• Tuesday, May 29, 2012

Previous

Next

Southern Cal Twitter-Mining Tool Picks an Oscar Dark Horse

February 23, 2012, 4:28 pm

Oscar statueWhen it comes to which movies deserve an Oscar this Sunday, are fans and the official voters divided?

The public would have picked Avatar over The Hurt Locker in 2010, some say. But this is “The Age of Big Data,” as The New York Times put it recently. Which means computers can help settle this film-buff debate, courtesy of a new tool co-developed by the University of Southern California’s Annenberg Innovation Lab.

The lab’s “Oscar Senti-meter” mines millions of Twitter messages to chart how much people are talking about the nominated films, and, more important, whether that chatter is positive or negative. The inside dope among industry types holds that The Artist will win best picture. And Twitter fans, too, are showing the silent film a lot of love, says Jonathan Taplin, director of the new USC lab.

“The dark horse, from our point of view, is Midnight in Paris, which also has a huge amount of positive sentiment,” Mr. Taplin says, repeating a prediction he made in Forbes on Tuesday. “That could be the one surprise.”

USC’s movie project, a partnership with IBM and the Los Angeles Times, grew out of a broader effort to apply the same technologies to the Arab Spring and politics.

The big challenge is sarcasm, Mr. Taplin says. When somebody tweets, “I’m so happy that Michele Bachmann threw her tin-foil hat in the ring,” the machine reads that as a sign of enthusiasm. But lots of human corrections have helped the computer get better at understanding the subtleties of language, as well as emoticons and other symbols.

With movies, the software has proven “astonishingly predictive” of success, Mr. Taplin tells Wired Campus. If a film comes out on a Friday, Twitter sentiment on the preceding Monday, Tuesday, and Wednesday can generally forecast its fate. For example, the studio thought last summer’s Cowboys & Aliens would be a smash. ”We knew from the sentiment that it was going to tank,” Mr. Taplin says.

His lab plans to release a tool similar to the Oscar Senti-meter for monitoring tweets about politics.

This entry was posted in Computer Science, Research, Social Networking. Bookmark the permalink.

  • Print
  • Comment
  • mrkaplan

    I understand that this might tell interested people what the buzz is on Twitter, how much buzz there is for each film, and whether that buzz is positive or negative. What I don’t understand why this has anything to do with which film is will win any of the awards. It’s entirely possible that Midnight in Paris will win something unexpectedly, but, if so, that will only be coincidental to what this senti-meter finds. The Oscars are not popularity contests amongst the general population or Twitter users. As the LA Times recently reported, these awards are decided by 5,765 voting members of the Academy of Motion Picture Arts and Sciences, and these people are over 90% white, over 75% male, and over 85% are 50 years of age or older.
    http://www.latimes.com/entertainment/news/movies/la-et-unmasking-oscar-academy-project-html,0,6763063.htmlstory
    Unless this senti-meter can tell which of the people on Twitter are members of this voting group or can survey these demographics, then I don’t understand how it will tell us who might win. (And the demographics wouldn’t tell us much since the members are also film industry insiders.) As this Chronicle story mentions in the second paragraph, the public and the Academy sometimes different things. As the story mentions in the second-to-last paragraph, this metric can be useful when predicting general success, but that is hardly the same thing as an Oscar.

    I teach journalism for high-school students, and, if one of my students turned in the above piece as a draft, I would return it with the following comments/questions for the revision:
    a) When was this “buzz” measured? Was there any consideration of when the window for voting was? That is, was this senti-meter measuring buzz after all the votes had to be in?
    b) In the past, has there ever been a winner of the Award that was also the popular choice? If so, how often does that happen? Is there any sense that buzz on Twitter correlates to general popularity?
    c) Was there any attempt to identify Twitter accounts of any of the voting members of the Academy?
    d) What’s the Venn Diagram of Twitter users and members of the Academy?

    If no one has attempted to answer these or similar questions, then what are we talking about? Right now, this piece reads like someone predicting the dark horse for the Iowa caucus based on a poll conducted on a random street corner in Miami.

    The Academy is a quirky, specialized group that often is at odds with the general public. General Twitter buzz seems a poor metric for predicting the winners.

  • parrymarc

    You are absolutely right — this tool only reflects public sentiment, not how the academy might vote. I did not intend to imply otherwise. Sorry if any part of my post conveyed that impression.
    -Marc Parry

  • dailyreader

    It’s interesting that the Artist actually did win