Headlines from our Mobile Media and Social Media blogs, plus posts about the future of news from our friends at paidContent, Mashable, Lost Remote, Nieman Journalism Lab, MediaShift’s Idea Lab, J-Lab and Reynolds Journalism Institute.

Screen Shot 2014-07-02 at 1.21.03 PM

As mobile ad revenue continues to soar, newspapers still struggle to catch the wave

Screen Shot 2014-07-02 at 1.22.19 PM

There was a double dose of good news in eMarketer’s mid-year ad forecast released today. Ad spending will grow more than 5 percent in 2014 for the first time in 10 years. And the mobile ad boom shows no sign of plateauing with 83 percent growth over 2013 expected.

Digital giants like Facebook and Google continue to dominate the category (together more than 50 percent), while newspapers and magazine struggle to offer competitive ad buys on their mobile products.

The Newspaper Association of America’s revenue report for 2013, released in April, found that mobile advertising had grown 77 percent for the year but still accounted for less than 1 percent of total revenue.  By contrast, as Facebook reported its first quarter earnings the same month, it said mobile had grown to 59 percent of its total ad revenue.

A newspaper publisher friend summarized the state of play in his industry this way — “2013 will be remembered as the year when mobile went from infinitesimal to insignificant.”

Doing better in 2014 remains a high priority for many newspapers, but more bumps in an already bumpy road are foreseeable.

The American Press Institute held a summit on mobile this spring and found that detailed personalized data is the key to sales.  That is a great strength of Google and Facebook as the digital giants continue to invest heavily to stay ahead of competitors

The creative side of effective mobile advertising is a work in progress for marketers.  The consensus seems to be that banners do not work well on smart phones and tablets and that video, GIFs and other entertainment along with location-specific messages are the better match to how customers use the devices.

The right sort of sponsored content/native advertising also fits with mobile, especially if it is the sort of thing users will share on social media.

In short, these are characteristics of the new generation of content sites like BuzzFeed (which does not take banners) but relatively unfamiliar to legacy operations which do.

Mobile news content is also in early stages of development except at the largest organizations like the Wall Street Journal, New York Times, Washington Post and Boston Globe. They have put money into iterative improvement of apps that both display well on the smaller smartphone screen and are tailored to quick, on-the-move consumption.

My own hunch is that getting video right and getting stronger mobile ad performance will go hand in hand for news sites — challenging and frustratingly slow work but hardly impossible.

If the eMarketer forecast is correct, the imperative will only intensify. The research firm sees mobile advertising revenues passing the total ad revenues for newspapers this year and more than tripling them by 2018. Read more

Tools:
6 Comments
More in Digital Strategies
Bird words

How to do Twitter research on a shoestring

Twitter’s increasingly influential role in journalism has prompted an accompanying upsurge in academic research, particularly around the ways in which journalists and media organizations have integrated Twitter into their norms and practices.

With 500 million tweets a day, Twitter offers researchers a potentially deep and rich stream of social media data. However, unlike historical newspaper content, which is readily available via library microfiches or databases like Lexis Nexis, much of the historical data on Twitter (what’s called the Twitter firehose) is walled off in costly private archives.

Information may want to be free, but accessing and analyzing that information can be costly.

The Library of Congress signed a deal with Twitter in 2010 to build an on-site research archive but that system has still not been finalized. A progress update is expected this summer, but the archive, which now houses more than 170 billion tweets, poses major logistical challenges for the Library and the firehose reseller Gnip, which is delivering the data for Twitter. For example, a single search of the 21 billion tweets in the fixed 2006-10 archive was taking 24 hours just last year. Twitter acquired Gnip in April, prompting hopes that the archive may be operational in 2014-15, but even so, the archive will only be accessible on-site at the Library in Washington, D.C.

That source of reliable, inexpensive online access to the Twitter firehose has become almost a Holy Grail for journalism professors in the U.S. and Canada who I surveyed this June using a Google form.

Kathleen Culver, assistant professor at the University of Wisconsin-Madison, says she would like to see “portals for academics into Twitter, supported by Twitter,” and an easy user interface for research. Alf Hermida, associate professor at the University of British Columbia, agrees. Hermida, who has just published a new book on social media, says such a portal could contain “shared archives of Twitter data, best practices and approaches.”

Mike Reilley, online journalism instructor at DePaul University in Chicago says he wants something that will let him go deep. “I’m looking for that ‘super tool’ and am hoping someone at JS Knight Stanford comes up with one. An all-in-one tool – scrapes, archive, great search, everything. I’m tired of ‘tool-hopping’ to get work done,” he said.

Flawed early Twitter research tools

Early efforts such as the freemium TwapperKeeper service offered that “all-in-one” functionality, albeit with some restrictions. TwapperKeeper, which allowed users to create and download .csv files of Twitter archives, limited historical searches to 7 days earlier or 3,500 tweets (whichever came sooner). However, TwapperKeeper, which was launched in 2009, was taken over by HootSuite in 2011 and became a premium subscription product.

Some researchers then shifted to Topsy Pro, which offered trial accounts for researchers or a single annual license for $12,000, but the datasets were often incomplete.

Hermida says Topsy used its own criteria to delete tweets from the archive. “Topsy removed tweets that had been deleted from the Twitter firehose, and tweets without at least six retweets or a retweet by an influential user were removed from the search index after 30 days,” he said.

Robert Hernandez, associate professor of professional practice at USC Annenberg School for Communication & Journalism, says he has long suspected such archives could be flawed. “I always have an uneasy feeling that the archive – whether I get it formally or not – doesn’t feel as accurate or complete as one thinks,” he said.

‘Divide between data-rich and data-poor researchers’

A more robust historical search, such as analyzing the #Newtown tweets to examine journalists’ behavior in the hours immediately following the school massacre, would require subscription to a certified Twitter firehose service such as Gnip or DataSift.

These services can retrieve an unlimited amount of tweets from practically any time in Twitter’s history. But the resellers’ main focus is businesses seeking more data on how consumers view them. Thus, their pricing is aimed at institutions or corporations. The pricing plans for both companies are difficult to decipher (both sites ask users to submit a Web form for a quote) but a 2014 article put DataSift at about $3,000 a month with Gnip starting at $500 for each one-off search. Licensing fees cost an additional $0.10 per 1,000 tweets and are paid to Twitter. These licensing fees accounted for $32 million of Twitter’s earnings in the first half of 2013.

However, a $3,000-a-month subscription level or even a $500 search would be too expensive for most academics unless they were able to make arrangements with their institutions.

Hermida’s university uses Crimson Hexagon, which charges $5,000 a year for 50 search terms or “monitors” as part of its Social Research Grant Program. Elizabeth Breese, senior content and digital marketing strategist, said the program seeks researchers who are “a good fit… that the research is non-commercial in nature, and that the results will be made public in some way,” she said by email. The grant program provides 50 “simultaneous monitors” which can be deleted to provide for a new query, giving researchers more flexibility.

Meanwhile, a freemium Twitter scraping tool from the British company ScraperWiki could be the solution for cash-poor researchers. Users set a hashtag, keyword or user name as a search term and then let ScraperWiki monitor Twitter for all new occurrences. Like TwapperKeeper before it, ScraperWiki can only create new archives rather than search for historical data, but the drawbacks of the service are mitigated by the price.

Pricing starts at $9 a month for “Explorer” access to three datasets and tops out at $29 a month for “Data Scientist” access to 100 datasets. The main drawback, as discussed, is the lack of historical data. But the tool is incredibly robust and a well-planned project could return tens of thousands of rows of data for analysis and visualization as there is no maximum limit on tweets.

For example, using the Data Scientist package, a researcher could easily track the ongoing output from up to 100 users for a project such as a comparative analysis on a constructed week. In my own research, I used ScraperWiki to retrieve approximately 22,000 tweets tracing the social media development of the Tuam babies story in Ireland in May/June 2014.

ScraperWiki CEO Francis Irving says the scraper is easy to use. “Once you know the search term or user you want to archive you can create the dataset and let the tool run. Once you have enough tweets, you can download the data for analysis,” he said via Skype. The software can also visualize and summarize the data, saving much work for the researcher.

A similar freemium tool is Simply Measured’s RowFeeder, but the datasets are more expensive and the results are more limited than ScraperWiki’s. For example, RowFeeder’s cheapest product, which costs $35 a month, includes just three datasets for a maximum of 5,000 tweets per month.

In the absence of an archive from the Library of Congress, ScraperWiki seems a reasonable solution to the ongoing problem of how to collect and analyze meaningful Twitter data. Its relatively inexpensive pricing partially addresses the growing two tiers in academic research caused by the high cost of data analysis. As Hermida said in the survey, “Paying for access means that there could be a divide between data-rich and data-poor researchers.”

Correction: A previous version of this story misspelled Mike Reilley’s name.

Kelly Fincham, an assistant professor at Hofstra University, has been using Twitter for research since 2010. Read more

Tools:
13 Comments
More in Social Media

Latest from Our Partners

  • Creating a ‘Virtual Space’ for Community News

    The inewsource “virtual space” idea started with a simple goal: get more eyeballs on inewsource content. But as we started to play around with a strategy, the goal became much more ambitious. I’ve long believed that as traditional media has shrunk, people seeking information valuable to their lives have thronged to the niches – whether [...]
  • Verizon refutes editor's claims that its tech site will censor stories

    Corporate blogs that tow=e the company line have become increasingly common in recent years, but a new site from Verizon has raised eyebrows for a policy that prohibits its writers from writing about spying and net neutrality On Tuesday, Patrick Howell O'Neill, a writer for the Daily Dot, revealed the details of an email exchange [...]
  • Social Scoreboard: Tuesday, October 28

    Last night, NBC’s “The Voice,” and ESPN’s “30 for 30″ took the top two spots, respectively, in Nielsen’s Twitter Ratings. “Sons of Anarchy” took the number three spot, but we bet that starts to change as things get even weirder approaching the series finale. The CW’s “Supernatural,” and ABC’s “Marvel: Agents of S.H.I.E.L.D.” rounded out [...]
  • Tracking John Oliver’s #ShowUsYourPeanuts Campaign

    John Oliver struck again this week, this time tackling the food industry and how much hidden sugar they put in our food. In his end-of-show takedown rant — he’s previously targeted militarized police forces, internet service providers, and Scotland — he asked viewers to tweet at food companies and ask them to #ShowUsYourPeanuts. You can [...]
  • Controlled chaos: As journalism and documentary film converge in digital, what lessons can they share?

    Documentary film and journalism are, in many ways, rooted in the same traditions. Though focus on narrative often differentiates film from traditional journalism, it helps to remember that the earliest films were straightforward recordings of real life, such as trains pulling into stations Decades after L’arrivée d’un train en gare de La Ciotat, journalists like...
  • MTV Promotes ‘Scream’ With Mysterious Emoji Tweets

    MTV has picked up “Scream,” a horror series based on the Wes Craven film franchise. And then they promoted it with emojis. Targeting media outlets and TV people in general, they sent a slew of tweets with scary movie inspired emojis, a phone number, and a hashtag. According to various people on Twitter, that phone [...]
  • With Video on Demand, ‘The Walking Dead’s’ Success Stretches Beyond Sunday Nights

    As we wrote about last week, Video on Demand is changing how people watch TV and Comcast’s ‘Xfinity on Demand’ is one of the main catalysts. The platform includes more than 55,000 choices, which results in more than 400 million views each month. With the way that networks and advertisers are demanding that post-linear viewing [...]
  • OpenNews Announces Its 2015 Knight-Mozilla Fellows

    We’ve been looking for Knight-Mozilla Fellows for four years now, and so you begin to notice patterns during the process. There’s that moment when you worry that there won’t be enough applicants, and then that other when you worry there will be too many. There’s that melancholy time when you realize that you won’t have [...]
  • The FCC is about to light a fire under the television industry's ass

    Cable companies have enjoyed a regulatory buffer from Internet competitors when it comes to television. Those days may be numbered, opening the door for companies like Aereo to compete with companies like Comcast and Time Warner Cable. FCC Chairman Tom Wheeler said on Tuesday that he has circulated a proposal that would change the regulations [...]
  • The near future of First Look’s next site, Racket, looks fuzzy

    Andrew Rice reported for New York magazine’s Daily Intelligencer earlier today that Matt Taibbi has gone missing (update: he’s out) from First Look’s New York offices “after disagreements with higher-ups inside Omidyar’s organization,” where he’s supposed to be launching new digital political satire rag Racket. Sources confirmed that Taibbi has been absent from the office...