Chicago Tribune last, NPR first in test of news websites’ speed

Idea Lab | Brian Abelson
Phillip Smith tested the speed of various news sites using tools from GTmetrix. NPR and USA Today absolutely smoke their competitors, Smith writes, while the Chicago Tribune has “one of the slowest sites on the Internet.”

NPR Director of Engineering Irakli Nadareishvili tells Smith that one of NPR’s philosophies is “Speed is a Feature. Our tech team has been investing heavy effort in getting great page load-times.” Smith made a teeth-grinding video of a Tribune page loading.



Third-party add-ons to sites can cause slowness, Smith writes, as can sites that are optimized to mobile instead of desktop users. Many data intensive news apps can be “baked out” — “served as a large collection of static files,” he writes.

New York Times OpenNews Fellow Brian Abelson is also thinking about news apps —  specifically how to measure engagement with them. Traditional statistics like page views and time spent on a page aren’t adequate metrics, he writes: “A ‘successful’ news application is one that presents a reader with a story and offers them an opportunity to dig deeper.”

Given this common structure of news applications, it should be possible to create a simple metric that captures the degree to which readers use an app to move from the far view to the near view. Such a metric might help newsrooms begin to assess readers’ level of engagement; defined here as the intersection of what readers want and what newsrooms want readers to do.

Abelson uses stats to measure engagement with a Times interactive feature on red-carpet outfits, comparing time spent on the app to the number of features — color filters, shares — readers used. He proposes a more involved equation to measure engagement. Such equations will become more important, Abelson guesses, because “without a metric for news apps, our only tools for gauging success will be conjecture and anecdote — a great irony given the meticulousness with which data is cleaned and analyzed to construct these projects.”

With a standard, interpretable metric, editors and journalists can begin to judge whether their intuitions match up with their readers behavior; analysts can compare apps over time and across news organizations; developers will come to value simplicity of presentation and ease of use over technical complexity; and, perhaps most importantly, news organizations will begin designing their digital offerings with users in mind.

Related: Washington Post website now slightly faster than Huffington Post

We have made it easy to comment on posts, however we require civility and encourage full names to that end (first initial, last name is OK). Please read our guidelines here before commenting.

  • http://twitter.com/javaun Javaun Moradi

    You’re very correct that third-party software and ads do slow down page performance. When it comes to ad servers, even though we call ours “sponsorship” (there are very strict rules on what we will display, no offers, no superlatives, i.e. “#1 leading…”, etc), we still use the same 3rd party serving software as everyone else.

    I do want to give a shout to my colleague Irakli and our engineering team. They looked at every aspect of site delivery from the backend to the client side and made significant changes last year with speed as the main goal. The deadline was the November election, and the site was fast, not just on the east coast but everywhere.

  • http://phillipadsmith.com/ phillipadsmith

    @danwin:disqus @twitter-10135802:disqus You’re both correct, of course: the number of ads, the ad-serving software, and the 3rd-party ad networks being served via those ad-servers, which may in turn be routed through another system, is a complicated mess and — without a doubt — adding to the page load times for Chicago Tribune (a site that carries a high number of ads compared to the others).

    Admittedly, calling out NPR was not an apples-to-apples comparison, even though they do carry display “sponsorships,” but taking the next site — USA Today — the same lessons can be distilled, IMHO: speed is important and it’s attainable with some focus.

    Ultimately, I think the ranking overshadowed the intent of the post, which was to point out that speed is still a concern in 2013 and that there are relatively straightforward ways to improve it (even if you’re stuck with the ads). The Tribune, ads aside, has lots of room for improvement as is detailed in the test reports.

    Thanks for the feedback. Lots to think about for the next column. :)

    Phillip.

  • http://twitter.com/yelvington Steve Yelvington

    Ditto what Dan said. Ad servers, especially third-party network ads, are performance poison.

  • http://twitter.com/dancow Dan Nguyen

    I think it’s important to note that NPR seems to rely much less on display advertising for their digital revenue.