When it comes to media, not everything that counts can be counted

One of the great ironies of the online media business is that there are more ways to measure reader activity than there have probably ever been in the history of human communication — pageviews, unique visitors, time spent, clickthroughs, etc. — but no one can seem to agree on which measure accurately reflects the value that content creates. It’s like quantum mechanics: Our tools have never been better, but the thing we are trying to measure still slips from our grasp.

A sense of frustration at this state of affairs seeps out of a recent post by Evan Williams, the former co-founder and CEO of Twitter and founder of Medium, the site that is part content platform and part traditional publisher (something he also recently posted some thoughts about, after some criticism from Pando Daily’s Sarah Lacy). The industry still seems obsessed with large numbers such as pageviews or unique visitors, he says, but this results in sites and services that are “a mile wide and an inch deep.”

“We literally say one company or service is bigger based on a single number?—?specifically, number of people who have used it in the last 30 days. Even without even getting into how use is defined, this is dumb.”

Pictures vs. tweets

This is particularly obvious when comparing services like Twitter and Instagram, says Williams, returning to the scene of an earlier argument. As he put it in his original comment to Fortune, Twitter is “what we wanted it to be. It’s this realtime information network… important stuff breaks on Twitter and world leaders have conversations on Twitter. If that’s happening, I frankly don’t give a shit if Instagram has more people looking at pretty pictures.”

Instagram new filters

His point, Williams says, isn’t that Instagram is somehow less valuable because it involves pictures, but that the two services are trying to do completely different things, and so measuring them with the same blunt instrument — whether it’s called unique visitors or monthly average users — tells you virtually nothing of any value about their likelihood of success.

Even replacing those kinds of crude measurements with something like time spent probably doesn’t help with services like Twitter, Williams notes, since it is somewhat similar to Google, in that part of what it does is link to things, and thereby send people elsewhere. How does one measure the value of that?

“Twitter is as much utility as media and part of its benefit is being incredibly concise?—?plus, a lot of its purpose, like Google, is to point people off to other places. So optimizing for time spent probably wouldn’t make sense.”

When it comes to sites like Medium, however, looking at time spent gets closer to what they are trying to achieve, Williams says — so the site looks at a metric it calls “total time reading,” which is similar to what Chartbeat terms “total engaged time” and Upworthy refers to as “attention minutes.” These metrics are an attempt to discover real engaged users, as opposed to the drive-by click traffic that is never going to return.

Time spent vs. clicks

In Medium’s case, for example, a recent post that went viral on Facebook drove traffic numbers through the roof: “By number of unique visitors to medium.com, we blew it out of the park,” says Williams, “but the vast majority of those visitors stayed a fraction of what our average visitor stays, and they read hardly anything.” And so the company was much happier with a week in October when the unique visitor count was 40 percent lower, but time spent was 50 percent higher.


Although he touches on it somewhat — where he notes that Wall Street continues to value companies based on outdated metrics like monthly average user — the Medium founder doesn’t really grapple with the underlying cause of the media’s obsession with pageviews or unique visitors: namely, the fact that the advertising industry continues to focus on those raw numbers, regardless of whether they actually denote anything of value, because the ad industry is arguably even more backward than the media.

There are signs of hope here and there, with Chartbeat pushing the time-spent measurement and being accredited to do so for advertising (which will make the metric more appealing for both publishers and advertisers) and certain publications like the Financial Times and The Economist convincing ad agencies to go with time-spent measurement instead of raw visitors. But it’s going to take more than that to shift the industry towards measuring actual engagement rather than the equivalent of window-shopping or foot traffic.

The biggest problem is that there is no single “God metric,” as BuzzFeed founder Jonah Peretti put it in a recent interview — no over-arching measurement that both describes value and is easy for advertisers to understand. It changes depending on what the content is and what the goal is. As sociologist William Cameron put it: “Not everything that can be counted counts, and not everything that counts can be counted.” That may be hard for advertisers and publishers to accept, but it’s true.