BrandSavant

Gaining Insight From Social Media Data

A recent study posted in AdAge would have you think so. The study, conducted by an agency called 360i (direct link to the data here) examined 1800 tweets and determined that only 12% of updates posted to Twitter mentioned a brand – and for most of those, the brand was Twitter itself. The implicit conclusion: no one is talking about your brand on Twitter, so brands can direct their attention elsewhere.

I’m certainly not going to argue that Twitter is anywhere near as significant as other channels, and it is true that many marketers use Twitter like a big “easy button” for the Internet. Pushing it tends to give you immediate feedback, which is gratifying, but also tends to summon other marketers.

I’m not willing to go completely down the road of irrelevance based upon this study, however, for one important reason. The AdAge article states that, “after spending six months going over a statistically significant sample of 1,800 tweets,” the researchers were struck by how mundane most were. It is true, by the way, that 1,800 tweets would give you a statistically significant sample – I know, given the metric tonnage of tweets the service throws off every hour that it seems like a small number, but (cue Sly Stallone voice) Sampling Is Da Law.

The problem with the sample isn’t the fact that the N=1800. 1800 respondents would be fine if you sampled them all at once. If I drank from the firehose right now and just grabbed 2000 truly random tweets, you could actually draw some valid conclusions with a 2-3% margin of error on the total. However, that isn’t what this study did – instead, they looked at 1800 tweets over a six month time period. If we assume that they were spaced out regularly, that’s 300 a month, or roughly 10 per day. Even if we accept one month as a valid sampling time frame, what this study gives you isn’t one 1800-person sample, it’s six 300-person samples. Bolloxing them all together gives you a big number, but introduces a longitudinal bias into the data that’s pretty much a non-starter as far as I’m concerned. We weren’t talking about BP six months ago, for instance. And we aren’t really talking about Toyota now.

That’s about as far as I’ll go here to disparage the data, but it does beg the question – why so few? Harvesting tweets is, as far as I know, essentially free and relatively painless. Why not analyze 50,000 of tomorrow’s tweets and see if you get the same result? Yes, it’s work. That’s kinda what makes it worth doing.

Post to Twitter

{ 3 comments }

The Blind Retweet

by Tom Webster on July 26, 2010

Here’s a stat I’d love to know – what percentage of retweeted links on Twitter are never actually read by the retweeters? So many of the current crop of Twitter influence/trust measuring services place a great deal of weight on the “retweet” – perhaps more than is healthy. Some may factor retweets in as just one component of their algorithm, but then use other third-party Twitter measures (that are also largely based on retweets) as other components, which may actually compound the error. What I don’t know, though, is if any of these services measure the “blind” retweets – those links passed along without being actually read by the retweeter – and if those particular retweets are treated differentially.

The fact is, just as there are multiple reasons why someone might retweet a link, there are equally numerous reasons why someone might retweet a link they didn’t actually click on. Some of these are innocuous enough (they might have already read it, for instance, as Matt Ridings reminded me), while others may be purely sycophantic. Some retweets stem from a genuine trust in the original source; others are simple gamesmanship. That a retweet – especially of unread content – implies influence of some kind is probably axiomatic; however, since the motive for a retweet can’t be parsed by a machine, the degree to which a blind retweet implies trust can’t really be discerned with an acceptable degree of certainty.

So, here is my open question to you, dear readers. Is a retweet of a link I did click on qualitatively or quantitatively different than a retweet of a link I didn’t click on? I’d especially love to hear from anyone in the Twitter grade/level/clout measuring business. I’m open minded about this – convince me in the comments. The floor is yours…

Post to Twitter

{ 16 comments }

This report claims it can, and the New York Times ran with it. Once that happened, the Twittersphere started tweeting it (presumably, making Twitter users “happy.”) Anything to this? Well, I’d point out that as of earlier this year, only about 7% of Americans were even on Twitter. The data was also collected from 300 million Twitter messages stretching back to 2006. The first time we ever added Twitter usage to our tracking surveys was in late 2007 – when Twitter usage was essentially a rounding error and not even representative of .1% of Americans. So this data, while colorful and interesting as a snapshot of Twitter, can hardly be billed as representative of the mood of the nation.

Still, I’m not going to beat up what is a fascinating look at the mood of persons who have updated their status on Twitter (which is not the same thing as Twitter users.) Where such a study becomes interesting to a researcher like myself would be if a similar chart could be constructed of the actual “National Mood,” and then compared to this data. If you had both datasets, then you would not only have the true National Mood (you don’t need the Twitter data for that), you would also have a valuable means of calibrating the tendencies of Twitter users by examining where they differ, and where they resemble, the 90+% of Americans who don’t use Twitter. For instance, our last data on Twitter users revealed that they were more optimistic about a U.S. economic recovery – but is that due to their own economic circumstances, or are Twitter users actually generally more optimistic people? For social media researchers, that is pretty valuable stuff.

So, “pulse of the nation,” as the article claims? No, but pulse of Twitter, yes. Comparing the two would be a seriously interesting study, but one I’m in no mood to conduct.

Post to Twitter

{ 0 comments }

The Twitter – Facebook Disparity

July 19, 2010

Last night, I attended a minor league (AA) baseball game in North Carolina (where I live) and was struck by [...]

Read the full article →

Is The Social Web An “Economy Of Favors?”

July 16, 2010

A short thought for “Follow Friday“: spend a little time searching out people who take you well outside your comfort [...]

Read the full article →

What You’re Missing By Measuring Social Media ROI Online

July 15, 2010

The short answer is: a lot. If your social media efforts are strictly tied to tweeting out coupon codes, then [...]

Read the full article →

Is Social Media Monitoring Worth The Trouble?

July 14, 2010

Karl Havard posted a provocative article this week on Econsultancy entitled “Social Media Monitoring: Time To Say ‘Sod It’?” (for [...]

Read the full article →

Trust And Our Addiction To Link Shortening

June 23, 2010

When I publish this blog post, a plugin will dutifully tweet you all that I’ve written something new here on [...]

Read the full article →

The Value of Empirical Research

June 22, 2010

Yesterday I read a critique of a new study that represented itself as empirical research on an aspect of social [...]

Read the full article →

The Big Money In Small Numbers

June 14, 2010

A recent post on Search Engine Land highlighted a small survey of businesses currently advertising on Foursquare. The headline for [...]

Read the full article →