BrandSavant

Gaining Insight From Social Media Data

Social Media Monitoring 201: The Market Research Perspective

by Tom Webster on February 25, 2010

So, you’ve taken the big first step in social media for your business: listening. You’ve set up Google Alerts for your brand, done some Twitter searches, and maybe even signed up for some heavy duty monitoring services from the likes of Radian6, Trackur or Tweetfeel. Sentiment analysis is far from perfect, but on a pretty good day, it will give you a pretty good idea of the consumer zeitgeist out there for your products and services. So, let’s stipulate that you are listening, you can measure the conversations, and you have a pretty good idea whether or not those conversations are trending positively or negatively towards your brand.

Now what?

Certainly part of social media monitoring operates under the aegis of customer service–if people are tweeting problems, your customer service representatives should be out there actively listening to and solving those problems. Those are important interactions, but they are tactical interactions. How do you incorporate that information into more strategic initiatives?

Before you can tackle that, you first have to  make sure that your ears are as wide open as they can be. Listening to Twitter is fine, but Twitter conversations represent a small fraction of the overall universe of social media conversations, and are subject to biases unimaginable (though I’ll have some exciting data on that score soon…). If you want to elevate social media monitoring from the tactical to the strategic, you owe it to yourself to take in those inputs from as many sources as possible, to insure the stability of your data and improve the representativeness of your sample. So–Twitter, Facebook, blogs or message boards? The answer is yes.

Once you have ensured that your input stream is as robust as possible, then you are ready to go beyond simple sentiment analysis and start to segment those conversations. In market research, we do this all the time with open-ended responses to quantitative surveys. In most national survey work we do, we leave openings for respondents to provide open-ended responses to questions–the “whys” behind the “whats.” In order to make sense of those responses, we code them–we have trained survey teams go through these verbatim answers one-by-one and assign them categories. There may be, for instance, 1000 different responses to a question like “why are you dining less often at J.P. McBeers?” but chances are they fit into one of a handful of buckets. Developing those buckets is an iterative process, but after going through a hundred or so responses, y0u’ll probably be 99% there, and the rest will go fairly quickly. Are there computer algorithms to do this? Yes, but they aren’t as good as people, and once you have a good code list it’s fast work anyway–that’s what you have interns for. Many of the top social media monitoring platforms have tools to help, so feel free to use them if you have them.

So, let’s say that you’ve combed through 10,000 brand mentions for J.P. McBeers, and you’ve segmented them into buckets–declining food quality, appearance of other casual dining alternatives, change in economic circumstance, etc. The next step is to go back out into the wonderful world of social media and probe around some of these segments by engaging with commenters. The wonderful thing about social media for customer service reps and community managers–the infinitely variable interactions between company and customer–turn out to be the bane of your market research team. We like to control for variables–it helps us provide better answers to your questions. In terms of this exercise, that means doing something that might be counter-intuitive to your community managers, but really just gives them a framework to do their jobs more effectively. For each of the conversation segments you have identified, come up with a few questions you’d like to ask those people, and standardize them. Have your social media teams go back to the folks who made the original comment, tweet or post, and ask them a specific follow-up question–just one or two, and make them the same every time (for each specific bucket/issue.) Asking one or two really great questions the same way every time beats asking 1000 different questions six ways to Sunday, and gives you more confidence in extrapolating quantitative data from social media–and insight from that quantitative data.

In the case of our example, let’s say that one of the big buckets of conversation topics revolving around J.P. McBeers are conversations revolving around people spending less going out to eat. A crappy consumer insights team would take that data and deduce that J.P. McBeers needs to cut its prices. You can do better. Here’s what I would like to ask the folks who made these comments: have your economic circumstances changed for the worse? If not, what are you spending more money on lately? Knowing the answer to that opens up a whole new world of consumer insights for not just the brand in question, but the evolving needs of  your target consumers and how you can best serve those needs.

If you can standardize the question(s), you can standardize the responses and make apples-to-apples comparisons. Is this the last word on reliable consumer insights? Hardly. Will it let you make some intelligent hypotheses that you can test in situ or with split-tested offers? Definitely! To me, this represents the real next generation of market research for brands–reengagement after the question, turning market research into relationships, and relationships into market research. The key is to do a little thinking beforehand, standardize on a few really good questions, and empower your engagement team to go out and get the answers.

Be Sociable, Share!
  • http://www.radian6.com Katie Morse

    Hey and thanks for the Radian6 shout-out! Using listening tools to improve market research is a great application – you’ve given me a bit to think about today; thanks for that!

    Katie Morse
    Community Manager
    @misskatiemo
    http://www.radian6.com

  • http://www.trackur.com Andy Beal

    Thanks for sharing your advice on how to segment and actually use the data being extracted from your monitoring efforts!

    Thanks also for the Trackur mention!

    P.S. Going to add this post to reputation.me :-)

  • http://www.listenlogic.com Chris

    Great post and great insight on using social media as a market research tool.

    I have to politely disagree with the thought of sentiment being far from accurate. With most of the tools out there, I agree – it’s a complete coin-toss due the disparity between the way people talk in social media and what the sentimental analysis is intended for.

    Our tool, RESONATE from ListenLogic, features adaptive sentiment through machine-learning. It actually learns the way people speak about your brand and adapts accordingly. Our in-house analysts are constantly fine-tuning the sentiment, and as a result we boast a much higher accuracy for sentiment.

    Once again, a great post and a great read. Will definitely be RT this one out there.

  • Tom Webster

    Chris, I didn’t say “far from accurate.” I said “far from perfect.” A very different statement, no? Thanks for reading!

  • http://www.trackur.com Andy Beal

    Tom, I wouldn’t worry, cos I’ll say it. Automated sentiment analysis IS far from accurate. :-)

    Chris, curious as to how often you find your analysis doesn’t need manual adjustment by the end-user. Anything more than a 10% error, and users tend to check ALL sentiment for accuracy–which defeats the object of automation. :-(

  • Tom Webster

    I’ll just add this–I think sentiment analysis is getting a lot better with what statisticians call “Type I” error, but “Type II” error is another story. One is a sin of commission, the other a sin of omission. If I Tweet that “I LOVE that my Toyota actually stopped this time when I hit the brake” what do you do with that? A human knows instantly what to do with that. A computer doesn’t–and won’t until the day when SkyNet takes over.

  • Mark Shavers

    Very good article. I like the way you take social media monitoring and break it down into it’s component parts. Listening, learning, and engaging. I think there’s good tools out there for listening and engaging, but there’s not very many for doing as you said ” In order to make sense of those responses, we code them–we have trained survey teams go through these verbatim answers one-by-one and assign them categories”. Isn’t that the learning part, where the real value is derived from the conversations in social media? Sentiment is somewhat useful, it gives directional guidance on how people feel about a brand or product, but it’s not 100% accurate. It’s also really only useful for PR and customer service. The learning part, being able to group people’s comments into buckets and seeing why don’t people eat at J.P. McBeers more often, that’s the real power of social media. Because what you learn from that, isn’t coming from a prompted response, it’s coming from unsolicited comments.

  • Pingback: brandsavant blog: next generation of market research  | web cubed – the next web

  • Pingback: Business Coaching: 9 Realities About Social Media For Your Business | Finding Answers

  • Pingback: Six Degrees Of Social Media Monitoring | BrandSavant

  • http://www.brandtology.com Ashley Lim

    Nice article, many companies are indeed stuck at the stage “yea, I am listening online, but I have not figured out what to do with the data”. I think its crucial for agencies to help clients analysis and segment the most relevant conversations so that they can look at integration into their existing product development, customer service, branding efforts.

    Ashley
    Social Media Consultant
    Brandtology
    http://www.brandtology.com

  • Pierre

    Thanks for the great article. Asking the “right” questions make a world of difference.

    Pierre Gauthier
    http://www.qualitative-research-canada.com/

  • Pingback: What’s the Deal With Data? « Measuring Social Media Success

  • Michelle

    Great concepts here for social media monitoring. I like the idea of breaking the segments up into buckets and then the follow-up question being the same so that you can dig even further into customer sentiment

  • ramandeep singh

    social media had become a reliable source of primary data for market research .. its the most accurate and cost effective way …i wrote an article on it on my blog , give it a look http://www.jasica.in/2012/01/four-reasons-why-social-media-is-most.html

Previous post:

Next post: