Big Data? Big Deal. #MRX

Recently, a new beast has begun to terrorize the market research industry. Big Data. Say it with a booming echoey voice and it sounds even scarier. For a while, I thought I was missing something. Big Data must be a specific term for something newly discovered, a new book, a new piece of software. But alas no. It simply means what it sounds like. Really big data sets.

Because I’m in the market research industry, I’ve worked with online survey panel datasets of hundreds of millions of records, transactional datasets with hundreds of millions of records, and social media datasets with hundreds of millions of records. If we allow for individual data points, then I’ve worked with datasets containing billions of data points.

So why are folks getting all excited big data? Have they never worked with big datasets before? Are they just now realizing that big datasets exist? Believe me, big datasets are no big deal to market researchers. This is what we do everyday. We already get it. Just ask us.

4 responses

  1. No, there’s a difference. You have to have your millions of records served from a Hadoop database server. That’s all.

    1. Thanks for the confirmation. I thought i was crazy.

  2. No, they haven’t worked with big datasets before. Most of the crowing over Big Data seems to come from people who don’t have much experience with data analysis. So much emphasis on managing the data, so little on what it takes to extract useful information from it.

    Thanks for the plain talk, it’s a breath of fresh air.

    1. Thanks. You deserve high response rates. 🙂

%d bloggers like this: