Tag Archives: NewMR

These data prove I am worth 80% of what my male research colleagues are worth #MRX #NewMR

As a freelance market research writer (my service sheet is here), I regularly check my public profiles to make sure they’re up to date. This time, I checked my profile on Savio, a marketplace connecting market research buyers with research experts, which is maintained by GreenBook.

Thumb print unlockAfter clicking around the website for a bit, I realized that every researcher’s hourly rate was completely and easily transparent, not hidden behind multiple clicks and privacy walls. My brain gears sped up….

People don’t talk about salaries which is a problem. Freelancers don’t know if they’re being paid what they deserve. Women don’t know if they’re being paid less than their equivalent male counterparts. So in that regard, I have to thank Savio and Greenbook for opening the black box and helping researchers see a piece of reality.

I had planned to go see the new Solo movie but this lovely little dataset just presented itself to me. Plus, I hear there isn’t any ukulele in this movie so let’s do this.

I downloaded the data and removed the business profiles. That left me with 191 individuals who provided an hourly rate, country, and the types of work they do. I manually gendered all the profiles. Obviously, I may have gotten a few wrong as I am not the gender police (much better said by Effin Birds) – 83 women, 107 men, and 1 unknown.

Hourly rates by genderAs all good data people do, I started with a frequency distribution. A few things were immediately apparent. 1) 3% of men and 4% of women VASTLY undervalued themselves. If you have listed an hourly rate under $50 per hour, go to your profile right now and FIX IT. I never want to see an hourly rate less than $50. From any freelancer. For anything. 2) 6% of men and 2% of women listed stunningly high rates, a couple over $1000 per hour. These rates might be for bragging, for negotiating, or for real but if you can command them, more power to you. 3) Women were far more likely to undervalue themselves while men were far more likely to overvalue themselves. [“THAT was a pencil in the neck moment!” -Luke Sklar]

Hourly rates by country and gender Maybe group averages would paint a different picture but nope. Across all 191 rates, women asked for 81% of what men did – $168 versus $207 per hour.I tried excluding outliers from 12 people whose rates were below $50 or above $500. Women still asked for 81% of what men asked – $153 versus $189 per hour. I then focused on the three countries with at least 8 researchers. In Canada, two women and myself listed rates that were a paltry 40% of what five men listed. Among 123 US researchers, women asked for a somewhat better 80% of what men asked for. I am thrilled, though, to offer a huge hurray to the 14 researchers in the UK where hourly rates listed by men and women were equal. (Okay, women can increase their hourly rates by $5 in the UK.)

Maybe it’s because women do “less valuable” work so I tried grouping by the 25 different type of work people specified they did. Major caveat though – these data do not account for the fact that someone might charge different rates for different types of work.

I’ll pick out two examples from the chart since it’s a little bit complicated and uses two axes. At the left of the graph, among people who offer legal research services, women specified an hourly rate of $169 compared to men at $136. Thus, women listed a rate that was 124% of what men listed. There exist four categories of work where women listed a higher hourly rate than men – Legal Research, Field Services, Recruiting, and Support Services.

Second, at the right of the chart, among researchers who conduct Mystery Shopping, women listed an hourly rate of $138 compared to men at $225. Women listed a rate that was 61% of what men listed. There exist 21 categories of work where men listed a higher hourly rate than women.Hourly rates by industry and gender

I don’t know if these differences are because women undervalue themselves or because men overvalue themselves. I don’t know how much of these differences exist for bargaining or bragging purposes.

But I do know this. As much as I love statistics, t-tests and chi-squares aren’t necessary to determine the likelihood that these results are due to chance. Correlations and Cohen’s D aren’t necessary to determine whether the effect sizes are meaningful.

Women ask for less financial compensation than do men.

Cindy Gallop Highest Number Without Laughing Gender Diversity Salary Income

Women, my advice to you is simple. Give yourself a raise. Give yourself a giant fucking raise. (I’m channeling my inner Cindy Gallop and I urge you to follow this amazing woman on Twitter or LinkedIn and personally talk about your salary with her here.)

Cindy Gallop Shit Ton Money Gender Diversity Salary IncomeIf you’re currently in the $50 to $99 bucket, up your rate to land in the $100 to $149 bucket. If you’re in the $200 to $249 bucket, give yourself a raise into the $250 to $299 bucket. Don’t think twice, it’s all right.

If you’re curious, I may have started my day claiming my worth to be 80% of what my male research colleagues felt they were worth.

It sure didn’t end that way.

You might wish to look at:

Happy International Women’s Day! Let’s meet some #MRX women who are flying under the radar #IWD #WIRe #NewMR #WIREheroes

International Women's DayHappy International Women’s Day!

The market research industry is lucky to benefit from a diverse range of people. Indeed, unlike some industries that are vastly male or vastly female, about half of us are women.

I know many women within our industry who regularly take the stage or sit on association boards or have roles on leadership teams. You probably know them too. Don’t you think it’s time to get to know some other fabulous women who keep the cogs or our industry turning? Let me start with two of those fabulous women!

I first met Kim Wong when she interviewed for a researcher position at Conversition, a social media research company. It was quickly apparent that she was a perfect choice. She figured out our business super fast, even though it was a strange concept at the time. She soon became a wizard at sentiment analysis, content analysis, and data quality of social media data. We could trust her to turn any set of random data into exactly what we needed. You know how amazing it is to find a colleague who can take a task and run with it independently? Yup, that’s Kim. Kim, cheers to you, your awesome contribution to our research team, and to the market research industry. 👏🏽👏🏽👏🏽👏🏽👏🏽👏🏽👏🏽👏🏽

Meredith Morino is another quietly awesome researcher who deserves a big round of applause. I love your dedication to and passion for qualitative research. I love your openness to try new things even when they seem outside your usual way of doing things. I love that you’re a team player who works hard to ensure that you and your colleagues at Sklar Wilton & Associates do well. Meredith, I look forward to many more intriguing blog posts from you, and even seeing you present on stage. You’ll be awesome, I know it. 👏🏽👏🏽👏🏽👏🏽👏🏽👏🏽👏🏽👏🏽

Do you know Kim or Meredith? It would be awesome if quiet people could stand on stage and get the huge applause that thought leaders/speakers get all the time so let’s do it here. If you appreciate the work that Kim or Meredith do, leave a note for them here. Even better, send them an email and tell them just how much you appreciate their work.

What do Kim and Meredith need to do now? Recognize another woman in research who is making a difference! Tell us which women researchers are your unsung heroes! You could leave their names in the comments below, tweet their name and why they are awesome, mention why they’re awesome on LinkedIn or, even better, email them and let them know why you think they’re awesome. Don’t forget to tag it #WIREheroes so we can clap for all these awesome people!

What should YOU do? If you’ve been named, and even if you’ve not, it’s your turn to name a woman in research who is flying under the radar. Let’s see how many unsung heroes we have! Don’t forget to tag it #WIREheroes!

Voxpopme Perspectives: Video posts… in writing

Along with a group of market researchers from around the world, I was asked to participate in Voxpopme Perspectives – an initiative wherein insights industry experts share ideas about a variety of topics via video. You can read more about it here or watch the videos here. Viewers can then reach out over Twitter or upload their own video response.

Except the video blogging thing wasn’t working for me. I do my best thinking in writing and I’m pretty sure you don’t want to watch me read a post. So instead, I’ll be sharing my thoughts in written posts. Feel free to write back if you’re so included. Stay tuned!


What’s Beyond Mobile? New MR: General Mills Goes All In by Ryan Backer, General Mills #CRC2014 #MRX #GreatTalk

CRC_brochure2013Live blogging from the Corporate Researchers Conference in Chicago. Any errors or bad jokes are my own.

What’s Beyond Mobile? New MR: General Mills Goes All In by Ryan Backer, General Mills

  • 2011 saw opportunity for mobile technology; 2013 felt confident they’d figured out mobile; 2014 formed emerging technologies team
  • 2011, they bet big. spent a year trying to get smart. convinced that by 2014 80% of research would be mobile.
  • Believers because 1) they felt they had to, mobile is surpassing desktop, default access point for all things internet, even surveys designed for desktops, particularly for multi-culturals and millennials, attention spans keep shrinking 2) pride themselves on bringing innovation to the marketplace, love idea of getting richer insights using bells and whistles of the phone – location, audio, visual, in the moment qualitative, feedback WHILE it’s happening 3) it felt right, traditional research feels ancient, we can now ask people to take a picture of their snack drawer and then see products they would never imagine sitting right beside your product, have people take pictures in the stores of how their product is always out of stock, it felt more natural in terms of ethnographic research
  • How did it go? GEMO – good enough, move on. there are plenty of warts but let’s move on
  • They heavied up and sold hard – did a lot of hand holding for any research project that seemed to work best with mobile so that every person had a positive experience with it. Had major meetings with large teams to showcase the mobile research so that everyone could see they could do mobile research too
  • They redefined best practice.
    • Ethnography – Not limited to certain geography, more honest feedback, it’s not a stranger interviewing you, you’re in your own home
    • Shopper satisfaction – Do it while you’re still in the store, not the next day after you’ve forgotten everything
    • IHUT – save on shipping costs, send them to store to buy something, ask questions about finding the product, comparing the products
    • Instant A&U – increased speed because everyone has phone with them at all times, can push a survey at any time
  • Invented new capabilities – answered questions they’ve never been able to get answered before, ask questions they’ve never had before
    • Mobile Missions: send people on a task
    • Geo-intercepts: without physically being in a store
    • LaunchWatch: get results on brand new products immediately, real time basket analyses
    • OTC ad-tests – typically in a controled environment but now they can do it “On The Couch,” as ads are experienced for the first time while you’re on your couch
  • Mistakes along the way
    • Lift and Shift ROR – You can’t just put a standard survey on a phone, know when to put audio video so that the research is done well not just somewhere else, know that results will be different because the method and timing and location is different
    • Multimedia paralysis – how do you handle hundreds and thousands of visuals, it’s very time consuming
    • New Method Flops – They never turn work away, but sometimes it just doesn’t work
    • DIY Scissors – They are many DIY solutions, anyone thinks they can do research and it results in “Running with scissors” research
  • Abandoned the mobile team now, but no longer have an in-house team, it’s just regular research now
  • Next is still mobile but also other things
  • We’ve reached the tipping point. Stop talking about mobile and start talking about device agnostic.
  • Close to 80% now, but not by dollars
  • They have a solid rolodex of suppliers and now recommend those suppliers to their teams
  • Know your barriers
  • data stitching is not easy, gamification is on their list, still need true full service – know research AND technology AND storytelling
  • Exponential change
    • Internet of things – connect all device and eeverything in between
    • quantified self – behavioral is now diary but we’re going way beyond that
    • augmented reality and virtual reality – could be THE next big thing
    • 3D printing – especially in food industry
    • artificial intelligence – natural language interpretation, unstructured data interpretation
    • robotics
  • looking for new applications of mobile, new data streams, and new technology/gadgets
    • Geofence consumers to within 4 inches when they are in front of a box of cheerios, how much time in front of those cheerios, build your own granola bar game
    • data streams previously unavailable – fitbit, wearables, consuming calories, how you burn calories
    • fridge with internet, clip on your shirt and takes a pictures every 30 seconds [need one!], coupons and menu ideas direct to your fridge monitor

10 answers to contemporary market research questions #MRX

Are you fresh out of school? Full of book knowledge but short on practical knowledge? Then this book is for you!

Join the book launch on May 22nd here!

10 Answers to Contemporary Market Research Questions provides new entrants to market research with a first point of reference in a fast changing industry. In  market research, there are some key concepts, ideas, and pieces of knowledge that even the newest researcher (or a researcher new to a topic) should have at their fingertips.

The 10 Answers to Contemporary Market Research Questions aims to present those key items as a set of questions and answers. While its not a manual of how to conduct research, it does provide nuggets of information that will enable new (and sometimes older) researchers to orientate themselves, and avoid walking into too many of the traps that the changing world of market research can create.market research, there are some key concepts, ideas, and pieces of knowledge that even the newest researcher (or a researcher new to a topic) should have at their fingertips.

The Project Team
The book has been created through the voluntary and collaborative efforts of a team of people brought together by ESOMAR to generate this resource as part of the celebration of its 65th year. The project curators are Finn Raben, director general of esomar, Sue York, chief curator of Newmr, and Ray Poynter, Director of Vision Critical University, Vision Critical.

The contributing authors are:
Suz Allen, Sven Arn, Reg Baker, Susan Bell, Pete Cape, Alison Dexter, Dirk Huisman, Nasir Khan, Kathryn Korostoff, Phyllis Macfarlane, Omar Mahmoud, Bernie Malinoff, Katie O’Connor, Stephen Paton, Annie Pettit, Pravin Shekar, Anouk Willems and Tom Wilms.

The editors are Ray Poynter and Sue York.

Join the book launch on May 22nd here!

NewMR Implications for Research Agencies: Jeff Miller #CASROmanage #MRX

Welcome to this series of live blogs from the CASRO Management Conference in Chicago. All posts appear within minutes after the speaker has finished. Any errors, omissions, or silly side comments are my own.


  • Burke is midsized without the some of the resources of the large companies
  • “Change before you have to” Jack Welch
  • Most MR are laggards, not at the forefront of change
  • Change is nothing new to our industry, voices are always calling for more and cautioning for less, trends get hyped, promises get made, alarm bells get run, the future is never quite how it is made out to be
  • We always overestimate the change that will occur in the next two years and underestimate the changes that will occur in the next ten – Bill Gates
  • What about the people managing the other 4000 US research firms? The industry is too big for first movers to scale. Secondary market rises to meet the need. Most take a wait-and-see approach to change.
  • Pressing issues – data quality, blurring of quant and qual, big data and analytics, mobile, unstructured data
  • Mobile – self administered surveys, so much talk about it and the business has been so small for a number of years now, will that change? 85% of population owns a cell phone but only 40% have a smart phone. Only 25% of people 55+ have used a browser on their phone. One of fastest growing areas but on a very small base. Mobile is where online surveys were in 1997. Surveys just can’t be moved over  to mobile like they sort of can with paper to online. “In the moment” is the sweet spot, a transactional based research. panelists are increasingly trying to access web surveys with their phone – even though it wasn’t designed to work right there.
  • Mobile is too big, too pervasive to ignore but there is no immediate threat to revenue. Panels are there so you don’t need to build your own. This is the new way to interact with younger people as email is less and less how they work.
  • Unstructured data – 85% of data is unstructured. replacement and supplementation debate will continue for a long time. Is it for PR? Marketing? Research? Where is the ownership? It doesn’t always correlate highly enough to be a complete substitute for trad research. Best insights come from targeted analysis [ah, you mean have a research objective!].
  • Market has many many options. Companies have been formed, acquired, and sold back off.  mid-sized company can’t keep pace. Better advised to know how to take the information and combine it with your existing data.
  • Qual/quant – problem is misuse of some data. Communities are growing in popularity. Temptation to survey a community is high even though it’s a very biased source. We are trained better than this but our resolve is weakening. Quantification of social media continues – tweets, positive mentions. Hybrid techniques continue to evolve.
  • Data quality – the crisis of confidence is over but now we have issues of routers. People who never qualify for surveys can indeed qualify if you use a router. Standards are helping to raise the quality of research. Quality has a cost. Making it right has a higher cost than doing it right.
  • Big data –  Promise is fantastic. Skill is analytics, not just survey analytics. We lack this understanding. Maybe MR doesn’t have this skill.
  • Other items – Neuro – quant estimates are made on very small samples but we don’t question these [fab point]; Standards – Do you want to conform to standards? Will clients insist on it?
  • Don’t measure the wrong thing with incredible accuracy [ love it!]
  • Fit for use matters – there isn’t one method that solves every problem

The New MR Age and Technology: Jeffrey Hunter #CASROmanage #MRX

Welcome to this series of live blogs from the CASRO Management Conference in Chicago. All posts appear within minutes after the speaker has finished. Any errors, omissions, or silly side comments are my own.






  • First job was doing phone research, then coding, then data processing
  • Used to work for General Mills
  • Nouriel Roubini predicted the housing crisis. He was called a Cassandra but now he’s called a sage. Even though it was one right prediction among many wrong predictions.
  • Futurism is easy, sure, sure, if you only pay attention to the predictions that came true
  • The future is already here. Mobile has been around for a bit but we still stay it’s just arrived. MROCs also seem to have just arrived but they’ve been around for a while.
  • Information, not data, has value. It’s the people who do something with the information that turn data into money. How do we manage data towards positive economic value. Everyone remembers the one insight that led to $$.
  • The world has changed for our businesses. Cheerios has been around 50 years, in a yellow box for 50 years, business model has not changed. What is different? We live in a multi-screen world: TV, print, radio, internet, smart phone, apps, tablets, digital price, in auto programming. Do you have enough time and money to deal with all of these instead of just TV and print? When do you choose what is ‘good enough.’ There could be hundreds of touchpoints in one day. It’s not additive, it’s geometric. How many information partners, and they all need to be treated differently?
  • Consolidating retail formats – have to worry about relationship with retailers that have a lot more power, new retailers don’t carry about rep samples, they want to know their market, their targets, behaviourally related
  • Fragmenting retail formats – small format stores with different clientele, established formats that now carry completely new categories compared to their entire history. It only matters what the retailer believes, not what social sciences believe.
  • Global – Where is growth? Outside of North America
  • Implications – futurism is necessary, the future is already here, it’s about information not data, information needs will follow the evolution of the business
  • What research tools will we use?
    • Surveys – continue but less of it, it needs to be reinvigorated, if you structure surveys well you can get pretty good estimates to supplement what you have from syndicated data – together is better, more research on research
    • MROCs – why aren’t these bigger than they currently are? They can help with every single thing – the copy, the package. Do it all as one piece of research, not split up into all its components
    • Web scraping – still developing, cumulative buzz corresponded exactly, r squares were in the 90s
    • Neuroscience – he doesn’t get excited about this, it shows up every few years, it’s insightful but incremental value doesn’t justify expense
    • Behavioural economics – useful for interpreting data
    • Mobile – good for adding diagnostic value
    • Big data – suffers from definitional ambiguity
  • A pessimist sees the difficulty in every opportunity, an optimist sees the opportunity in every difficulty – Winston Churchill

Cross Media Marketing by Insight Express and Disney #TMRE #MRX

Live blogs by @LoveStats! This is a session summary from The Market Research Event by IIR in Orlando, Florida, November 2011. It was posted mere minutes after completion of the talk. Any inaccuracies are my own. Any humorous side remarks are also my own. Feel free to leave comments and critiques.

***                                                                                                          ***

11:30 – Best Practices in Cross Media Marketing and Measurement
Molly Elmore, Vice President of Market Research, InsightExpress
Marc Normand, Vice President, Research, The Walt Disney Company

  • #1 Clearly defined goal objective. Have focus, choose specific objectives. [in SMR, the objective is often “do something in SM. sigh]
  • #2 Less is sometimes more. Do not include random questions that are not related to the objective. Do include brand metrics, target definition questions, profile analysis questions.
  • #3 Accurately define exposure groups. Advertising recall is very inaccurate. Don’t assume ads are memorable. 23% of people think they saw an ad but didn’t. 70% of people don’t remember.
  • #4 Ensure clean, valid comparisons between Control/Exposed group. Weighting can be your friend.

    Daisy Duck from The Walt Disney Company

    Image via Wikipedia

  • #5 Design the survey to capture frequency of exposure.How often do people need to be exposed in order for them to remember it. Binary exposure question is insufficient. 12 exposures in short time can be bad for your brand though.
  • #6 be cautious of screening to heavily [THANK YOU] People are define their target too narrowly. You DON”T KNOW which is the important part of your data every time. WOM gets ignored with excessive screening, out-of-target can become in-target. Broaden your target and get larger sample sizes.
  • #7 Compare to normative if available. Adds context. Can see if the difference you saw is better or worse than similar studies. But take it with a grain of salt, category must be similar, brand awareness should be similar, consideration set must be similar.
  • #8 Incorporate costs into final analysis. TV is expensive option. Can be three times as effective but if it’s ten times as expensive, it may not make sense. [unless the # of people you reach is vastly greater….]
  • #9 Develop analysis with a story in mind. Does the creative accomplish the intended goal – awareness, etc.
  • #10 Explore media vs creative. How are some measures aimed for media vs creative. Do people connect with ads physically. Awareness measures are often media measures, did media do its job. Education, persuasion is the job of the creative. Does the brand come across? Must always have multiple measures because “purchase was flat” isn’t helpful at all.
  • [Very tweetable presentation. Means they gave specific advice. Always good. Thank you presenters!]

Sesame Street Multi-Platform Study #TMRE #MRX

Sesame Street

Image via Wikipedia

Live blogs by @LoveStats! This is a session summary from The Market Research Event by IIR in Orlando, Florida, November 2011. It was posted mere minutes after completion of the talk. Any inaccuracies are my own. Any humorous side remarks are also my own. Feel free to leave comments and critiques.

***                                                                                                          ***

8:45 – Sesame Street Multi-Platform
Diana Polvere, VP Market Research and James Williams-Ness, Director of Media Research, Sesame Workshop

  • Three goals – True audience size, children and adults or caregivers; Device interaction – how do people use the new media platforms; Engagement – Not just reach, but how we reach them, frequency, deeper relationship [Hi Grover, we love you]
  • We should be platform and channel agnostic, be everywhere we can. 2005 had six channels, tv, home videso, web option. Now – 21 channels and growing – VOD, netflix, itunes, youtube, hulu, yahoo kids, facebook, twitter, tumblr
  • Digital space apps – monster maker, once upon a monster game, podcasts [I’m loving the sesame street characters on every slide]
  • Not a lot of cross platform measurement. There was no good single solution for web and TV. TV is the hub and didn’t know how they all relate to each other. [Hi Big Bird!]
  • TV 86%, comptuer 48%, video games 45%, mobile, 12%.[Hi cookie monster!]
  • What is the relationship, the overlap among devices? Why choose one platform over another? [Hi Bert!]
  • 20 minute panel survey of 2000 households [Hi Slimey! You’re one of my faves]
  • Co-usage is very important, kids learn more and better when they interact with others [Hi Snufalupagus]
  • 3% of households interact on mobile platform, 3% on podcasts, 12% on computers, 5% on gaming, 12% on audio, 47% on TV
  • 50 millions users on a quarterly basis [Hi Cookie Monster]
  • Viewing is not unique individuals. We know kids will watch the same video ten times [or until you whip a ceramic coaster at the TV]
  • Repetition is good. Repetition is good. Repetition is good. Repetition is good. [Hi Oscar the Grouch]
  • Podcasts are not viewed where you think – 63% watch them on a PC or laptop, not a mobile device. Portability is NOT a key to choosing which device you use. Appropriateness is more important.
  • Sesame Moms – watch with their kids. There are also Digital Dads, a growing audience. Siblings, 9-17 year olds as well.
  • Insight cookies – Extend the reach to digital dads, appointment viewing, know who the adult audience is [Note to presenters – white text on light blue, not so good]
  • Learning is magic – streamline the questionnaire, you don’t need to measure 34 devices in one questionnaire, focus on mobile and apps

#MRXblogs – It’s new and it’s fabulous #MRX #NewMR #NGMR

Yes, there are a million places online that will aggregate anything and everything related to market research. Do we need yet another one? Maybe not. But I wanted one for me. So I created a new Twitter feed called @MRXblogs. You’re welcome to follow and read it too.

It will publish blogs from individuals, small companies, and established industry organizations that are focused on market research, statistics, survey, and charting. Blogs that overwhelm the stream or are heavy on sales and marketing, won’t be included. I won’t monitor the account or reply to tweets or DMs.

If you would like your blog included, please leave a comment here or tweet me at @LoveStats and we’ll see if it fits well with the stream.

So if it suits you, enjoy!

%d bloggers like this: