Ethical Framework for SMR, Panel #SoMeMR #MRX #li

10.15 PANEL: Establishing an ethical framework for social media research

  • Tracking developments towards new standards for social media research in Europe and the US
  • Dealing with privacy issues: Assessing attitudes towards privacy in online environments
  • Evaluating ethical guidelines for blog and buzz mining
  • When is engagement with commenters necessary?
  • Evaluating appropriate codes of conduct for qualitative approaches to harvesting data via social media channels

Barry Ryan, Standards & Policy Manager, MRS
Jillian Williams, External Relations Team Leader, Highways Agency
Pete Comley, Chairman, Join the Dots (formerly Virtual Surveys)
Simon McDonald, Business Director, Insites Consulting

  • Barry – Data protection, there is identifiable data that must be protected. Copyright – blogposts, photos, videos, all covered under copyright act. Terms and service – of individual sites must be respected. Internal issue – how MR codes are constructed – participation is based on voluntary informed consent, that is our heritage.  (I’m waiting to hear about the stance on observational research, and qualitative researchers abilities to summarize text.)
  • Simon – Does research industry need rules?  We know it’s a work in progress. We don’t want to be restricted from doing things that other companies are able to do. (e.g., buzz companies don’t have to listen to MR ethics)
  • Pete – Believes in guidelines. Was part of ESOMAR guidelines committee.  Not happy with MRS stance. Bodies should be forward looking and represent us. Tone of consultation document does not do that. Document is like Pope and Catholic church. Applying to the letter. MRS won’t stop us from doing SMR. Seriously risks splitting entire MR industry in the UK. It is that serious. Solutions? We must be more inclusive and representative. Must be provisions for MR to do SMR. Long term, MRS code of conduct is the problem. Informed consent is the problem. We are NOT interviewing people here. This is analyzing public data. Concept of informed consent does not apply. We need to relook at code of conduct.
  • Jillian – As a research client, anonymity is important. Masking isn’t satisfactory.  Client does not want to be on the front page of the Daily Mail. Client will take the flack, not the industry. Clients want to comply with guidelines. Clients pay the bill.
  • Barry – Data Protection Act is the problem. Informed Consent is the first thing in it. There is no distinction between public and private. The MRS Code reflects rules of legislation. MRS made it easy for researchers to comply with data protection act. “This data is accessible” is not sufficient but you can work with the data provider directly and then it’s ok. “Subject to data protection rules” is important. If MRS interpeted law incorrectly, please tell them. [Call to MR company internal legal counsel - does anyone see if there have been misinterpretations of Data Protection Act?]
  • Pete – Data Protection Act is pre-internet. How do we survive as industry until and if there are changes?
  • Barry – Whatever comes next will not be better. “The legislator knows best.”  People want the right to be forgotten (drunken photos should be deleted if the person wants them deleted).
  • Simon – Self-regulation is important. Dialogue with respondents means better qulaity data. Consent is important but best research is also important. Their company had a problem where they friended people for research purposes, with multiple layers of consent, but then of course Facebook lets you see friends of friends, and those friends hadn’t given consent.
  • Jillian – SMR is not necessarily representative.
  • Annie – I asked a question about whether observational research is not research since it’s not informed consent and whether masking is an assault on qualitative researchers who mask for a living.
  • Barry – This is not an assault on qualitative research. There is a separate guidelines for qual research. Maybe the MRS heard nothing back from qualitative researchers and it’s not reflected in the paper. In the online space, everything is data, video, photo. Under the data Proection Act, processing data is engagement. Masking is good for privacy, but it doesn’t rectify the potential unlawfullness of the act of taking the data.
  • Pete – Does everything really need to be masked? “I love McDonalds” maybe not.  Anything Pete says here, he risks it being written down and shared. (Hmmmm….. watch out!) Going out of your way to NOT quote something written in the online public space seems odd. What do you do with gray area of semi-private. Inconsequential “This hotel is lovely” doesn’t need masking but someone’s sexual preference does need masking. It is a minefield.
  • Jillian – Doesn’t like masking at all. We want the insight from the quote as opposed to masked verbatims that aren’t exactly correct and could be misunderstood.
  • Question – why are companies doing this if it’s all illegal under data protection act? [Great question - are we waiting for someone to get sued and go to court before we get an update to the legislation?]

If It Ain’t Illegal, It’s All Good #MRX

I’ve been to a number of market research conferences where the following argument has been raised in defense of  methodologies that some people deem questionable:

It’s not illegal so we can do it.

It’s made me stop and re-evaluate how I run my life. That whole “Do unto others” thing is far too complicated and theoretical and the books that promote it are thousands of years old and not relevant to me. Besides, it’s greatly to my advantage to base my choices purely on legalities. So here is how I’m going to better my life.

  1. I’m going to save at least $100 every year by keeping any wallets or phones that I find. (Shout, I could have had a new Android phone last week!)
  2. I’m going to get at least 3 free pairs of gloves and 1 free umbrella every year by not telling departing transit passengers that they’ve dropped something.
  3. Conferences presentations will be a lot funnier because I won’t tell people who are about to present that their zipper is undone.
  4. I will save at least 90 minutes every year by no longer holding doors open for people, trying to re-unite lost children with their moms, and offering to taking photos for visiting travelers.
  5. I will make more money by disregarding personal preferences for privacy, anonymity, and respect.
  6. I will gain more self-respect by doing what’s right for me personally instead of wondering how my perfectly legal actions affect the people around me.

It’s all perfectly legal my dear friends so let’s start with item #1.

donut hamburger cne ex

Social Media Data is like a Box of Timbits #MRX

The Timbit Story

Once upon a time, I brought a box of Timbits to work to share with my research team. I plopped the box on my desk, and my colleagues and I occasionally reached over to dip our hands into the box and grab a treat. I picked out the chocolate Timbits and kruller Timbits. My teammates picked out the raspberry Timbits because they know it’s in their best interest to eat the donuts I don’t like. We chatted and worked and ate.

timbit donut

Suddenly, someone who sat way over in the far corner of the office and who had never talked to us before, happened to wander by our area on his way to the photocopier. He spied the Timbits and with one swoop of his arm, he reached over and grabbed as many as he could fit into his two hands.

We stared in surprise as he continued on his way without a word. “Do you know that guy?” I asked. But no one did. The Timbit thief had struck in broad daylight.

The end.

————————————————————————————————————————–

Deconstructing the Timbit Story

Ok, so that wasn’t a great story, and the fact that I shared Timbits makes it an unbelievable story. But let’s think a bit about it.

I know that the 200 people in my office share a common space. We share the windows, the meeting rooms, the kitchen. Though I may not talk to everyone, or know everyone’s name, we all work for the same company, towards the same goal. We are many small teams within one larger team. My research team is one small network within a much larger social network.

And clearly, the Timbits weren’t MY donuts since a bunch of us were shoving our hands in the box and taking whatever we wanted without asking permission to eat each individual donut. They were obviously communal donuts. But still, most people would recognize that the donuts were intended for the research team, not for  the entire office to pillage.

This is how a lot of people feel about social media data. Yes, they know the internet is public, just as their office space is public. But within the office, you have friends who are allowed to touch the donuts on your desk. And, all the other people in the office can wander around but they aren’t allowed to touch the donuts on your desk. Similarly, when we’re on the internet, we’re sharing information with our friends and followers, not with random people waiting to pillage whatever valuable items they can find.

So please, the next time you embark on a social media project that uses publicly available social media data, consider the mighty Timbit. Before you quote status updates and tweets and messages, make sure you consider the fact that those messages weren’t intended for you. If you haven’t got permission to quote someone, be sure to anonymize and mask their messages. It’s basic common sense and respect. Respect for the Timbit.

Qualitative Market Research is Bunk #MRX

A photo of a group conducting psychotherapy.

Image via Wikipedia

I have the greatest of respect for psychologists. My original training was as an experimental psychologist, and as such, I obtained permission to take a graduate level class in ethics alongside students training to become clinical psychologists. I learned the ins and outs of the ethics involved with working with people in the most fragile state of their lives, and trust me it’s very complicated. What I learned there has come with me through my entire career. Any time ethical issues arise in the field of market research, I always look back on what I learned in my training to become a psychologist to guide me down the right path. It’s a good place to start because academic Psychologists have some of the strictest ethical codes out there. People’s lives are on the line.

Psychology ethics codes sound very much like a medical doctor’s code. Do no harm. Respect the individual. Care for people in situations where they may be unable to care for themselves. This is what I seek in market research even when some people say that I am being naive and idealistic.  But I’m OK with that. I’d rather be too careful than risk someone being hurt. I sleep well because of this.

Is it an issue of informed consent?

So when I saw the MRS paper on proposed privacy guidelines, I was very concerned. My interpretation of it suggests that it disregards the legitimacy of naturalistic observation research (i.e., practice of scientifically observing people in their natural environment without interfering with them or drawing attention to yourself). Here is one quote (all the quotes in this post are out of context) from the MRS paper:

“That is why as the real and virtual worlds converge further, MRSB believes that researchers must apply the same ethical standards to research online as they do in real life. That is: Obtaining the informed consent of all persons from or about whom data is collected”

To me, this flies in the face of traditional ethical research methods that have been practiced by psychologists, sociologists, anthropologists, and market researchers for decades. All of these codes permit naturalistic observation and recognize it as a valid and ethical practice. Here are just a few excerpts from various ethics codes of psychology organizations.

Canadian Psychological Association Code of Ethics
“Obtain informed consent for all research activities that involve
obtrusive measures, invasion of privacy, more than minimal risk of
harm, or any attempt to change the behaviour of research
participants.”

American Psychological Association Online Research Ethics
When conducting research online, researchers need to contend with changes in the technology, the ways the technology is typically used, and the norms surrounding this use, because this context is integral to assessing anonymity, privacy, risk and the like. For example, the concept of minimal risk depends upon a comparison of the risk associated with research participation to risk in everyday life. The concept of privacy depends upon participants’ reasonable expectations about whether others will be allowed access to information about them. As online behavior and norms change, the nature of minimal risk and the very concept of privacy themselves change.

American Psychological Association Code of Ethics
“8.05 Dispensing with Informed Consent for Research
Psychologists may dispense with informed consent only (1) where research would not reasonably be assumed to create distress or harm and involves (a) the study of normal educational practices, curricula, or classroom management methods conducted in educational settings; (b) only anonymous questionnaires, naturalistic observations, or archival research for which disclosure of responses would not place participants at risk of criminal or civil liability or damage their financial standing, employability, or reputation, and confidentiality is protected; or (c) the study of factors related to job or organization effectiveness conducted in organizational settings for which there is no risk to participants’ employability, and confidentiality is protected or (2) where otherwise permitted by law or federal or institutional regulations”

British Psychological Society Code of Ethics
“Unless informed consent has been obtained, restrict research based  upon observations of public behaviour to those situations in which  persons being studied would reasonably expect to be observed by  strangers, with reference to local cultural values and to the privacy of  persons who, even while in a public space, may believe they are unobserved.”

Department of Psychology, University of Sheffield
9. Observational Research
9.1 Studies based upon observation must respect the privacy and psychological well-being of the individuals studied. Unless those observed give their consent to being observed, observational research is only acceptable in situations where those observed would expect to be observed by strangers. Additionally, particular account should be taken of local cultural values and of the possibility of intruding upon the privacy of individuals who, even while in a normally public space, may believe they are unobserved.

Is it an issue of permissions?
 
This for sure is a no. Ethical monitoring and measuring and research platforms would not exist if it was an issue of permissions. Websites have two very simple ways of ensuring their data remains private. First, they can insert code into their website that essentially says “please don’t gather our data.” This code is readily respected by ethical companies. Second, websites can choose to NOT create APIs that permit the sharing of data with external companies. Since Facebook and Twitter and most other major websites provide APIs to give data to third parties, they are the ones who determine what can be shared within their privacy policy. Ethical companies won’t, and physically can NOT, take data that isn’t permitted.
 
Is it an issue of masking verbatims?

On a separate note, the MRS paper indicates this about the cloaking of data: “While data masking or cloaking may be offered as a privacy solution, from a methodological point of view it is rather unsatisfactory. This approach could distort results if the original wording was materially altered (and even a single word change can do this).”

This, I believe to be an affront to the skills, expertise, and training of most qualitative researchers who perform this task on a daily basis with the utmost of quality in workmanship. Are we to disregard qualitative researchers? Push them outside of the market research world? Ignore the contributions of people whose skills are qualitative because they are incapable of properly summarizing or describing opinions? I can only hope that this was an unintended side effect. Masking is truly such a minor issue that I immediately begin picturing babies and bathwater. Masking is a widely used process that can be taught and learned. So let’s teach it and learn it.

Whether you agree or disagree with me, whether my opinion is in the extreme minority, I implore you to share your opinions with the MRS. Our industry is being shaped right now and your voice matters. Please speak up.

Quick Poll: Have you read the Terms of Service for Twitter, Facebook, and LinkedIn? #MRX

Nope, not scientifically sound, not randomly sampled. The answers are extremely important however.
.
Please answer honestly. If you have not COMPLETELY read the TOS, please answer no. If you COMPLETELY read the TOS, then answer yes.



Answers, and the reasons for asking these questions, will be posted later.