Is sample building an opinion? Short dissertation about “root biases”

Trumpet SoldierRecently a person informed me about a study published on Proceedings of the National Academy of Sciences of the United States of America: Music training alters the course of adolescent auditory development.

THe scientists observed a group of 40 adolescents: 20 of them chose in-school music training. Please wait: I will tell you what other 20 adolescents chose, after.

The study demonstrates “in-school music training changes the course of adolescent brain development. Relative to an active control group that shows the expected wane in subcortical response consistency, adolescents undertaking in-school music training maintained heightened neural consistency throughout high school. The music training group also exhibited earlier emergence of the adult cortical response, suggesting that in-school music accelerates neurodevelopment“. In other words: linguistic and cognitive functions improve more if you study and play an instrument.

The other sub-sample (20 adolescents) chose a military cadet programme.

Continue reading

Advertisements

The ultimate or the last question? How NPS could compromise your understanding

ultimate questionThe number of top executives who is asking for NPS (Net Promoter Score) has grown permanently since the famous article by Bain & Company mentor Frederick F. Reichheld (The One Number You Need to Grow, Harvard Business Review, December 2003). Main reason of such success is not the NPS’s predictive ability but its own simplicity.

Top executives hasn’t enough time to read huge amounts of pages describing complex (although elegant) analysis or sophisticated indicators. NPS seems to provide a good recipe: it is simple to explain, it is short (“The one number…“) to show, it is clear to understand.

Like several examples we can catch from other contexts, NPS is a “postulate-driven” assumption: if I recommend, I am a promoter; if i don’t recommend, I am a detractor. Like other postulates, NPS has a corollary: company revenues are predicted by NPS.

I don’t agree. Simply. I don’t  mean I don’t care Top executives’ need to receive few, clear and self-standing results that could provide a compass for growth. I strongly suggest to understand that a postulate has to be weighted before to be accepted.

A careful observation of NPS could drive us to a healthy criticism. And I say healthy in an ontological meaning (every theory must be put to the test), but also in a restricted meaning (if you want a compass for growth, be sure it is calibrated).

I will describe main mistakes that may occur to you if you don’t accept a healthy criticism on NPS. Mistakes are divided between

A. NPS’s own lack of foundation

B. Self standing NPS risks

Continue reading

You! Hypocrite Research Spender! – mon semblable, -mon frère!

Thomas Stearns Eliot ends The Burial of the dead (first part of Waste Land) with an excerpt from Charles Baudelaire‘s preface to Fleurs du Mal: “You! Hypocrite Lecteur! – mon semblable, -mon frère!” (in Baudelaire’s original there isn’t the word “You!”). We can translate it in “You! Hypocrite reader, my likeness, my brother!”.

In Baudelaire’s (and Eliot’s mind), the reader is guilty of lies and sins exactly like the author. And sins are not the output of any kind of Devil’s activity but rather the result of boredom.

Recently I answered to an online questionnaire that asked me about “online bet games”. I d0n’t bet often but the curiosity pushed me. And I found a great example of HOW NOT TO WRITE A QUESTIONNAIRE.

Continue reading

A laudable initiative: Foundation for Transparency in Offshoring

Offshoring is a matter in MR industry. But debate is hushed up. Few researcher publicly speak of aptitude to realize fieldwork abroad in countries where costs are considerably lower.  In my country most fashionable country for fieldwork seems to be Romania. A typical italian aptitude: foreigners are good when they stay at their home, where they let themselves to be exploited (possibly silently) far from indiscreet glance.

I know some Romanian interviewers… they often speak italian better than a lot of Italians. I don’t agree with someones who say “It is only a problem of quality of data”. Well… it is a problem of quality of data, too. Working conditions are another part of the trouble. And fieldwork control is the third facet.

So I’m proud to share a laudable initiative: Foundation for Transparency in Offshoring. I let them to tell:

Market Research is a relationship business, and trust is the cornerstone of any relationship. While industry associations offer various quality standards and codes of ethics to cover corporate behavior and practices, one important and growing trend — the offshoring of data collection and analytics — has not been adequately addressed by either governments or industry trade associations.

Clients are concerned about their loss of control over the market research process, specifically the difficulty in obtaining accurate and honest information. These concerns are directly related to the information needed by buyers to make informed decisions and trade offs between cost and quality as well as the protection of intellectual property and data security.

Continue reading

Tecniques: it’s not a matter of “which”…

Sometimes I meet research customers (or prospect customers) who ask me: “Which kind of techniques do you employ at your institute?“. Usually I answer  “Just a bit of everyone “. I understand the meaning of the question: MR is a whole made by empirical experience, so if you “use, know,employ” certain techniques, you are supposed to be “skilled enough“.

But I prefer to talk about another matter: which kind of techniques would fit with your purpose. Let’s take an example: new concept or new products. They deal with the notorious newcomer’s dilemma: if you propose a new sentence (concept, thesis, product, …), mainstream could not to listen to you;  if you propose a mere variation of a known sentence (concept, thesis, product, …), you wouldn’t be new and probably outsmart by your competitors who have a more well-established position.

Choose the right research mix is surely the right option. In the past years unwarranted researches drove to several dramatic flop (do you remember when gurus told us that no one would have chosen a mobile phone to take a photo and that the “real business” was in “multimedia content streamed by phone services”?).

Follow the video and laugh with me…

A bright new product… ancient times focus group


Crisis and market research

Good Geoff Ramsey,  eMarketer‘s CEO published a post onto his society’s site: Why Now Is Not a Good Time to Slash Your Market Research Budget.

Geoff  mentions some recent researches, among corporate marketing directors; and the landscape is  “a precipitous drop in spending for overall media and advertising budgets“. According to ANA – US Association of National Advertisers – 77% of firms is going to cut their advertising budget. According to AdMedia Partners, only a quarter of marketers would be planning a growth in market research investments, an equal percentage schedules a reduction.  According to Duke University Fuqua School of Business, in 2009, MR investments will increase 1,8% only. Data has to be wisely “pondered”: 1,8% is an average between willingness to increase (3,7%) in B2C activities and willingness to reduce (2,9%) in B2B ones.

Continue reading