• Subscribe to our newsletter
The Media Online
  • Home
  • MOST Awards
  • News
    • Awards
    • Media Mecca
  • Print
    • Newspapers
    • Magazines
    • Publishing
  • Broadcasting
    • TV
    • Radio
    • Cinema
    • Video
  • Digital
    • Mobile
    • Online
  • Agencies
    • Advertising
    • Media agency
    • Public Relations
  • OOH
    • Events
  • Research & Education
    • Research
    • Media Education
      • Media Mentor
  • Press Office
    • Press Office
    • TMO.Live Blog
    • Events
    • Jobs
No Result
View All Result
  • Home
  • MOST Awards
  • News
    • Awards
    • Media Mecca
  • Print
    • Newspapers
    • Magazines
    • Publishing
  • Broadcasting
    • TV
    • Radio
    • Cinema
    • Video
  • Digital
    • Mobile
    • Online
  • Agencies
    • Advertising
    • Media agency
    • Public Relations
  • OOH
    • Events
  • Research & Education
    • Research
    • Media Education
      • Media Mentor
  • Press Office
    • Press Office
    • TMO.Live Blog
    • Events
    • Jobs
No Result
View All Result
The Media Online
No Result
View All Result
Home Communications Opinion

Researchers, stop treating what people say as if it’s what people really do

by Dave Morgan
April 22, 2013
in Opinion
0 0
0
Researchers, stop treating what people say as if it’s what people really do
Share on FacebookShare on Twitter

I’m tired of research companies presenting the results of what people say as if it factually represents what they did or are likely to do. Come on. This is the era of digital media and marketing and Big Data. We can have massive direct measures of most consumer media and consumption behaviors, and we have extraordinary abilities to store, analyse and present that information. Why do we still rely so much on sending out surveys asking people to tell us about behaviors that we can much more accurately directly measure?

Let’s look at some trade stories from these past few days. Earlier this week, TV Week reported that 87% of DVR owners don’t skip movie ads. Did they use readily available anonymous DVR log data on tens of millions of viewers from TiVo or Kantar or Rentrak to find the answer? No. Instead, the Worldwide Motion Picture Group asked 1,500 viewers what they “think” they do. Raise your hand if you think this is an accurate representation of what people who DVR content really do?

Yesterday, research company Gfk told us that streaming video may erode traditional TV viewing, since 33% of those surveyed say they watch less “regular” TV. Did they check the above sources, or Nielsen or comScore, all of which have some capacity to answer the question with actual observed data? No. Also yesterday, Forrester told us that younger TV viewers are moving online, citing that there has been an 18% hike in online viewing in the U.S. between 2012 and 2010. Did this data come from any one of a number of log-based panels of online video viewing? No. It came from what 60,000 survey respondents said they did, not what they actually did.

Are research companies doing this because they want to deceive us? Of course not. These are reputable firms. Instead, I think they keep to this model because that’s what they’ve done for years and they haven’t felt the need to change yet.

But now it’s time that survey and other “declared” data is put into its place as a distant second to observed data in measuring media behaviors. Here’s why:

Accuracy. We should use the best available data when we compile and present our research. If we can get factual data on actual behaviors from a massive sample of consumers, why should we rely on “remembered” data from surveys and polls? Diaries have given way to People Meters. So too should surveys.

Reporting bias. As has been widely reported in many studies, if you ask people about their media behaviors, they tend to significantly under-report their TV viewing and over-report their computer and Internet usage. If you ask them what they watch on TV, it seems everybody spends most of their time watching Discovery, History Channel, C-Span and BBC Americas. Nobody ever watches reality shows or reruns. Log files of actual viewing from TV set-top boxes tell a completely different story — as do the ratings.

Panel bias. Some people like to take surveys. Many do not. Just as we’ve learned that folks who click on ads do not represent most online media consumers — see comScore’s “Natural Born Clickers” work — the same bias exists for those who are willing to take online surveys. You can try to balance your panel according to sex/age demographics, but you can’t entirely take the bias away.

People are what they do, not what they say they do. Let’s stop pretending that the latter represents the former (or is any way factual). What do you think?

Dave Morgan is the CEO of Simulmedia.

This post was first published by MediaPost.com and is republished with their kind permission.

Dave Morgan

Dave is the CEO and founder of Simulmedia. He previously founded and ran both TACODA, Inc., an online advertising company that pioneered behavioral online marketing and was acquired by AOL in 2007 for $275 million, and Real Media, Inc., one of the world’s first ad serving and online ad network companies and a predecessor to 24/7 Real Media (TFSM), which was later sold to WPP for $649 million. After the sale of TACODA, Dave served as Executive Vice President, Global Advertising Strategy, at AOL, a Time Warner Company (TWX). A lawyer by training, Dave served as General Counsel and Director of New Media Ventures at the Pennsylvania Newspaper Association in the early 1990’s. Dave received a B.A. in Political Science from The Pennsylvania State University and a J.D. from the Dickinson School of Law. He serves on the boards of the International Radio and Television Society (IRTS) and the American Press Institute (API), and was a long-time member of the executive committee and board of directors of the Interactive Advertising Bureau (IAB). He and his wife, writer Lorea Canales, live in Manhattan with their two daughters.

Follow Us

  • twitter
  • threads
  • Trending
  • Comments
  • Latest
Kelders van Geheime: The characters are here

Kelders van Geheime: The characters are here

March 22, 2024
Dissecting the LSM 7-10 market

Dissecting the LSM 7-10 market

May 17, 2023
Keri Miller sets the record straight after being axed from ECR

Keri Miller sets the record straight after being axed from ECR

April 23, 2023
Getting to know the ES SEMs 8-10 (Part 1)

Getting to know the ES SEMs 8-10 (Part 1)

February 22, 2018
Sowetan proves that sex still sells

Sowetan proves that sex still sells

105
It’s black. It’s beautiful. It’s ours.

Exclusive: Haffajee draws a line in the sand over racism

98
The Property Magazine and Media Nova go supernova

The Property Magazine and Media Nova go supernova

44
Warrant of arrest authorised for Media Nova’s Vaughan

Warrant of arrest authorised for Media Nova’s Vaughan

41
The future is now

The future is now

July 1, 2025
Commercial radio: Spiced and flavourful

Commercial radio: Spiced and flavourful

July 1, 2025
Generation green: The youth’s eco impact

Generation green: The youth’s eco impact

July 1, 2025
Awards Wrap: Winners from the SAFTA Awards, Bookmark Awards finalists announced

Awards Wrap: MediaMix 360 and the IEC win Bronze Polaris Award, Veuve Clicquot Bold Woman Award finalists announced, Rachel Irvine honoured on UK top 40 PR power list

July 1, 2025

Recent News

The future is now

The future is now

July 1, 2025
Commercial radio: Spiced and flavourful

Commercial radio: Spiced and flavourful

July 1, 2025
Generation green: The youth’s eco impact

Generation green: The youth’s eco impact

July 1, 2025
Awards Wrap: Winners from the SAFTA Awards, Bookmark Awards finalists announced

Awards Wrap: MediaMix 360 and the IEC win Bronze Polaris Award, Veuve Clicquot Bold Woman Award finalists announced, Rachel Irvine honoured on UK top 40 PR power list

July 1, 2025

ABOUT US

The Media Online is the definitive online point of reference for South Africa’s media industry offering relevant, focused and topical news on the media sector. We deliver up-to-date industry insights, guest columns, case studies, content from local and global contributors, news, views and interviews on a daily basis as well as providing an online home for The Media magazine’s content, which is posted on a monthly basis.

Follow Us

  • twitter
  • threads

ARENA HOLDING

Editor: Glenda Nevill
glenda.nevill@cybersmart.co.za
Sales and Advertising:
Tarin-Lee Watts
wattst@arena.africa
Download our rate card

OUR NETWORK

TimesLIVE
Sunday Times
SowetanLIVE
BusinessLIVE
Business Day
Financial Mail
HeraldLIVE
DispatchLIVE
Wanted Online
SA Home Owner
Business Media MAGS
Arena Events

NEWSLETTER SUBSCRIPTION

 
Subscribe
  • About
  • Advertise
  • Privacy & Policy
  • Contact

Copyright © 2015 - 2023 The Media Online. All rights reserved. Part of Arena Holdings (Pty) Ltd

No Result
View All Result
  • Home
  • MOST Awards
  • News
    • Awards
    • Media Mecca
  • Print
    • Newspapers
    • Magazines
    • Publishing
  • Broadcasting
    • TV
    • Radio
    • Cinema
    • Video
  • Digital
    • Mobile
    • Online
  • Agencies
    • Advertising
    • Media agency
    • Public Relations
  • OOH
    • Events
  • Research & Education
    • Research
    • Media Education
      • Media Mentor
  • Press Office
    • Press Office
    • TMO.Live Blog
    • Events
    • Jobs

Copyright © 2015 - 2023 The Media Online. All rights reserved. Part of Arena Holdings (Pty) Ltd

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In

Add New Playlist

Are you sure want to unlock this post?
Unlock left : 0
Are you sure want to cancel subscription?