Phil Meyer on what to look for in covering pre-election polls
COMMENTARY | January 14, 2008

The renowned journalist-pollster offers a 5-point checklist. He sees primaries as more difficult to poll than general elections and has no problem with focusing on the horse race.


By Philip Meyer
pmeyer@email.unc.edu

Here are five things to think about while covering pre-election polls.

1. Making accurate election predictions in primaries is really hard. It always has been. For most voters, as Paul Lazarsfeld found out way back in 1940, party identification is their main guide to the voting decision. That guide is neutralized in primaries and referendum elections.

When the interviewer asks how a voter is going to decide, the person can’t give a good answer if he or she doesn’t know. But to admit not knowing makes the respondent feel impolite or even ignorant, and so some kind of answer is usually forthcoming. We should always be skeptical of what respondents tell interviewers in primary and referendum polls. They’re not lying, their choices are just mushy.

2. Election outcomes have multiple causes. Journalists like simple explanations, hence the focus on Hillary Clinton’s widely replayed episode of tearing up late in the New Hampshire campaign. But there had to be other contributing causes of her first-place finish.

For example, Jon Krosnick, professor of communication, political science and psychology at Stanford, thinks that something as simple as her position on the ballot could have had an effect. New Hampshire listed the candidates in alphabetical order from a random start, which happened to be Z.  Thus Clinton was placed near the top and Obama near the bottom of the ballot – worth as much as 3 percentage points to Clinton in Krosnick’s estimation. (Questionnaire design is one of his research specialties.)

3. Don’t obsess over sampling error. The only reason statisticians give it so much attention is that it is easy to estimate. But those estimates assume that every member of the voter population has an equal chance of being interviewed. That’s hardly ever true. The most important source of error these days is probably nonresponse. Telephone polls can’t help focusing on the people who are easiest to reach.

How do they get away with it? Well, it causes no problem when the easy-to-find folks hold the same views as those who are hard to find.

But sometimes they don’t. Polls chronically fall short on young people, many of whom can’t be reached by land line, which is the basis of most random-digit dialing. The bias created by under-representing them can be self-correcting because young people are less likely to vote. That could change in an election where they are worried about finding jobs or getting drafted.

4. It’s okay to cover the horse race. It helps build interest. Watching basketball with the score announced only at the end of the game would be pretty boring. But journalists need to drill down into the horse-race data to see where the leaders’ support is coming from.

All democracies are run by coalitions of varying interests that figure out how to compromise their differences. More light needs to be shed on the process of creating these coalitions.  It’s easier to follow in parliamentary democracies because their multi-party systems allow voters to vote directly for their narrow concerns. Once in office, the diverse winners go through a process of give-and-take negotiation until a governing coalition is formed – hence the expression, “Politics makes strange bedfellows.”

In our two-party system, the coalitions are formed in the election campaign. The process needs to be reported so that voters can know whose bed they are being invited to share. Current polls are already starting to show signs that the Republican coalition formed by Ronald Reagan is breaking up. That one paired economic conservatives protecting their wealth with social conservatives hoping to promote their religious values. If those groups split, it could be because the social conservatives are noticing that the economic conservatives never gave them much beyond lip service.

5. Don’t worry about polls affecting the outcome. It’s okay for voters to take information about their peers into account when making their decisions. Polls can be especially helpful when there are more than two candidates because they can enable a citizen to vote strategically. In a five-person field, a poll might show that one’s first choice is running dead last while the second choice has a shot at winning. In that situation, it makes sense to avoid wasting a vote and go for the second choice.

Both bandwagon effects – voting for a person because he or she is ahead -- and underdog effects – basing a vote on sympathy for a loser – have been suggested but not confirmed. Even if such effects exist, voters have the right to use whatever information they want in making their decisions.

One positive way to use polls to help voters choose in primary elections is to report on trial heats pitting Democrat against Republican hopefuls. Most primary voters want to pick somebody who can beat the candidate of the other party. Early polls can’t predict that with certainty, of course, but they can be a legitimate factor in assessing the probabilities. Pollsters and the journalists who follow them ought to provide the electorate with that information.

-

Martin Lobel
It’s time to do more than just say the economy is the No. 1 issue
If voters are to go into the midterm elections with any understanding at all, the press needs to get away from he-said, she-said reporting and look into the positions that candidates and the two parties are taking. Martin Lobel offers some vital questions.

William Claiborne
What a broken Senate looks like from far away...and why it matters
Our correspondent in Australia has ideas on how to improve things a little. But he’s not optimistic that anyone on Capitol Hill will be interested.

Steven Greenhut
How severe is the public employee pension problem across the U.S.? (Hint: Is a $3 trillion debt severe?)
Columnist and author Steven Greenhut looks at the ongoing pension issue, including abuses of it, and deals with some of the key questions.

Watchdog Blog
Herb Strentz
Des Moines Fair Coverage, Part 2
Cleaning up in the wake of the 2010 Iowa State Fair will be daunting this year. In addition to the mess left by nearly 1 million visitors and thousands of farm animals, we have a continuing saga of news coverage that told of possible racial assaults and then, in Saturday Night Live fashion, appears [...]

Herb Strentz
On ‘Beat Whitey Night’ in Des Moines
(Editor’s note: The incidents described here have become part of a developing story, as this Google link shows.) The Des Moines Register’s reluctance to identify criminal suspects or victims by race has turned into an outright refusal to do so. The closing night of the Iowa State Fair was marked by an observance not exactly on the [...]

Barry Sussman
Justice Department Shows Its Mettle, Indicts Clemens
I got this note from a friend and colleague a little while after Roger Clemens was indicted by a federal grand jury on Aug. 19th: “And meanwhile, Condoleezza Rice, Donald Rumsfeld, CIA officials and others who lied to Congress in sworn testimony about Iraq go free. If we can ‘look forward, not backward’ on torture, perjury, [...]

Blog main page >>
Web Essentials
Leading journalism sites, blogs...
Enter your e-mail address
Spotlight On

TWITTER
Follow Nieman Watchdog on Twitter.
(Nieman Watchdog)

Telecoms charging more to do nothing
It's getting more expensive to have an unlisted phone number. What's the logic behind that?
(Center for Media and Democracy)

Prosecute those leaks
The Obama administration has indicted another alleged leaker, this time for reportedly passing along to Fox News an intelligence assessment that North Korea was likely to respond to U.N. sanctions by conducting another nuclear test.
(Secrecy News/Federation of American Scientists)

A broad array of massive financial crimes
As PRWatch.org shows, court-imposed settlements have only skimmed the surface of big banks' wrongdoing in the financial crisis.
(Center for Media and Democracy)

More Spotlights >>