Featuring fresh takes and real-time analysis from HuffPost's signature lineup of contributors
Peter Kellner

GET UPDATES FROM Peter Kellner
 

Obama Stays Ahead - Just

Posted: 23/10/2012 16:43

There are two versions of what has happened in the past three weeks in the battle to be US president. One is the version told by most nationwide polls and accepted by the media; the second, told by a minority of nationwide polls, including YouGov, and most polls in the key battleground states, is significantly different.

Version one says that the first television debate between Barack Obama and Mitt Romney was a game-changer; If we average the polls conducted by Gallup, Pew; Ipsos, ARG and the Daily Kos, we find that before the debate, Obama was ahead by four points; afterwards Romney led by four - a shift in the lead of eight points. Before the debate, Obama was heading for a clear victory; afterwards, Romney looked the more likely winner. Since then, the contest has narrowed a little, but Romney has held most of his initial gains.

Version two says that the first debate made only a small difference. If we average the polls conducted by YouGov, Rasmussen and ABC/Washington Post, then the debate shifted the nationwide vote shares by just a single point: from an Obama lead beforehand of 2% to an Obama lead of 1% afterwards. The figures have stuck close to that ever since. (YouGov's latest survey, completed this Monday, shows Obama 2% ahead.)

Movements in polls in the key states sit nearer version two than version one. If we average their findings then Florida tipped from Obama to Romney after the first debate, but Obama remained ahead in other key states - notably Ohio, Pennsylvania, Wisconsin, Nevada and New Mexico. Obama narrowly led in Virginia and Colorado before the first debate; afterwards, they were too close to call. On these figures, Obama would still win the electoral college, even if Romney won Virginia and Colorado.

Why these two kinds of difference - between different national polls, and between most national and most state-level polls? The answer, I'm afraid, requires some technical delving into the data. For those who DON'T want to come on this journey, my advice is to believe the majority of state polls and the minority of national polls (including YouGov). I believe that the bulk of the media (especially, but not only, Fox News), with their natural tendency to fasten onto the more dramatic polling shifts, have simply got the story of the past three weeks wrong. Obama has remained ahead since last month's Democratic convention. His (modest) lead has probably narrowed fractionally since the beginning of October, but any movements in the national figures, and in most state-level races, have been within the margin of error.

Now for the explanation. In all polls these days, the raw data must be handled with care. It's normal for the sample to contain too many people in some groups, and too few in others. So all reputable pollsters adjust their raw data to remove these errors. It is standard practice to ensure that the published figures, after correcting these errors, contain the right number of people by age, gender, region and either social class (Britain) or highest educational qualification (US). Most US polls also weight by race.

Beyond that, there are two schools of thought. Should polls correct ONLY for these demographic factors, or should they also seek to ensure that their published figures are politically balanced? In Britain these days, most companies employ political weighting. YouGov anchors its polls in what our panel members told us at the last general election; other companies ask people in each poll how they voted in 2010, and use this information to adjust their raw data. Ipsos-MORI are unusual in NOT applying any political weighting.

A similar variation applies to the US. The difference is that there, most pollsters apply only demographic weights. YouGov and Rasmussen are unusual in taking account of political partisanship; whether people think of themselves generally as Democratic, Republican or Independent. (This is generally known as party identification, or party ID.)

In the case of YouGov's weekly nationwide polls for The Economist, we apply the same overall principle as in Britain. That is, we draw on baseline information in order to ensure consistency in the political profiles of our samples. Specifically we know the party ID of most panel members last December, and also how they voted in 2008 and/or 2010, from what they told us at the time. (What's important is not that the month we collected a mass of ID data happened to be last December; rather, the point is that we have a common baseline for anchoring this year's polls.) This doesn't remove all risk of sampling variation - sadly, we have been unable to repeal the laws of probability - but it does reduce the risk of a rogue poll in which our sample is demographically fine but politically skewed.

That is not all. YouGov has also conducted two large-scale surveys in 25 states for CBS News, one before the first TV debate and one afterwards. These covered all the battleground states, plus the largest states such as California, Texas and New York. The key point is that this was a true panel study. We questioned the same people twice. This allowed us to investigate what change, if any, took place at the level of individual voters, NOT by comparing results from different samples. Any change in the numbers in such panel studies reflects real changes by real voters. And our overall sample was much larger than normal. We polled almost 33,000 electors in September, and re-interviewed more than 25,000 of them after the first debate.

The message from this study was clear. The Romney bounce was tiny. Overall, YouGov found just a one-point narrowing of Obama's lead.

Or rather, those were the published figures. Had we adjusted the raw data only for demographics, and treated the two polls as separate samples then we would have reported a five-point shift, from an Obama lead of 4% in these 25 states to a Romney lead of 1%.

However, when we compared the intentions of the people who completed both surveys, we found hardly any net movement. Those who backed Obama in September divided as follows after the first debate: Obama 93%, Romney 3%, undecided 4%. Romney's September supporters divided: Obama 3%, Romney 94%, undecided 3%. (The modest numbers of those who did not take sides in September, but who did this month divided evenly between the two men.)

So we have a discrepancy between what we reported - only a tiny net movement after the first debate - with what we would have reported had we acted like most other pollsters.

Here's the reason. Those who supported Romney in September were more likely than Obama supporters to respond to our follow-up survey after the first debate. The re-contact rate was 80% for Romney supporters and 74% for Obama supporters. That's why the raw numbers - and the demographically-only adjusted numbers - for the post-debate poll appeared to tilt the whole contest towards Romney. Had we reported these, we would have been in line with most other pollsters.

We didn't because we take one side in a specific argument about political polling. It is whether party ID is stable or not in the short term. At YouGov, we believe - and experiments from time to time support this - that party ID changes only slowly. Other companies argue that it can change sharply in response to specific events, such as a successful party convention, or a TV debate in which one candidate emerges as the clear winner (as Romney did in the first debate).

At this point, it would plainly be helpful to report how the party ID figures for all the major pollsters moved after the first debate. Sadly, US pollsters are not generally as open as British pollsters. However, we do have numbers from two companies that collect party ID data but don't weight to it. Both have deservedly high reputations.

The first is Pew, which reported an 8% Obama lead in mid-September and a 4% Romney lead after the first debate. Its party ID figures also moved sharply, from a 9% Democratic lead in September to a 1% Republican lead this month.

The second is the ABC/Washington Post poll. This actually reported a slight INCREASE in Obama’s national lead after the first debate, from 2% to 3%. And its party ID figures moved in the same direction, from a 5% to 9% Democratic lead.

In short, the reason for the gulf between the Pew and ABC/WP results comes down to the different political compositions of their samples. Had both weighted their data to hold their party ID figures constant, both would have reported a tiny shift to Romney - which is exactly what YouGov did report.

What we can therefore be fairly sure of is that the first TV debate made little or no difference to the (high) degree of loyalty Democrats and Republicans display towards the two candidates. It is NOT the case that many voters switched from Obama to Romney. The question, rather, is whether the first debate caused the number of Democratic-ID Americans to fall, and Republican-ID Americans to rise. Pew's figures suggest they did; YouGov believes (and the ABC/Washington Post figures suggest) they didn't.

Or, rather, YouGov's data indicates that Republicans were slightly keener than Democrats to respond to the second survey. This is consistent with other occasions when polls have tended to show movement after specific events, notably post-convention bounces. The figures for Republican ID tend to rise after Republican conventions, and for Democratic ID to rise after Democratic conventions. Past panel-based surveys indicate that this reflects shifts in response rates among Democrat and Republican voters, not significant changes in voters' attitudes to each party.

Of course, differential response rates can matter. If one party's supporters are more enthusiastic than the others, they are probably more likely to vote. However, this requires two things to happen. First, differential response rates must equate to enthusiasm; second, changes in enthusiasm must persist until election day. Neither is certain. Well-informed poll-watchers in the US, such as Nate Silver (New York Times) and Mark Blumenthal (Huffington Post) say response rates to US telephone polls are now below 10%. So pollsters fail to reach more than nine out of ten Americans they try to contact. It takes only a tiny change in relative response rates to have a large impact on the results.

For example, suppose the non-response rates among supporters of Obama and Romney one week is 90% and a poll shows them level. Suppose the next week, every American has the same voting intention, and all that changes is that the non-response rate among Obama's supporters rises just one percentage point to 91%. With political weighting, the published result would be the same; without it, Romney jumps to a five point lead.

Secondly, there's a high chance that, even if response rates a few weeks before polling day do reflect a relative shift in enthusiasm, short-term movements such as these are likely to be reduced as election day draws closer and the campaigning more intense.

That could be why swing-state polls have shown Obama remaining ahead, even as national polls have shown Romney taking the lead. In battleground states, the campaigning is already intense; it is possible that more voters on both sides are firmer in their partisanship, and therefore, the impact on polling response rates of specific events, such as the first TV debate, is likely to be less.

Two further points. Apart from the issue of political weighting, telephone polls in the US divide between traditional polls conducted by human beings, and robopolls done automatically by computers dialing voters. Robopolls are cheaper; or, for the same cost, can reach more people faster. The trouble is that, under US law, robpolls can dial only landlines. They can't reach the one-in-three Americans who have only mobile phones. Another 18% of Americans have landline phones but seldom use them. These figures rise dramatically among the under 30s. They are the people who are keenest on Obama. So we should not be surprised that robopolls, both nationally and in swing states, tend to produce slightly higher figures for Romney than conventional telephone polls in which real people dial both landline and mobile phone numbers.

If the overall result were clear-cut, the small differences between robopolls and live-interviewer polls would be of interest only to obsessive poll-watchers. In the current very close race, they tell very different stories. It looks increasingly as if the state that will decide the outcome next month will be Ohio. According to robopolls, the state, and therefore the nation, are too close to call; according to the live-interviewer polls (and YouGov's online polls), Obama enjoys a modest but consistent lead in Ohio and is on course for a second term in the White House.

Secondly, a point that is specific to YouGov. According to US census data, just 71% of eligible Americans are registered to vote. In 2008, almost 90% of those who were registered did vote. So in any poll, it is vital to know which respondents are on the register. Telephone polls simply ask people and accept their answer. Inevitably, some people give the wrong answer - not necessarily dishonestly but because they think they are on the register but in fact are not.

YouGov is different. As we have recruited an online panel, we are able to check with each state's actual register. In our election surveys we draw on a pool of around 150,000 Americans whom we know are on the register. This doesn't mean we are bound to be closest to the actual election result. We do all we can to minimize sampling error but can never guarantee absolute accuracy. What it does mean is that we are on firm ground on one important aspect of polling American elections. We do know which members of our panel are actually eligible to vote.

Does all this mean that Obama is certain to win on November 6? No. The race is too close. There have been past elections where a late shift in the national mood has changed the outcome. And the ground war could be decisive - the battle by local Romney and Obama activists in the key states to find all their supporters and make sure they turn out on the day (or vote early, as millions of Americans now do, by post or in person). What we can now be fairly sure of is that neither of the first two debates (a Romney triumph in the first one and an effective Obama fight-back in the second) made much of a difference.

YouGov will return to our panel of voters in 25 states next week for CBS, as well as conducting further national polls for The Economist. Four years ago our final national poll came within one point of the result, and we called the right winner in all bar one very closely-fought state. Meanwhile, when polls report big shifts in support; especially when they are from companies that do not weight their data to ensure politically representative samples we should remember the old truth: dramatic polling movements make for bold headlines, but are not always right.

 

Follow Peter Kellner on Twitter: www.twitter.com/@YouGov

FOLLOW UK POLITICS
There are two versions of what has happened in the past three weeks in the battle to be US president. One is the version told by most nationwide polls and accepted by the media; the second, told by a ...
There are two versions of what has happened in the past three weeks in the battle to be US president. One is the version told by most nationwide polls and accepted by the media; the second, told by a ...
 
 
  • Comments
  • 37
  • Pending Comments
  • 0
  • View FAQ
Comments are closed for this entry
View All
Favorites
Recency  | 
Popularity
Page: 1 2  Next ›  Last »  (2 total)
HUFFPOST SUPER USER
rawulom
11:31 AM on 10/28/2012
I am happy Romney is getting teased up but I am also very happy it will make Obama people not to sit down and do nothing. All in all, Obama will win even better than is being predicted. The only reason Romney is even getting closer to his numbers is because of those Whites who will never see a Black man good for anything. This is really a pity!
03:40 PM on 10/28/2012
How sad that your black leader has to rely on bare-faced cheating and the verbal put down of his opponent by his own children in his desperation to cling on to his post.

As a role leader, Obama is an utter disgrace.

It is impossible to respect, surely, someone who illegally counts over one million DEAD people's votes in addition to, also illegally, allowing people to register and vote in two different states. Talk about filthy tactics.

As far as your final comment is concerned, it is black people who have voted for Obama purely because he is black. 94% of your African Americans who voted, voted for the black man. This vote, from people who are largely uneducated and unsophisticated, was not a considered vote in any form and is a poor reflection on their race. It is in fact pure racism.

THAT is the real pity!
05:33 PM on 10/27/2012
Do Americans need clowns like Romney and Bush?
photo
HUFFPOST SUPER USER
Judie Vc
rMONEY OUTSPENDS SICKY 6:1 ON Mi = UNELECTABLE!!!!
03:38 PM on 10/26/2012
Interesting take on polling.
07:28 AM on 10/25/2012
Anyone comes at me in the street with a clipboard is getting swerved! Who actually completes these polls? I am sure that a Black / Gay / Muslim / disabled / Veteran / Elderly / Republican is included as a pollster?
09:10 PM on 10/24/2012
I am relieved that the American people are not as fickle and naive to allow a single debate performance to allow a phenomenal 8% nett difference in Polls. The Polls have been indicating that Americans are more influenced by the style of the delivery of the message that the content, or the basis of fact. How can the American public be taken in by the contradictions and lies delivered by Romney throughout this campaign and his career? His credibility and integrity on most issues must be in serious doubt?
05:49 PM on 10/24/2012
Come on Mitt, you can do it.
HUFFPOST SUPER USER
rawulom
11:33 AM on 10/28/2012
Do what? Become a president of US? You are ready to accept a man who doesnt believe in anything? A man that says something in the morning, change it in the afternoon, have another position by evening, by midnight he comes up with another one. Just to win an election. I have no respect for such a man.
01:27 PM on 10/28/2012
Are you describing Obama?
photo
edmurfin
Old man, on Bonus Time:-)
02:58 PM on 10/24/2012
An interesting and informative article - clearly written and it helped to dispel a few puzzles I've always had regarding opinion polls. Though I'm English, I took a keen interest in watching all three debates. My opinion of the credibility of either candidate is irrelevant - I have no vote in the US - but in all three I heard nothing from Romney that would persuade me to vote for him. I do notunderstand why Romney has such a large support among voters. I can understand the support of fellow businessmen, for whom national concerns only ever occupy their minds when change threatens the profitability of their companies. I can understand the support of those who do not care about the less privileged in society and view with horror any prospect of any portion of their taxes contributing to succour of the poor, even though it must occur to them that no-one chooses a lowly state in life. I can even - with some difficulty - understand the support of those who are not content that America remains already militarily the strongest on earth and want even more federal taxes wasted on hardware and resources to maintain that position. What I cannot understand is why anyone with a single pair of functioning neurones can actually believe that Romney as President will be better for America and the world it dominates than Obama. For the sake of all Americans and the rest of humanity, I hope most fervently that Romney fails
04:37 PM on 10/24/2012
My sentiments exactly, Obama is a very genuine person who admits his shortcomings and like you I think Romney is very smarmy and very false, hopefully the American people will see through him before its too late.
photo
edmurfin
Old man, on Bonus Time:-)
05:00 PM on 10/24/2012
Smarmy is an excellent description, Scuba. Would anyone buy a secondhand car from this man? His utterances have been inconsistent throughout his campaign - one gets a strong impression of someone who will say and agree almost anything if he thinks it will improve the chance they might vote for him. Fingers crossed - and a small prayer to whatever provocative agent might be watching over us - he won't win.
03:56 AM on 10/28/2012
Although there are a lot of ill-informed and ignorant voters that don't question the biased media here in the U.S., there are plenty more rational and intelligent people who see through Romney. Obama will ultimately win (thankfully).

I can't even bear to look at Romney without shuddering in disgust. He's such a flippin' weasel. His backward views on women are atrocious and I can't wait until he goes away.
03:49 PM on 10/28/2012
Perhaps you would care to 'big up' your hero Obama to all of the families now living in their cars thanks to him.

To all the fools depending on Obama to provide them with a lazy, benefit filled life, good luck with that. Romney is right to represent those who actually work for their families and their country. The real scare here is that those who want to rot away on their sofas will be forced to get off their arses and actually contribute.
photo
edmurfin
Old man, on Bonus Time:-)
08:27 PM on 10/28/2012
If you believe that Romney is the best man to ensure the US 80 million plus citizens presently living in poverty, with little hope of ever improving their lot, will under him find jobs and occupations that will help lift them out of the poverty trap, then vote for him. If you have ever lived on benefits, then you will know that it is hardly the most luxurious of lives. To dismiss 80 million people as bone idle scroungers who don't deserve state help to get them in work and so better able to fulfil the sort of aspirations you , doubtless, seek yourself, suggests someone who believes in the value of the devil take the hindmost ethos. Your choice. Not mine, but thanks for some further insight into the Repubican mindset - as a UK citizen it helps me to understand better what my people also have to deal with in our own political system. It is my observation as I approach 80 years, that most people want work that is rewarding financially - and preferably also fulfils their hopes of employment that satisfies their human spiritual and creative needs also. That doesn't seem wrong to me in the slightest.
photo
HUFFPOST SUPER USER
Nathan0316
TrueBlueTory Age quod agis
01:35 PM on 10/24/2012
What you're essentially saying is that there are two large camps in the US that will not be moved,with a selection of small roving bands that could tip the battle?

What you're really saying is that the US is deeply divided on partisan lines and is likely to stay that way for at least 4 more years!
10:26 AM on 10/24/2012
Let's hope that Romney succeeds.
photo
HUFFPOST SUPER USER
gussom
On the message
12:38 PM on 10/24/2012
Why?
HUFFPOST SUPER USER
rawulom
11:38 AM on 10/28/2012
At what? Succeeds at changing his positions four times in a day? Did healthcare in the state and says he will repeal Obamacare only to say he will retain some things in it. Self depot and not sign the dream act, but now says he will sign it. C'mon what can of man or woman are if you cant jump your party to see when a candidate is not being sincere. Please may Romney never succeed. Let him go back and continue his success in taken over companies and sending the workers into misery.
HUFFPOST SUPER USER
WilliamGossett
03:24 AM on 10/24/2012
Robo calls will pickup a slightly higher percentage of more affluent people because they have more phone lines (greater chance of being selected) even though the dialing of the numbers are random.
photo
CanadaToo
Religion != God
01:06 AM on 10/24/2012
Very interesting. Also interested in the post-election analysis to see if the young voters or non-English speaking voters have been under counted.
12:51 AM on 10/24/2012
Republicans believe whatever they see & hear anyways. So even though we know who is ahead, let them have their moment.
They know willard isn't ahead overall
12:28 AM on 10/24/2012
While the more respected Gallup and Rasmussen polls continue to show Romney way ahead.
HUFFPOST COMMUNITY MODERATOR
ShawnMichel
Insulting conservatives since 1962.
12:32 AM on 10/24/2012
Respected only by Republicans.

Which is to say, unworthy of any respect whatsoever.
09:22 AM on 10/24/2012
and this HUff Post are all pro Obama. The Mr "Me" president , a Harvard grad does not know how to use his grammar correctly nor knows how to pronounce the word :corpsman"
On this last debate, he was acting like "nannanannah, I know more than you.. we have aircrafts carrier, we have bigger boats that submerge..etc...any ordinary american citizen knows that and to insult Romney about horses and bayonets..which are still in use BTW...Obama may have won the debate according to this post and its leftist fans..but he would not win the election. This community organizer will be going back to Chicago permanently by Nov 6 midnight.
04:36 PM on 10/24/2012
Both was right 4 years ago.
HUFFPOST SUPER USER
rawulom
11:41 AM on 10/28/2012
Dont worry, Nov. 6th isnt too far. Romney will never win. There are not enough Americans that hate Obama to elect Romney president. I am so happy his ego is being massaged at this point. No wonder he will have serious heartache come Nov.6th
This user has chosen to opt out of the Badges program
11:18 PM on 10/23/2012
why isn't this on the US edition ?
06:27 AM on 10/24/2012
Because the US (IMHO) is one of the most propagandized and manipulated populations on the planet. On my few trips to Europe, I was struck by how much more down to earth straightforward and more intelligent programming on CNN was when directed to an international audience, rather than the "domestic" one.
04:37 PM on 10/24/2012
If this is true. Why is the US the only western country with a black president?
This user has chosen to opt out of the Badges program
11:17 PM on 10/23/2012
very helpful, thankyou