TPMDC

Rasmussen: How Poll Questions Affect The Answers (And Why Our Obama Approval Numbers Are Different)

Spread the word. Share this article on Facebook!

Share

President Barack Obama

Read More

Barack Obama, Rasmussen

Share

Twitter Facebook Fark Reddit Send to a Friend

Send to a friend!

To email:    Your Name:    Your email:

Rasmussen has released a new set of polls illustrating how the exact questioning of a poll can subtly affect the answers -- and perhaps explaining why their own daily survey puts President Obama's approval lower than nearly everyone else.

Respondents were asked their approval of Obama using Rasmussen's usual format: Do they strongly approve, somewhat approval, somewhat disapprove, or strongly disapprove? The answer here is 47% approval, with 28% strongly approving, to 52% disapproval, including 41% who strongly disapprove.

However, Rasmussen got a different result when they asked the question as a simple "approve" or "disapprove." Obama then enters positive territory at 50% approval, 46% disapproval -- in line with a lot of other polls, such as the Gallup survey.

From the pollster's analysis:

It's important to note that the difference could be just statistical noise in a survey with a +/- 4 percentage point margin of sampling error.

However, the difference is consistent with years of observations that Rasmussen Reports polling consistently shows a higher level of disapproval for the President than other polls. That may reflect the fact that there may be some people willing to offer a "somewhat disapprove" rating rather than say they "disapprove."

Some of the gap on the negative side is probably the result of using an automated polling system (see methodology). Automated polls almost always record a higher negative rating for all politicians--regardless of party or ideology--than operator-assisted polls. One theory is that automated polls pick up a more honest reaction on the negative side because people may be a bit reluctant to tell an operator that they don't like someone (especially someone they've never met).

Rasmussen also tried a third measurement of approval, asking respondents whether they rate Obama's performance as excellent, good, fair or poor. The numbers: excellent 27%, good 11%, fair 14%, poor 46%.

Join the Conversation!

7 comments

Recommend Recommend (0)

November 30, 2009 1:10 PM   

Of course now the problem is that whenever a Rasmussen poll is referred to, nowhere is the context of this post considered. So the reader is *still* left with an apples vs. oranges situation whenever a Rasmussen poll is touted here (compared to other polls)...but they are never told that!

Reply | Flag Abuse

Are you sure this comment violates TPM's Terms of Service?

November 30, 2009 1:54 PM   

Or why do our polls consistently rate Obama's approval lower, while our polls consistently gave George Bush the highest approvals of any pollster? Gee, I wonder what the mystery could be in that....

Reply | Flag Abuse

Are you sure this comment violates TPM's Terms of Service?

November 30, 2009 2:03 PM   

People are always bashing Rasmussen polls, but he usually gets the big elections pretty much right.

In light of that, I find it refreshing that Rasmussen is open enough to do a public analysis of his methods like this

Reply | Flag Abuse

Are you sure this comment violates TPM's Terms of Service?

November 30, 2009 2:45 PM    in reply to Campesino

We bash because their polls are bullshit and manufactured. They adjust eventually so that their bottom line always comes out 'in the mainstream', allowing them to spout off on their accuracy. They don't release their cross tabs and use party identification that almost any observer would ridicule. Yet people view their polls as 'non-partisan'. Who knows why.

What I know is that a 3rd grader can look at the following and play 'One of these things is not like the other....'

http://www.realclearpolitics.com/epolls/other/president_obama_job_approval-1044.html

Reply | Flag Abuse

Are you sure this comment violates TPM's Terms of Service?

November 30, 2009 2:55 PM    in reply to Campesino

The problem with Rasmussen, which they are not acknowledging here, is that they apply a likely voter screen to every poll they do and "weight" outcomes according to their own, rather odd, assessment of the "correct" ratio of Democrats to Indies to Republicans.

A "likely voter screen" is not just asking people whether they intend to vote in the next election, although that's part of the suite. Rather, it is a suite of questions dictated by a regression analysis --certain answers to certain questions that are mathematically found, over time, to correlate strongly with a likelihood of voting in the next election. Party identification, education, income, employement, profession, issues deemed most important.

well designed likely voter screens do a great job of identifying people who are likely to vote three or four weeks before the election. And the closer it gets to election day, the better they do. However, likely voter screens are highly unreliable for identifying likely voters months out and, more importantly, they skew the poll result rightward.

Let me put it another way. The group of people whose answers to the likely voter suite cause the model to deem them "likely to vote" is very different from the group that gives the "right" answers a year before the election. And, for reasons too complex to go into here--but the short version is "because they are generally more intense and angry about damn near everything all the time"--people who give the answers necessary to be deemed "likely voters" are much more likely to be conservative and Republican the further away the next election is.

So here's how the Rasmussen scam works. By applying a likely voter screen to their raw data far in advance of the next election, Rasmussen generates results that are pleasing to their customer base (Republican politicians), and thus make it more likely they'll hire them for election polling, and yet perserve their reputation for "accuracy" because their results get more accurate the closer to election day the polls are taken. And, as an added bonus, they get to use their skewed, pre-election, results to try to distort public opinion in a way that conforms to the owners' own ideology.

Reply | Flag Abuse

Are you sure this comment violates TPM's Terms of Service?

November 30, 2009 2:34 PM   

538 has the most accurate polls.

Reply | Flag Abuse

Are you sure this comment violates TPM's Terms of Service?

November 30, 2009 2:45 PM   

538 does not commission its own polls. They merely analyze and aggregate the polls published by other organizations.

Reply | Flag Abuse

Are you sure this comment violates TPM's Terms of Service?

Leave a comment

Your response:

Follow us!

Most Popular

TPM Stories Now Surging on