Gallup Poll

Goal: To critically analyze the role of probability and chance in real-world situations.
Go to and choose a recent poll that interests you which also has a Survey Methods section that includes a margin of sampling error %.

Survey Information and Methods:
  1. What is the total sample size for this poll? ____________________

  2. What is the overall margin of sampling error Gallup gives? ______________________

  3. What is the confidence level for the margin of error? __________________

  4. On what dates did Gallup conduct this poll? _______________________

  5. Who did Gallup survey for this poll?

  6. What method did Gallup use to collect the data (face-to-face interviews, phone...)?

  7. What is the headline or title of the poll?

  8. What is the publication date?
Critical Analysis:
  1. What do you think is the larger "population" this poll is meant to represent? Given the way Gallup chose its sample and collected its data for this poll, do you think they actually managed to get a representative sample of this population of interest? If yes, why do you think so? If not, what subgroups do you think might not be well-represented?

  2. If Gallup had taken a completely unbiased simple random sample from the population for this poll, what would be the overall 95% confident margin of error, given the poll's sample size above? Show the computation and then convert to an approximate percentage.

  3. Is Gallup's margin of error larger, smaller, or the same as the computed one?

  4. If Gallup's margin of error is different than your computation, does it generate a wider interval or narrower interval than yours would?

  5. Explain what 95% confidence interval means.

  6. Explain what margin of error means.

  7. Assume little to no bias and truly a random sample. If Gallup conducted 100 such polls with a 95% confidence interval, then about how many polls are likely to include the true population percentage?

  8. Is there any way to know which intervals contain the true percentage and which ones don't?

  9. Is there any way to know for sure if it is a representative sample?

  10. How should we interpret a margin of error if the sample is very biased?

  11. Does the title of your poll make any definitive-sounding statements about changes in opinions over time, majority opinion, or differences between groups (e.g., "Record-High Support for Legalizing Marijuana Use in US," "Slim Majority against Government Pushing Traditional Values," or "Women Lead Men on Key Workplace Engagement Measures")? If so, list them. You may also find these kinds of statements inside the article.

  12. Assume for this question that Gallup's sample is indeed representative of the population (e.g., no bias). If you take into account Gallup's margin of error when you interpret the poll results, is it statistically valid for Gallup to make the statements it did in the title or elsewhere about the population? Are the primary conclusions supported by the data if you take into account Gallup's margin of error? Take any overlaps into consideration--show them and explain. For instance, arguments might look something like: 54%-4% = 50% but the headline makes it sound like a majority, or 45%-5%=40% may not be highest since 1969 because...