5.4. Sampling Bias

Learning Outcome

Students will be able to cite sampling bias in its various forms.

Sample Tasks

• Identify data which is “cherry picked.” That is, selecting data that supports a particular position while ignoring relevant contradictory evidence.

• Characterize a sample of data influenced by nonresponse bias and explain that this bias is influenced by the salience of a study or its social appeal.

• Explain and pinpoint studies that could be affected by interviewer bias or from a voluntary response sample.

[OhioDoHEducation21]

Our first reading is two entries from Wikipedia desribing different types of biases.

• Sampling Bias

• Selection Bias

Reading Questions

• What is survivorship bias?

• What is Berkson’s fallacy?

Our second reading, from Learning Data Science [LGN23], describes four of the most common types of biases.

• 2.5.1. Types of Bias

Reading Question

• Do you fill out surveys?

  • Which type of sampling bias does that affect?

Our third readings, from Wikipedia, describe a type of bias that occurs for sensitive questions, and a technique to alleviate it:

• Participation Bias

• Randomized Response

Reading Question

• Applying the method of randomized response:

  • Did you have sex with a prostitute in the last month?

Further Resources

• What is Sampling Bias + 5 Types of Sampling Bias, a 2021 blog post.

• What is the Sampling Bias?, a 2021 blog post.

• 6 Types of Sampling Bias: How to Avoid Sampling Bias, a 2022 blog post.