Questionable Research Practices

Examples of Sampling Bias and Demand Characteristics through a Daily Show Clip

A clip (5:30) from the The Daily Show with Jon Stewart that demonstrates how sampling bias and demand characteristics can lead to misleading conclusions. “Poll Bearers: Cable news polls might not reflect public opinion so much as the ability of viewers to repeat the ideas they just heard.” View the episode here.

Open Stats Lab: Identifying Questionnable Research Practices

Students read “Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling“ Student respond to a series of questions asking them to define questionable research practices, how they relate to Type 1 Error, consequences, and remedies. A lab summary includes: learning objectives, background, article citation, and the response questions. You can follow Open …

Open Stats Lab: Identifying Questionnable Research Practices Read More »

Link:’s Hack Your Way to Scientific Glory

This website lets you take the wheel and play with several different parameters during data analysis. By defining who you’re sample is, how you measure economic performance, an what other variables you factor in, you’ll get to see how it impacts results. Sure enough, after a few tries you’re virtually sure to get “publishable” findings. …

Link:’s Hack Your Way to Scientific Glory Read More »

Online Activity: Open Science in Psychology

A set of lecture slides (created by Dr. Benjamin Le) entitled, “Open Science in Psychology: Why, What, & How.“ This stylish slide deck reviews the problem (i.e., the replication crisis) including several examples of failed replications, questionable research practices, and provides potential solutions (e.g, using open science concepts). Please click here for the file.