A clip (5:30) from the The Daily Show with Jon Stewart that demonstrates how sampling bias and demand characteristics can lead to misleading conclusions. “Poll Bearers: Cable news polls might not reflect public opinion so much as the ability of viewers to repeat the ideas they just heard.” View the episode here.
Questionable Research Practices
Students read “Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling“ Student respond to a series of questions asking them to define questionable research practices, how they relate to Type 1 Error, consequences, and remedies. A lab summary includes: learning objectives, background, article citation, and the response questions. You can follow Open
This website lets you take the wheel and play with several different parameters during data analysis. By defining who you’re sample is, how you measure economic performance, an what other variables you factor in, you’ll get to see how it impacts results. Sure enough, after a few tries you’re virtually sure to get “publishable” findings.
A set of lecture slides (created by Dr. Benjamin Le) entitled, “Open Science in Psychology: Why, What, & How.“ This stylish slide deck reviews the problem (i.e., the replication crisis) including several examples of failed replications, questionable research practices, and provides potential solutions (e.g, using open science concepts). Please click here for the file.