Research Methods

Open Stats Lab: Identifying Questionnable Research Practices

Students read “Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling“ Student respond to a series of questions asking them to define questionable research practices, how they relate to Type 1 Error, consequences, and remedies. A lab summary includes: learning objectives, background, article citation, and the response questions. You can follow Open …

Open Stats Lab: Identifying Questionnable Research Practices Read More »

Open Stats Lab: Introduction to Pre-registration

Students read “Research Preregistration 101“ Students read “Example steps for doing a pre-registration in (social) psychology” from the OSF website. Student respond to a series of questions about the value of pre-registration, including its ability to counter HARKing. A lab summary includes: learning objectives, background, links to articles, and the response questions. You can follow …

Open Stats Lab: Introduction to Pre-registration Read More »

Open Stats Lab: Additional Activities

Activities focus on the following topics: (RELIABILITY ANALYSIS) Do People Feel Immoral After Behaving Inauthentically? Here students get to compute new variable, calculate descriptive statistics, find Cronbach’s alpha, and create a table. (CHI-SQUARE TEST OF INDEPENDENCE) Why do People Fail to Follow Through on Their Good Intentions? Here students get to conduct a t-test for …

Open Stats Lab: Additional Activities Read More »

Open Stats Lab: Two-Way (Factorial) ANOVA Activities

Activities focus on the following topics: (TWO-WAY ANOVA) Do People Judge Physical Distances of Locations Based on Their Psychological Orientation Toward Them? Here students get to conduct a two-way (factorial) ANOVA, tests for the interaction, and create a figure. (MIXED ANOVA) Do People Underestimate the Pleasure of Remembering Ordinary vs. Extraordinary Events? Here students get …

Open Stats Lab: Two-Way (Factorial) ANOVA Activities Read More »

Open Stats Lab: One-Way ANOVA Activities

Activities focus on the following topics: (ANOVA w/ PLANNED COMPARISONS) Does Reasoning about Personal Problems Improve with Psychological Distance? Here students get to conduct a one-way ANOVA (with planned comparisons) and create a figure. (ANOVA w/ PLANNED CONTRASTS) Can Playing Tetris Reduce the Occurrence of Intrusive Memories? Here students get to conduct a one-way ANOVA …

Open Stats Lab: One-Way ANOVA Activities Read More »

Open Stats Lab: t-test Activities

Activities focus on the following topics: (SINGLE SAMPLE and PAIRED-SAMPLES) Does Music Convey Social Information to Infants? Here students get to conduct a single/one sample t-test, a t-test for dependent means (paired samples), and can create a boxplot and/or scatterplot. (TWO INDEPENDENT SAMPLES) Do Spoken or Written Words Better Express Intelligence? Here students get to …

Open Stats Lab: t-test Activities Read More »

Open Stats Lab: Regression Activities

Activities focus on the following topics: Why are People Biased When Reasoning About the Status Quo? Here students get to conduct bivariate correlations, regression, and multiple regression. They may also create a table. Do Experts Overrate the Extent of Their Expertise? Here students will conduct descriptive statistics, t-tests, multiple regression, and use a split file. …

Open Stats Lab: Regression Activities Read More »

Open Stats Lab: Correlation Activities

Activities focus on the following topics: Does Being Wealthy Distort Perceptions of Wealth Inequality? Here students get to create new variables, calculate means and standard deviations, and conduct bivariate correlations. Do Outbreaks of Infectious Diseases Influence Voting Behavior? Here students will need to select certain cases for the analysis, conduct bivariate correlations, and generate scatterplots. …

Open Stats Lab: Correlation Activities Read More »

Link: Open Stats Lab

Open Stats Lab (OSL) is a free resource for the teaching of introductory statistics. From the site: “OSL is primarily a resource for the teaching (and learning) of statistics. Although many statistics textbooks come with supplemental data sets to help train students in data analysis, these data sets often lack the richness and complexity of …

Link: Open Stats Lab Read More »

Stats in Everyday Life: Z-scores and the Top 20 Athletes Ever

“Top” lists of anything are always popular because people want to see how the list compares to their own beliefs. Readers then get to debate the merits of who was included or excluded. When it comes to a diverse group such as athletes, it can be difficult to compare across sports. Please click here for …

Stats in Everyday Life: Z-scores and the Top 20 Athletes Ever Read More »

Lecture Slides: Samples Representing the Population with the Use of M&Ms

This PowerPoint leads students through an activity that stresses the need to have a relatively large sample when trying to accurately represent the population.Instructors will need to supply students with fun size bags of plain M&Ms®. Students first estimate the population frequency of each color of candy using their small sample (fun size bag). Then …

Lecture Slides: Samples Representing the Population with the Use of M&Ms Read More »

Online Activity: Simulation of Sampling Distributions

This Java applet (created by Dr. David Lane) estimates and plots the sampling distributions of various statistics based upon the user’s specified population distribution, sample size, and statistic. The simulation and its associated questions can be used as either homework assignment or as an in-class activity for those classes with access to computers with Internet …

Online Activity: Simulation of Sampling Distributions Read More »

Link: FiveThirtyEight.com’s Hack Your Way to Scientific Glory

This website lets you take the wheel and play with several different parameters during data analysis. By defining who you’re sample is, how you measure economic performance, an what other variables you factor in, you’ll get to see how it impacts results. Sure enough, after a few tries you’re virtually sure to get “publishable” findings. …

Link: FiveThirtyEight.com’s Hack Your Way to Scientific Glory Read More »

Link: Society for the Improvement of Psychological Science (SIPS)

From The Society for the Improvement of Psychological Science (SIPS) Mission Statement: The Society for the Improvement of Psychological Science (SIPS) brings together scholars working to improve methods and practices in psychological science. Anyone interested in improving psychological research is welcome to join, regardless of experience. SIPS is a service organization aiming to make psychological science higher …

Link: Society for the Improvement of Psychological Science (SIPS) Read More »

Online Activity: Open Science in Psychology

A set of lecture slides (created by Dr. Benjamin Le) entitled, “Open Science in Psychology: Why, What, & How.“ This stylish slide deck reviews the problem (i.e., the replication crisis) including several examples of failed replications, questionable research practices, and provides potential solutions (e.g, using open science concepts). Please click here for the file.

Empirical Article: Is It Worth Updating Your Methods Course?

This paper describes the approach we took when revamping our methods course. These are the features that we have highlighted on this site and in our textbook. Please click here to read the full article. Ciarocco, N., Lewandowski, G. W., Jr., & Van Volkom, M. (2013). The impact of a multifaceted approach to teaching research …

Empirical Article: Is It Worth Updating Your Methods Course? Read More »

Exemplar Study: Evaluating Meals on Wheels (Program Evaluation)

This paper describes a process evaluation conducted for a local Meals on Wheels program. In doing so, the researchers sought to address 4 key issues: 1) identifying key program components; 2) extent of component implementation; 3) volunteer satisfaction; 4) how to improve the program.  Based on their findings they suggested means for improvement. Mye, S. …

Exemplar Study: Evaluating Meals on Wheels (Program Evaluation) Read More »

Lecture Slides: Listen to the Music (Mixed Design Demonstration)

In this activity all of the students in class have the opportunity to listen to five different songs,and provide ratings of how energized they feel after each song. Instructors would need to insert the five music clips into the PowerPoint (details provided on the slide below). For the between-subjects variable, students are randomly assigned to …

Lecture Slides: Listen to the Music (Mixed Design Demonstration) Read More »

Online Activity: Factorial Design Concepts Review

This interactive application (created by Dr. Marcie Desrochers and Dr. Sara Margolin) provides supplemental instruction on factorial research designs that students enrolled in a Statistics or Research Methods course in psychology can complete as homework or on their own. It consists of 10 pages of definitions, examples, and images, and 11 quiz questions that help …

Online Activity: Factorial Design Concepts Review Read More »

Practice: Calculating the t-test for Paired-Samples/Dependent Means (Thinking Logically Over Time)

Instructors should assign this problem (about graduate programs training students to think logically) to students as in-class practice or homework after students have learned how to calculate a t-test for dependent means and test for significance. The activity leads students through determining the type of statistical analysis to use, the hypotheses, calculating the t-ratio and …

Practice: Calculating the t-test for Paired-Samples/Dependent Means (Thinking Logically Over Time) Read More »