Missing the Function: How Standard Experimental Practices Undermine Psychological Theory
- Sponsor
- Quantitative Psychology
- Speaker
- Dr. Marc Jekel, University of Cologne
- Views
- 4
- Originating Calendar
- Psychology General Calendar
Experimental psychology often aims to identify causal effects of metric constructs—such as affect, motivation, or cognitive processing styles—by manipulating them at only two or three levels. This practice discretizes inherently continuous constructs, hindering the ability to test functional relationships between independent and dependent variables. It reflects the dominant mode of verbal theorizing in psychology, which identifies relevant variables and predicts effect directions but rarely specifies the functional forms of those relationships. We argue that this limitation is sustained by a vicious circle between imprecise theory and impoverished experimental methods: experiments rarely test functional forms because theories rarely specify them, and theories rarely specify them because experiments include too few conditions to reveal them. To break this circle, we propose that experimental designs systematically vary manipulation intensity to uncover functional relationships—an approach that may also help address challenges in replication and effect heterogeneity. We emphasize the importance of manipulation checks and discuss (some) analytic tools for investigating functional relationships. Embedding functional considerations into experimental design can advance the development of more testable and generalizable theories.
An open-access pre-print of the subject is available at the following link: https://doi.org/10.31219/osf.io/r2upn_v7