Psychology Reader

Constraints on Generality (COG): A Proposed Addition to All Empirical Papers

Daniel J. Simons, Yuichi Shoda, and D. Stephen Lindsay · 2017 · Perspectives on Psychological Science

Role
Methodological contribution
Difficulty
Accessible
Full work length
6 pages
Type
Journal article

Access

Psychology Reader links to legitimate sources and does not host article PDFs.

Reading focus

Syllabus: When Do Psychological Findings Generalize?

Follow how the proposed statement connects the sample described in the method to the population named in the conclusion.

Why you’re reading it. Turn an implicit claim of generality into something that can be evaluated.

A question to consider. For a student memory experiment, write one supported scope statement and one broader hypothesis that still needs testing.

Why this reading

A claim can extend far beyond the people and circumstances described in a method section. Simons and colleagues propose a way to make that intended reach explicit, including the evidence and assumptions that support it.

Before you read

The source population is where observations came from; the target population is what the conclusion is meant to concern. Both can refer to materials and situations as well as people. A boundary condition specifies circumstances under which an effect is expected to change or disappear.

Read for

  1. Separate observed boundaries, theoretically expected boundaries and limits that remain unknown.
  2. Compare the worked statements with a generic acknowledgment that further research is needed. What could a future study actually test?

Consider afterwards

  1. A memory experiment uses students and English nouns. What target claim could you defend, and what evidence would you need to extend it to other kinds of material?

Editorial context

This is a proposal for reporting and cumulative research, not an experiment showing that the proposed policy improves science. An explicit claim is easier to evaluate, but writing it does not supply evidence for it. Unanticipated boundaries can still emerge.