⚠️
Verdict
Misleading

Precognition (future prediction) research replicated so successfully that it triggered the replication crisis in social sciences and psychology

cognitive-biasesL22026-02-09T00:00:00.000Z
🔬

Analysis

  • Claim: Precognition (future prediction) research has been replicated so successfully that it triggered the replication crisis in social sciences and psychology
  • Verdict: MISLEADING
  • Evidence Level: L2 — Peer-reviewed precognition research and replication crisis analysis exist, but the causal relationship between them is distorted
  • Key Anomaly: The claim reverses causation: precognition research didn't trigger the crisis; rather, methodological problems revealed through analysis of all psychology (including controversial precognition studies) exposed systemic flaws
  • 30-Second Check: The replication crisis arose from publication bias, p-hacking, and base rate fallacy across all psychology. Precognition studies became an example of these problems, not their cause

Steelman — What Proponents Claim

Proponents of this claim point to precognition research demonstrating unusually high replication rates, which allegedly forced the scientific community to reconsider its methodological standards. According to social media discussions, "psi research was good enough that it triggered the replication crisis in the social sciences and psychology, since precognition replicated too well for them to ontologically handle" (S001).

Indeed, a substantial body of peer-reviewed precognition research exists. The Mossbridge and Utts (2018) review defines precognition as a form of prospection — attempting to foresee one's future, generally assumed to be based on conscious and nonconscious inferences from past experiences (S004). This review has been cited 88 times, indicating serious attention from the scientific community.

Earlier research by Mossbridge and colleagues (2014) on predictive anticipatory activity (PAA) received 116 citations and presents critical analysis of phenomena where physiological measures allegedly change before future events occur (S007). The authors distinguish PAA from precognition: "In contrast to PAA, precognition may be defined as a perception or a behavior (not a physiological measure) that is influenced by future events" (S007).

Proponents also note that the methodological quality of modern precognition research has reached levels comparable to mainstream psychology, allowing these works to pass peer review in respected journals and be published in APA PsycNet and NIH PubMed Central databases.

What the Evidence Actually Shows

The actual picture is considerably more complex and does not support the direct causal relationship claimed. The replication crisis in psychology and social sciences arose from multiple systemic problems affecting the entire discipline, not just precognition research.

Nature of the Replication Crisis: According to Bird's (2021) analysis, "the replication crisis in social psychology and clinical medicine arises from the fact that many apparently well-confirmed research findings fail to replicate when independent researchers attempt to reproduce the studies" (S010). Bird proposes understanding this crisis through the lens of base rate fallacy — when researchers focus exclusively on salient evidence while neglecting the prior probability of a phenomenon (S006, S010).

Role of Precognition Research: Precognition studies didn't trigger the crisis but became its symptom and diagnostic tool. Francis (2013) notes that "recent reports in psychological science have used apparently scientific methods to report strong evidence for unbelievable claims such as precognition" (S008). This observation, cited 176 times, indicates the problem lies in methods, not in precognition specifically.

Francis analyzes statistical consistency of results and publication bias, showing that high replication rates may indicate not the reality of a phenomenon but systematic methodological biases affecting multiple research groups (S008).

Publication Bias: One key problem is the "curse of failed replications," as Chris French describes in The Guardian (2012): "Science progresses when repeat studies back or refute previous research, but getting 'replications' published can be a nightmare" (S005). This creates a distorted view of the evidence base, as negative results remain unpublished.

Bird (2018) emphasizes: "If negative outcomes are published, then the community is less likely to accept the positive result as proven, because, for example, a meta-analysis shows..." a contradictory picture (S011). However, difficulties publishing negative results create an illusion of consensus.

Chronology and Causation: The replication crisis began to be recognized in psychology in the late 2000s to early 2010s through numerous failed attempts to reproduce classic experiments in social psychology, not through precognition research. Precognition studies attracted attention precisely because they represented an extreme case that highlighted broader methodological problems.

Conflicts and Uncertainties

Interpreting High Replicability: Fundamental uncertainty exists in interpreting what high replicability in precognition research means. On one hand, it could indicate a real effect. On the other hand, as Francis (2013) notes, unusually high replicability can signal systematic methodological problems such as:

  • Selective publication of positive results
  • P-hacking (manipulating data analysis to achieve statistical significance)
  • Multiple comparisons without correction
  • Flexibility in data analysis after collection
  • Sensory leakage in experimental protocols

Defining Precognition: The definition of precognition itself remains debated. Mossbridge and Utts (2018) define it as "a form of prospection," suggesting it may be based on "conscious and nonconscious inferences from past experiences" (S004). However, this definition blurs the boundary between ordinary cognitive forecasting processes and extrasensory perception.

The distinction between precognition and predictive anticipatory activity also creates conceptual complexities. Mossbridge and colleagues (2014) note that PAA refers to physiological measurements while precognition refers to perception or behavior (S007), but this boundary isn't always clearly maintained in the literature.

Methodological Disagreements: Significant disagreements exist regarding what methodological standards should apply to research on extraordinary claims. Some researchers argue precognition studies meet mainstream psychology standards, while critics insist extraordinary claims require extraordinary evidence.

Role of Prior Probabilities: Bird's (2018, 2021) analysis of base rate fallacy highlights a critical problem: evaluating evidence requires considering the prior probability of a phenomenon (S006, S010, S011). For phenomena with very low prior probability (such as precognition), even statistically significant results may be more likely to be false positives than true effects.

Interpretation Risks

Reversing Causation: The main risk of this claim is that it reverses the actual causal relationship. Precognition research didn't cause the replication crisis; rather, the replication crisis revealed problems in precognition research (along with problems throughout psychology). This distinction is critical for understanding the nature of scientific progress.

False Validation: The claim may create the impression that precognition received scientific validation through the replication process, when in fact high replication rates raised suspicions about methodological problems. As Francis (2013) notes, psychological science used "apparently scientific methods to report strong evidence for unbelievable claims" (S008), indicating a problem with methods rather than confirmation of claims.

Ignoring Broader Context: Focusing on precognition as the crisis trigger distracts from systemic problems affecting all psychology and social sciences. The replication crisis concerns:

  • "Publish or perish" pressure incentivizing positive result publication
  • Insufficient statistical power in many studies
  • Lack of pre-registration culture for hypotheses
  • Undervaluation of replication studies
  • Misunderstanding of statistical significance and p-values

Misunderstanding Scientific Method: The claim may suggest high replicability automatically confirms a phenomenon's reality. However, as Francis's (2013) statistical consistency analysis shows, unusually high replicability can be a red flag indicating publication bias or other methodological problems (S008).

Contextual Factors: French (2012) notes difficulties publishing failed replications: "getting 'replications' published can be a nightmare" (S005). This means even if failed attempts to reproduce precognition studies exist, they may remain invisible in scientific literature, creating a distorted view of the evidence base.

Practical Implications

To properly understand the relationship between precognition research and the replication crisis, we must recognize the following:

Precognition Research as Diagnostic Tool: These studies proved useful not because they confirmed precognition's existence, but because they highlighted methodological problems affecting all psychology. As an extreme case of an "unbelievable claim," they forced researchers to look more critically at standard research practices.

Systemic Nature of the Problem: The replication crisis isn't a problem of individual studies or fields but a systemic issue related to how scientific publication is organized, how statistical data are interpreted, and how researchers are evaluated. Bird (2018, 2021) shows that understanding the crisis through the base rate fallacy lens helps reveal these systemic problems (S006, S010, S011).

Need for Methodological Reforms: The real lesson isn't whether precognition is real or unreal, but that psychology needs more rigorous methodological standards, including:

  • Mandatory pre-registration of hypotheses and analysis methods
  • Publication of all results, including negative ones
  • Higher statistical power in studies
  • Accounting for prior probabilities when interpreting results
  • Encouraging replication studies
  • Transparency regarding all conducted analyses

Critical Thinking: When evaluating any scientific claims, especially extraordinary ones, we must consider not only the statistical significance of individual studies but also the broader context: the prior probability of the phenomenon, possibility of publication bias, methodology quality, and existence of independent replications by skeptical researchers.

Thus, the claim that precognition research "triggered" the replication crisis is misleading, reversing the actual causal relationship and simplifying a complex systemic problem to one dramatic example.

💡

Examples

Sensational headlines about 'proven' precognition

In 2011, psychologist Daryl Bem published a paper on precognition that indeed sparked discussions about reproducibility. However, subsequent replication attempts failed to confirm his results, and the replication crisis was caused by many other factors, including p-hacking and publication bias. To verify this claim, examine meta-analyses of attempts to replicate Bem's studies and reviews of the causes of the replication crisis. The crisis was triggered not by successful replications of precognition, but rather by failed attempts to reproduce many classic psychology experiments.

Pseudoscientific courses promising 'scientifically proven' abilities

Some organizations sell training courses on developing intuition and foresight, citing a 'crisis in science' allegedly caused by successful precognition research. In reality, the replication crisis is related to methodological problems in research, not to confirmation of paranormal phenomena. Check scientific databases (PubMed, Google Scholar) for systematic reviews on precognition — you will find that the scientific community consensus denies the existence of this phenomenon. The real causes of the crisis include small sample sizes, flexible data analysis, and selective publication of results.

🚩

Red Flags

  • Переворачивает причинно-следственную связь: выдает следствие (кризис воспроизводимости) за причину (успешные репликации прекогниции)
  • Приписывает прекогниции роль триггера кризиса, хотя кризис охватил всю психологию независимо от паранормальных исследований
  • Использует слово 'реплицировались успешно' без указания на эффект размера, p-hacking и публикационное смещение в этих исследованиях
  • Игнорирует, что большинство исследований прекогниции не прошли независимую репликацию при строгом контроле методологии
  • Подменяет наличие рецензируемых публикаций на доказательство валидности эффекта и его роли в системном кризисе
  • Создает впечатление, что прекогниция — центральная проблема кризиса воспроизводимости, хотя это маргинальная область психологии
🛡️

Countermeasures

  • Search PubMed and PsycINFO for precognition replication studies published before 2011 (pre-crisis) versus after; quantify success rates and compare with baseline replication rates across psychology
  • Examine Bem's 2011 precognition papers and subsequent failed replications (Ritchie, Wiseman, French); trace which methodological critiques actually triggered the reproducibility crisis debate
  • Cross-reference timeline: identify when reproducibility crisis discourse began (Ioannidis 2005, Simmons et al. 2011) against when precognition became central to that conversation—check if causal claim holds
  • Analyze citation networks using Google Scholar: map which precognition studies are cited in reproducibility crisis literature; quantify whether precognition research is actually a primary driver versus peripheral example
  • Request raw data from major precognition meta-analyses (Bem, Honorton); apply modern statistical corrections (p-curve, z-curve analysis) to assess whether effect sizes survive scrutiny or collapse
  • Compare replication success rates: measure precognition study replication percentage against psychology baseline (currently ~36%); determine if precognition performed better or worse than field average
  • Falsifiability test: ask proponents what evidence would prove precognition research did NOT cause the crisis; if no answer exists, the claim is unfalsifiable and logically inverted
Level: L2
Category: cognitive-biases
Author: AI-CORE LAPLACE
#replication-crisis#parapsychology#statistical-methods#publication-bias#base-rate-fallacy#research-methodology#pseudoscience