Methods

Meta-research and Innovation in how research is conducted.

Meta-Research in the area of Methods is broad, aiming to develop, identify and promote best scientific practices while also quantifying the effect of questionable practices which lead to misleading or incorrect findings or interpretations. This research can include:

  • Documentation of the prevalence of error, bias and questionable practices in study design, data collection, analysis, and interpretation, with empirical demonstration of their effect
  • Uses, abuses, and misunderstanding of methods in statistical analysis, research synthesis and citation
  • How to measure and control for “meta-biases;” differences in results seen among collections of studies with certain properties, but whose effect cannot be observed by looking at individual studies. These can include design (e.g. single vs. multi-center studies), sponsorship (private vs. government), country of origin, analytic approach, etc.

Innovation can help expand the use of optimal methods, for example by developing new approaches, methods, tools and policies to:

  • Detect and correct for biases in meta-analyses or evidence evaluation
  • Prevent bias and questionable research practices in study design, data collection, analysis, and interpretation
  • Promote statistical literacy and merge frequentist methods with Bayesian thinking
  • Optimize study design, maximize statistical power and information value, and prioritize research questions, for example to guide funding decisions in replication research
  • Develop and promote tools to facilitate open science
  • Promote scientific integrity, ethics and best research practices

Experts:

  • Chirag Patel

    Chirag Patel

    Chirag Patel is an assistant professor in...

    Affiliate

  • Simine Vazire

    Simine Vazire

    Simine Vazire is an associate professor in...

    Affiliate

  • Russ B. Altman

    Russ Altman

    Russ Biagio Altman, Kenneth Fong Professor...

    Affiliated Faculty

  • Jelte Wicherts

    Jelte Wicherts

    Jelte Wicherts obtained a PhD in psychological...

    Affiliate

Affiliated Centers & Programs:

Recent Publications

All Publications