The Analysis Clinic · For researchers and faculty

Something about your analysis is being questioned. Let's work out why.

Reviewers ask for analyses that don't fit. Study sections doubt the power analysis. Models fail to converge, and results contradict the literature. Each Case in the Clinic explains what the symptom means, what usually causes it, which checks to run, and how to explain the decision.

What are you dealing with? ↓ Or book a free consult →
01
Recognize the symptom
Match what you're seeing to what usually causes it.
02
Run the right checks
Short, concrete diagnostics, not a methods textbook.
03
Compare defensible options
What each fix assumes, and what it costs you.
04
Write the response
Language you can adapt for a reviewer, editor, or study section.
Start with the problem

What are you dealing with?

Pick the description closest to where you're stuck. Each department leads to focused Cases rather than a general methods archive.

01

A reviewer or editor challenged my analysis

Requests for post hoc power, multiple-comparisons corrections, different models, or more covariates, and how to answer them without weakening the paper.

Post hoc power · multiplicity · model choice
02

My grant needs a defensible power analysis

Effect sizes from pilots, unknown ICCs, attrition, and the sample size justification a study section will read closely.

Pilot data · ICCs · attrition
03

My model won't run

Convergence failures, singular fits, and estimation problems in the multilevel, longitudinal, and latent variable models research teams rely on.

Convergence · random effects · estimation
  • Case 006: My Mixed Model Won't Converge with Crossed Random Effects (coming soon)
04

My results don't make sense

Effects that flip sign, vanish, or contradict the literature, and how to tell a real finding from a modeling artifact.

Sign flips · suppression · interactions
  • Case 007: The Effect Flipped Sign When I Added a Covariate (coming soon)
05

My data aren't what we planned

Missing waves, uneven clusters, attrition, and measurement problems that change what the analysis can support.

Missing data · clusters · measurement
  • Case 008: Missing Data Across Waves: What Will Reviewers Accept? (coming soon)
06

We can't reproduce our own results

A coauthor reruns the code and gets different numbers. Finding where the analyses diverged, and preventing it next time.

Reproducibility · software · workflow
  • Case 009: My Coauthor Reran the Code and Got Different Results (coming soon)
Diagnosed and ready to read

Three Cases, each with a reproducible R script.

Case 001 · Diagnosed
A reviewer or editor challenged my analysis

Reviewer 2 Asked for a Post Hoc Power Analysis

Why "observed power" can't answer the reviewer's real question, and the three analyses that can.

Power analysisEquivalence testingR
Case 002 · Diagnosed
A reviewer or editor challenged my analysis

The Reviewer Wants a Multiple-Comparisons Correction

Whether to correct depends on the claim you're making, not on how many p-values are in the paper.

Multiple testingHolmFalse discovery rateR
Case 003 · Diagnosed
My grant needs a defensible power analysis

Can I Power My Grant on My Pilot's Effect Size?

Small pilots give effect sizes too noisy to plan on, and the pilots that look most promising are the most misleading.

Power analysisPilot studiesGrant writingR

Satisfying a reviewer isn't the same as fixing the analysis.

A quick fix can make a warning disappear or a comment go away while leaving the inference weaker than before. Each Case explains what the problem means for your conclusions, compares the defensible responses, and gives you wording you can adapt. Every number comes from an R script you can download and run.

Working on a dissertation? Dissertation Stats Helper's Analysis Clinic covers the problems doctoral students meet most. Preparing a manuscript? Reviewer Ready reviews the statistics before you submit.

In development

Cases in the pipeline.

Upcoming Cases become available once the diagnosis, the reproducible example, and the response guidance have been checked.

Case 004 · Coming soon
A reviewer or editor challenged my analysis

Reviewer: "Why Didn't You Use a Multilevel Model?"

Decide whether clustering changes your inference, and answer with evidence rather than a cutoff.

Mixed models
Case 005 · Coming soon
My grant needs a defensible power analysis

Powering a Cluster-Randomized Grant When the ICC Is Unknown

Build the power analysis around a defensible range of ICCs instead of a single guess.

Cluster designs
Case 006 · Coming soon
My model won't run

My Mixed Model Won't Converge with Crossed Random Effects

Separate optimizer trouble from a random-effects structure the data cannot support.

Mixed models
Case 007 · Coming soon
My results don't make sense

The Effect Flipped Sign When I Added a Covariate

Tell suppression, confounding, and collinearity apart before you interpret the new sign.

Regression
Case 008 · Coming soon
My data aren't what we planned

Missing Data Across Waves: What Will Reviewers Accept?

Match the missing-data method to the design and state the assumption it rests on.

Missing data
Case 009 · Coming soon
We can't reproduce our own results

My Coauthor Reran the Code and Got Different Results

Trace the difference to data versions, defaults, seeds, or package changes.

Reproducibility

Still stuck after the first checks?

Some problems turn on the details of your design, data, or the exact reviewer comment. A free 30-minute consult can identify the next defensible step and what it would take.

Book a free consult