Causal Methods
REFERENCE

Assumptions cheatsheet

Identifying assumptions for every method, with testability indicators and the standard diagnostic each assumption calls for.

TESTABILITY
testable
partially testable
not directly testable
DiD

Difference-in-differences

Estimand: ATT
Parallel trendspartially testable

Absent treatment, treated and control groups would have followed the same outcome trend.

Diagnostic:Pre-period event study: check that pre-treatment coefficients are jointly zero.
No anticipationpartially testable

Units do not alter behavior before treatment in response to expected future treatment.

Diagnostic:Inspect leads in the event study, significant pre-trends may reflect anticipation.
SUTVAnot directly testable

No interference between units and a single version of treatment.

DiD

Staggered DiD (Callaway–Sant'Anna)

Estimand: ATT(g,t)
Parallel trends (conditional)partially testable

For each cohort g, trends would have matched those of the not-yet-treated (or never-treated) units, conditional on covariates.

Diagnostic:Pre-treatment group-time ATTs should be zero; test jointly with aggte().
No anticipationpartially testable

Cohort g does not respond before period g.

Diagnostic:Inspect group-time ATT estimates in pre-treatment periods.
No forbidden comparisonstestable

Already-treated units are not used as the comparison group for later-treated cohorts.

Diagnostic:Ensured by design in CS estimator with 'notyet' or 'never' control group.
IV

Instrumental variables (2SLS)

Estimand: LATE
Relevancetestable

The instrument is correlated with treatment. Weak instruments inflate 2SLS bias toward OLS.

Diagnostic:First-stage F-statistic > 10 (Stock–Yogo). Report Cragg–Donald or Kleibergen–Paap F.
Exclusion restrictionnot directly testable

The instrument affects the outcome only through treatment, no direct path from Z to Y.

Diagnostic:Argue from institutional knowledge. Overidentification test (Sargan–Hansen) if multiple instruments, but only tests relative exclusion.
Independencepartially testable

The instrument is as-good-as-randomly assigned, independent of potential outcomes and treatment compliance types.

Diagnostic:Balance test: instrument should be uncorrelated with pre-treatment covariates.
Monotonicitynot directly testable

No defiers, if Z moves D for any unit, it moves it in the same direction for all. Ensures complier pool is non-empty.

Diagnostic:Argue from the sign of the first stage. Partial tests available in multi-valued instruments.
RDD

Sharp RDD

Estimand: ATE (local)
Continuity at thresholdpartially testable

Potential outcomes are smooth functions of the running variable at the cutoff. Any discontinuity in observed outcomes is attributed to treatment.

Diagnostic:Covariate smoothness test: pre-treatment covariates should not jump at the cutoff.
No manipulationtestable

Units cannot precisely sort above or below the cutoff. Assignment is effectively random in a neighborhood of c.

Diagnostic:McCrary (2008) density test, rddensity::rddensity() in R/Python.
Local covariate smoothnesstestable

Observed covariates are continuous at the cutoff, ruling out discontinuities that could confound the estimate.

Diagnostic:Run the main RDD specification with each covariate as the outcome. Coefficients should be near zero.
RDD

Fuzzy RDD

Estimand: LATE (local)
Continuity at thresholdpartially testable

Same as sharp RDD: both potential outcomes continuous in the running variable at c.

Diagnostic:Covariate smoothness; visual inspection of outcome and forcing variable plots.
No manipulationtestable

Same as sharp RDD.

Diagnostic:McCrary density test.
Monotonicitypartially testable

Treatment probability weakly increases (or decreases) at the cutoff for all units, no defiers.

Diagnostic:First-stage estimate should be positive and significant.
Match

Matching & IPW

Estimand: ATT or ATE
Conditional ignorability (CIA)not directly testable

All common causes of D and Y are observed in X. Unobserved confounding would invalidate the estimate.

Diagnostic:Rosenbaum bounds (rbounds) quantify how strong hidden bias would need to be to explain away the result.
Overlap / positivitytestable

Every covariate profile has a nonzero probability of treatment and control. Propensity scores of 0 or 1 violate overlap.

Diagnostic:Inspect propensity score distributions for treated and control. Trim or discard units outside common support.
SUTVAnot directly testable

No interference between units; a single version of treatment.

CF

Causal forest

Estimand: CATE
Conditional ignorabilitynot directly testable

No unobserved confounders given X.

Overlaptestable

Propensity bounded away from 0 and 1 uniformly in X.

Diagnostic:grf::get_forest_weights() or propensity model histogram.
Honestytestable

Each tree uses separate subsamples for splitting and for estimation. Required for valid confidence intervals on CATEs.

Diagnostic:Ensured by default in grf. Disable with honesty = FALSE only for exploratory work.
AIPW

AIPW (augmented IPW)

Estimand: ATE or CATE
Conditional ignorabilitynot directly testable

No unobserved confounders given X.

Overlaptestable

Propensity bounded away from 0 and 1.

Diagnostic:Trim extreme propensity scores if needed.
Double robustnesspartially testable

Consistent if either the outcome model or the propensity model is correctly specified, not both required. Achieves semiparametric efficiency when both converge fast enough.

Diagnostic:Cross-fit both nuisance models independently and check residual balance.
Nuisance convergence ratepartially testable

For valid inference, the cross-fitted outcome and propensity models must converge fast enough. Most flexible learners (lasso, forests) satisfy this.

Diagnostic:Report cross-fitted RMSE for both nuisance models and check that estimates are stable across learner choices.