Skip to main content
AI Platform ↗
06. Comparing 3+ Groups (ANOVA & Kruskal-Wallis)8 min readAdvanced Lesson

One-Way ANOVA, Welch's ANOVA, and Kruskal-Wallis

Checking the three assumptions of ANOVA and routing to Welch's ANOVA or Kruskal-Wallis when assumptions fail.

In this lesson you will learn

  • 1Verify the three core assumptions of One-Way ANOVA: independence, residual normality, and homogeneity of variance.
  • 2Select Welch's ANOVA with Games-Howell post-hoc tests when data is normal but Levene's test fails (p < .05).
  • 3Select the Kruskal-Wallis H test with Dunn's post-hoc procedure when outcomes are skewed or ordinal.
On this page▼
01

Assumption Checks & Routing to Welch or Kruskal-Wallis

What this section is about

This section provides the diagnostic routing protocol linking Shapiro-Wilk and Levene's tests to Fisher's ANOVA, Welch's ANOVA, or Kruskal-Wallis.

Why it matters for your study

Applying standard ANOVA and Tukey HSD when group variances differ by 4-fold or when one arm is heavily skewed produces invalid p-values.

Before interpreting a multi-group comparison, check three diagnostic gates in sequence:

  1. Independence vs Repeated Design: If different patients are in each arm, use a between-groups test. If the same cohort is measured across 3+ timepoints, use Repeated Measures ANOVA or the non-parametric Friedman test.
  2. Normality Check (Shapiro-Wilk per group): If any group is strongly skewed or ordinal, route to the Kruskal-Wallis H test (reporting Median [IQR] and Dunn's post-hoc test).
  3. Homogeneity of Variance (Levene's test): If all groups are normal and Levene's p > .05, use Fisher's One-Way ANOVA + Tukey HSD. If Levene's p < .05, use Welch's ANOVA + Games-Howell.
1. NominalLabels only (ABO Blood Type)n (%), Mode, Chi-Square2. OrdinalRanked order, unequal stepsMedian [IQR], Mann-Whitney3. IntervalEqual steps, arbitrary zero (°C)Mean (SD), t-test, ANOVA4. RatioTrue zero (Weight, Albumin)Mean (SD), Ratios, Regression
Figure:Scale of measurement, normality, and variance homogeneity jointly determine the valid 3+ group test.

Interactive Decision Tree: Pick the Right Statistical Test

Select your clinical objective, sampling structure, and outcome distribution

1. What is your primary clinical question?
2. Are observations independent or paired within the same subject?
3. What is the scale and distribution of your outcome?
4. Are group variances equal (Levene's Test p > .05)?
Recommended Defensible Test
Independent Samples Student's t-Test

Two independent groups with normally distributed continuous data and homogeneous variances (Levene's p > .05).

Table Summary Format:Mean (SD) per group
Required Effect Size Metric:Cohen's d or Hedges' g

Clinical Example

An emergency department study compares pain relief scores on an ordinal 1–5 Likert scale across 3 analgesic protocols (n = 35 per arm).

Outcome: 5-point Ordinal Likert | Kruskal-Wallis H(2) = 16.42, p < .001, ε² = .16 | Dunn's post-hoc: Protocol C > Protocol A (p_adj < .001)

Interpretation: Because the outcome is an ordinal 1–5 rating, Kruskal-Wallis compares rank distributions across the three arms, and Dunn's Bonferroni-adjusted test identifies which specific pair differs.

Common Pitfall

Running Tukey HSD post-hoc comparisons after a non-parametric Kruskal-Wallis test instead of using Dunn's rank-based post-hoc test.

Advanced Chapter

Included with Any Analysez AI Study Package

This deep interactive chapter (One-Way ANOVA, Welch's ANOVA, and Kruskal-Wallis) and its clinical simulation labs are unlocked for everyone who has bought any Analysez AI study package.

Full unlock of all 10 advanced handbook modules & interactive labs
Interactive statistical models, sandbox data editors & live curve simulators
Publication-ready APA 7th Word table downloads & results templates
Full access to the Analysez AI automated 55-check data cleaning platform
One-Way ANOVA, Welch's ANOVA, and Kruskal-Wallis | Biostatistics Handbook | Analysez