MerQuR+Statistics Glossary

Statistics Glossary → Intraclass correlation (ICC)

Intraclass correlation (ICC)concept

The share of total variance due to differences between groups (or between measured units), used both for measurement reliability and for multilevel data.

In its simplest form, ICC = σ²_between / (σ²_between + σ²_within). In multilevel data (such as pupils within schools) it shows how similar two observations from the same group are; a large ICC means the observations cannot be treated as independent and mixed models are needed. In measurement reliability it shows how consistently raters or repeated measurements score the same subjects.

Reliability studies use several kinds of ICC (Shrout-Fleiss, McGraw-Wong): one-way random, two-way random and two-way mixed models; an absolute-agreement or a consistency definition; and the reliability of a single measurement or of the average of measurements. Because these choices change the result markedly, they should be stated in the report. By Koo and Li's rough guide, values below 0.50 indicate poor, 0.50-0.75 moderate, 0.75-0.90 good and above 0.90 excellent reliability.

An everyday example

Three judges score 20 dancers. If most of the differences in scores come from the dancers genuinely performing differently and the judges give similar scores, the ICC is high (for example 0.85). If one judge systematically gives everyone 2 extra points, the consistency ICC stays high but the absolute-agreement ICC drops.

In MerQur

The 'ICC model' option (All, One-way random, Two-way random, Two-way mixed) and the additional output giving the six ICC types with exact formulas in the Intraclass Correlation Coefficient analysis; the ICC reported with Nakagawa's R² in Generalized Linear Mixed Models; 'ICC interval bootstrap samples (B)' in Hierarchical Bayesian Regression; and in Linear Mixed Models it is reported in every run together with Nakagawa's R².

Analyses where this concept appears

Linear Mixed Models (LMM)Generalized Linear Mixed Models (GLMM)Intraclass Correlation Coefficient (ICC)Hierarchical Bayesian Regression

Related concepts

Absolute agreement and consistency (ICC types)Variance componentsKappa statistic (Cohen's κ)