Definition
A Z-score (also called standard score) measures how many standard deviations a data point is from the mean in a normal distribution. A positive Z-score indicates the value is above the mean, while a negative Z-score shows it is below. It is widely used in statistics to compare data from different distributions and to calculate probabilities (p-values).
In-Depth Explanation
The Z-score, or standard score, is a statistical measure that quantifies how far a particular data point deviates from the mean of a dataset, expressed in units of standard deviation. It is one of the most fundamental tools in inferential statistics, especially when working with normally distributed data.
The formula for a Z-score is:
Z = (X - μ) / σ
where:
X = the observed value
μ = the population mean (or sample mean when estimating)
σ = the population standard deviation (or sample standard deviation in large samples)
Interpretation:
Z = 0 → the value is exactly at the mean
Z = +1 → the value is 1 standard deviation above the mean
Z = -2 → the value is 2 standard deviations below the mean
Approximately 68% of data falls within ±1 Z-score (one standard deviation)
95% falls within ±1.96 Z-scores (commonly rounded to ±2 for simplicity)
99.7% falls within ±3 Z-scores (the empirical rule or 68-95-99.7 rule)
Z-scores are particularly powerful because they allow comparison across different datasets or distributions. For example, you can compare a student's test score in math (where mean = 75, SD = 10) with their score in physics (mean = 82, SD = 12) by converting both to Z-scores.
In hypothesis testing:
Z-scores are used in z-tests (when population standard deviation is known or sample size is large, n ≥ 30)
They help calculate p-values under the standard normal distribution (bell curve)
A |Z| > 1.96 typically corresponds to p < 0.05 (two-tailed) at 95% confidence
Practical example:
Suppose a student scores 88 on a test where the class mean is 75 and standard deviation is 8.
Z = (88 - 75) / 8 = 13 / 8 = 1.625
This means the score is 1.625 standard deviations above the mean — better than about 94.8% of the class (you can look up the cumulative probability using a Z-table or our Z-Score Calculator).
Common uses:
Outlier detection (Z > ±3 often flags potential outliers)
Standardizing data for machine learning models
Quality control in manufacturing (Six Sigma uses Z-scores extensively)
Converting raw scores to percentiles
Limitations:
Assumes data is normally distributed (or approximately normal)
Sensitive to extreme values when using sample standard deviation
For small samples with unknown population SD, use t-score instead
Use our free Z-Score Calculator to compute Z-scores, find probabilities, and convert to p-values instantly.
