What Is Standard Deviation and Why Does It Matter?
Standard deviation is one of the most important statistics you'll ever encounter — and one of the most frequently misunderstood. It appears in everything from scientific research to financial risk to quality control in manufacturing. Here's what it actually means.
What It Measures
Standard deviation measures how spread out data is around its mean (average). A small standard deviation means data points are clustered tightly around the average. A large standard deviation means they're spread widely.
Two datasets can have identical means but completely different standard deviations — and tell completely different stories as a result.
A Simple Example
Two teachers give their students a test. Both classes have an average score of 70%. But in Class A, scores range from 65% to 75%. In Class B, scores range from 30% to 100%.
Class A has a small standard deviation — the students are performing similarly. Class B has a large standard deviation — there's enormous variation in performance. The same average conceals completely different realities.
How It's Calculated
For a dataset of values:
- Calculate the mean
- Subtract the mean from each value and square the result
- Find the mean of those squared differences (this is the variance)
- Take the square root of the variance
The square root step is what gives standard deviation the same units as the original data — so if you're measuring centimetres, your standard deviation is also in centimetres.
The 68-95-99.7 Rule
For data that follows a normal distribution (the classic bell curve), standard deviation has a remarkable property:
- 68% of data falls within 1 standard deviation of the mean
- 95% falls within 2 standard deviations
- 99.7% falls within 3 standard deviations
This is why a result "3 standard deviations from the mean" is considered highly unusual — less than 0.3% of results are that far out under normal conditions. This is the basis of much of scientific hypothesis testing.
Why It Matters in Finance
In investment, standard deviation is used as a measure of volatility — how much a stock's price fluctuates around its average return. A high standard deviation means higher risk. A low one means more predictable returns. It's why a savings account (low standard deviation) and a small-cap stock (high standard deviation) can have very different risk profiles even if their average returns look similar over a short period.