Mean bias, MAE and RMSE practice with simulated updraft speeds
Mean bias tells you the signed average error. MAE averages error magnitudes. RMSE is the square root of the mean squared error and gives larger misses more influence.
Start with How do you build a contingency table for a supercell forecast?.
| Error (m/s) | Magnitude (m/s) | Square (m²/s²) |
|---|---|---|
| −2 | 2 | 4 |
| +2 | 2 | 4 |
| +6 | 6 | 36 |
Worked example
Take error e as simulated minus observed updraft speed, with paired values for the same space and time. For −2, +2 and +6 m/s, bias is (+6)/3 = +2.00 m/s. MAE is (2+2+6)/3 ≈ 3.33 m/s. RMSE is √((4+4+36)/3) ≈ 3.83 m/s. These synthetic errors illustrate metric behavior without claiming actual simulated or observed storm speeds.
Hint for the exercises
Make three columns for signed errors, absolute errors and squared errors.
Practice questions
- Calculate mean bias for the table.
- Calculate MAE for the table.
- Calculate all three metrics after adding a fourth error of zero.
- Replace the +6 m/s error with −6 m/s. Find the new bias and RMSE.
- A student reports 14.67 m/s as RMSE for the original sample. Locate the missing step.
- Can a system have zero bias and nonzero MAE? Give an example.
Worked answers
Answer 1
(−2+2+6)/3 = +2.00 m/s.
Answer 2
(2+2+6)/3 ≈ 3.33 m/s.
Answer 3
Bias is 6/4 = 1.50 m/s. MAE is 10/4 = 2.50 m/s. RMSE is √(44/4) ≈ 3.32 m/s.
Answer 4
Bias is −2.00 m/s. RMSE remains about 3.83 m/s because the squared errors stay the same.
Answer 5
44/3 ≈ 14.67 m²/s² is mean squared error. Taking the square root restores m/s and gives about 3.83.
Answer 6
Yes. Errors +2 and −2 m/s average to zero and have MAE of 2 m/s.
- (−2+2+6)/3 = +2.00 m/s.
- (2+2+6)/3 ≈ 3.33 m/s.
- Bias is 6/4 = 1.50 m/s. MAE is 10/4 = 2.50 m/s. RMSE is √(44/4) ≈ 3.32 m/s.
- Bias is −2.00 m/s. RMSE remains about 3.83 m/s because the squared errors stay the same.
- 44/3 ≈ 14.67 m²/s² is mean squared error. Taking the square root restores m/s and gives about 3.83.
- Yes. Errors +2 and −2 m/s average to zero and have MAE of 2 m/s.