feedback-loops-and-calibration

Weather forecasters are almost perfectly calibrated — when they say 30% chance of rain, it rains 30% of the time. That's because they get daily feedback. In domains where feedback is rare or delayed, people are terribly inaccurate, because there's no mechanism forcing them to update.