30 нояб. 2012 г.

The Signal and the Noise: Why Most Predictions Fail but Some Don't. Nate Silver

Drawing on his own groundbreaking work, Silver examines the world of prediction, investigating how we can distinguish a true signal from a universe of noisy data. Most predictions fail, often at great cost to so­ciety, because most of us have a poor understanding of probability and uncertainty. Both experts and laypeople mistake more confident predictions for more accurate ones. But overconfidence is often the reason for failure. If our appreciation of uncertainty improves, our pre­dictions can get better too. This is the “prediction paradox”: The more humility we have about our ability to make predictions, the more suc­cessful we can be in planning for the future.

In keeping with his own aim to seek truth from data, Silver visits the most successful forecasters in a range of areas, from hurricanes to baseball, from the poker table to the stock market, from Capitol Hill to the NBA. He explains and evaluates how these forecasters think and what bonds they share. What lies behind their success? Are they good—or just lucky? What patterns have they unraveled? And are their forecasts really right? He explores unanticipated commonalities and exposes unexpected juxtapositions. And sometimes, it is not so much how good a prediction is in an absolute sense that matters but how good it is relative to the competition. In other cases, prediction is still a very rudimentary—and dangerous—science.

“Mr. Silver, just 34, is an expert at finding signal in noise… Lively prose — from energetic to outraged… illustrates his dos and don’ts through a series of interesting essays that examine how predictions are made in fields including chess, baseball, weather forecasting, earthquake analysis and politics… [the] chapter on global warming is one of the most objective and honest analyses I’ve seen… even the noise makes for a good read.” — New York Times

"Mr. Silver's breezy style makes even the most difficult statistical ma­terial accessible. What is more, his arguments and examples are painstakingly researched..." —Wall Street Journal

“Laser sharp. Surprisingly, statistics in Silver’s hands is not without some fun.” — Smithsonian Magazine