The Signal and the Noise is a book on statistics. But it’s also a wonderful read to understand the human mind’s limitations when it comes to numbers, probabilities and forecasting.
Contents
Bullet Summary
- Forecasts are difficult in many human endeavors
- More data can only add noise: in complex issue better focusing on a few reliable signals
- Watch out for those who seem to confident: they’re more likely to be wrong
Full Summary
Every day we make predictions.
But some predictions carry more weight and consequences than others, and being able to make good predictions there would result in a potentially better world.
Economic Predictions
There are so many economic indicators and so much data and historical data that we might would guess economic predictions are accurate.
But they’re not.
To begin with, the GDP predictions we often hear are actual part of an interval. For example, a GDP forecast growth of 1% means that economics are 90% sure that the growth will fall between 0.5% and 1.5%.
But even interval predictions are rather poor.
Indeed from then 1968 economics ave been wrong with their interval around half the time.
So not only they’re bad at predicting economic growth, but they are also overly optimistic in their own predicting abilities.
And economics are even worst at predicting depressions.
Out of 60 depression worldwide, and a single year ahead of time, economists were only able to predict two of them.
Why Are Economists Such Poor Forecasters?
Because the economy is influenced by a staggering amount of factors, and they are all interwoven and interdependent.
Since many of these factors are interdependent it’s even difficult to define causality.
Nate Silver then turns to analyze the failure of spotting the 2008 financial crisis.
Mo Data Mo Problems
Having more data might not be the solution to better forecasting.
Indeed just adding more data might give rise to false positives and show correlations where there is none. For example for 30 years the Superbowl seemed to have a strong correlation with the stock market.
It reached a point where the chances of that relationship being mere chance were 1 in 4.700.000. Yet, it was simply chance.
Indeed having more data can often only increase the quantity of noise, which makes it even harder to spot the signal.
Weather Forecast Example
Long term weather forecast is such an example.
Models with hundreds of data points failed spectacularly and models with humans who tried to pinpoint more meaningful signals and used less data fared better.
Instead simpler models who only take into account CO2 in the atmosphere and CO2 projections did much better. One single signal which is highly correlated with global warming.
Bayes’ Theorem for Better Forecasts
The author introduces the Bayes Theorem to help us overcome our natural biases and embrace a more data-drive approach.
One of our psychological biases is that of over-weighing new information and discounting the old information we had.
The Bayes Theorem instead considers all information and puts each one of them in perspective as we keep adding more data points.
Approach to Better Forecasts
Political scientist Philip Tetlock began to notice which type of forecasters turned out more accurate predictions. He realized that those who were right most often had a different approach: they would combine many pieces of data together.
Instead, the ones who were not nearly as successful would rely on one big idea or fact.
Hedgehogs and Foxes
Hedgehogs are people who rely on one big idea or claim. They are brasher and seem more confident. Sometimes they claim they know the truth and can look very charismatic.
Foxes instead look at all the information available and tend to look past ideologies. They change opinion if the data changes.
Hedgehogs are much more “media friendly” as they garner much more attention with their confidence and brashness. However, they are also much more often wrong. Indeed their chances of getting it right is just a little greater than pure chance.
Sigmund Freud is a good example of an hedgehog.
Beating the Stock Market Is Hard
The author says that beating the stock market is difficult because it tends to be relatively efficient.
Most of the trades are done by large institution that do indeed analyze stocks fundamentals and much discrepancies between prices and fundamentals tend to be corrected.
There is however one group in the US that is rather good at beating the stock market. And those are the members of congress, who tend to fare 5-10% better than the market returns.
Congressmen also have insider information through lobbyists and, of course, direct effect on the market by act of legislation.
A coincidence?
How to Predict a Bubble
Nate Silver still proposes a couple of ways to predict if the stock market is nearing bubble territory though:
- Sharp increase in stock prices (if S&P 500 increased at double its long-term average over five years, 62% of te times it ended in a severe crash)
- P/E ration (if it’s much higher than the long term average of 15 you have a good indicator a bubble is forming)
However, it’s not irrational for many money managers to keep buying as a bubble is forming. When the market goes up and they make money, they reap big rewards.
When the market collapses, they either only lose their job or nothing. And since everyone’s buying, it’s unlikely they’ll be single out as the guilty ones.
Real Life Applications
Watch Out For Patterns
Someone said we humans are pattern-making machines. However, those patterns are often made up. So watch out not reading too much into patterns.
Watch Our for Charismatic & Confident Forecasters
People who seem super confident of their own prediction are often also more likely to be wrong. I repeat: overconfident people are more often wrong.
CONS
Longish
The Signal and the Noise could have been briefer.
Repetitive
Lots of concepts repeat and could have been combined.
PROS
Awesome Insight
Lots of deep statistical insight here.
Review
I liked and praised Nassim Taleb’s work quite a bit in the past –Fooled by Randomness-.
But The Signal and the Noise might the best book on statistics and forecasting available for the general public.
A book at the convergence of numbers and psychology, this is recommended to anyone who wants to better understand sciences and mind.
Leave a Reply (& Warn Me If You Catch Typos :)