From one of the world's most highly regarded social scientists, a transformative book on the habits of mind that lead to the best predictions.
Everyone would benefit from seeing further into the future, whether buying stocks, crafting policy, launching a new product, or simply planning the week's meals. Unfortunately people tend to be terrible forecasters. As Wharton professor Philip Tetlock showed in a landmark 2005 study, even experts' predictions are only slightly better than chance. However, an important and underreported conclusion of that study was that some experts do have real foresight, and Tetlock has spent the past decade trying to figure out why. What makes some people so good? And can this talent be taught?
In Superforecasting, Tetlock and coauthor Dan Gardner offer a masterwork on prediction, drawing on decades of research and the results of a massive, government-funded forecasting tournament. The Good Judgment Project involves tens of thousands of ordinary people - including a Brooklyn filmmaker, a retired pipe installer, and a former ballroom dancer - who set out to forecast global events. Some of the volunteers have turned out to be astonishingly good. They've beaten other benchmarks, competitors, and prediction markets. They've even beaten the collective judgment of intelligence analysts with access to classified information. They are "superforecasters".
In this groundbreaking and accessible book, Tetlock and Gardner show us how we can learn from this elite group. Superforecasting offers the first demonstrably effective way to improve our ability to predict the future - whether in business, finance, politics, international affairs, or daily life - and is destined to become a modern classic.
©2015 Philip Tetlock Consulting, Inc., and Connaught Street, Inc. (P)2015 Audible, Inc.
I have a lot of respect for this author and all of the hard work that he put into this book. However I cannot recommend it. I was overwhelmed with how much exposition was in this book. It included example after example after example and contained fewer "takeaways" than what I was hoping for.
excellent work. less than compelling read. just not for me.
I am an avid listener. I listen between 75-100 hours per month on my iPhone: 60% fiction to 40% non-fiction.
Imagine that you spend a dozen years working on putting together the best chorus group. It's labor intensive, you have auditions, experiment with music, and the exact mix of singers to make it great. You succeed, beating the standard chorus groups. Now that you have that trophy, you want to tell the world about it and so you do -- you write a book. Enter Superforecasting by Tetlock et. al.
Superforecasting is an account of a government funded research approach for forecasting short term world events. The author, and his colleges, successfully created a process that aggregates amateurs individuals into teams that have an exceptional accuracy at predicting world events in the next 18 months. Individuals with exceptional accuracy are assembled into super teams and their performance further improve beating paid analysts.
Tetlock readily admits that no forecasts of world events three years out have any better chance of happening better than a chimpanzee with a dart -- he even authored a study on the subject. He does an excellent job describing the process and the results. Also, to his credit, he details criticism of his process by others.
As a research overview, I give it high marks. It will appeal to those who like to understand how forecasting geopolitical forecasting study was approached by one specific, successful team -- a team that won the competition. Also, Tetlock is clear on how this was accomplished. This book is not about the general topic of forecasting. The book rated a 3 because it is stuck. It did not go full-metal-jacket statistical, nor did it show the impact of the approach. For me, it's a meh.
I love listening to books when cycling, paddleboarding, etc but I press pause when I need to concentrate. Its safer & I don't lose the plot!
I recently enrolled in a sports prediction ring with some friends and I chose this book because I wanted to see if it might give me some insights into the art/science of prediction in general. Clearly the focus of this book is not sport at all, but I thought there must be some generalizable, transferable aspects – and there are. But on the whole I’d say the book mainly matched my existing perceptions of how to predict the future, although I did pick up a few nice nuggets along the way and there was some value in the book’s confirmation of some things I felt already knew.
The author states that there is no such thing as fate and that everything is the result of happenstance and probability. For example, I know that my being born was the random product of the circumstances of my parents’ meeting, the fact that none of their parents were killed in World War 2, the arbitrary time and place where I was conceived and the incredible odds against me winning a sperm race. I've never believed that life is predetermined by fate or destiny. So this was not news to me at all.
So how do you make good predictions? A few things help: It helps to be numerate, to diligently study the subject matter in question, to update your predictions as circumstances change, to keep an open mind.
There were a few things I hadn’t realised, such as the fact that lay people predict the future just as well, if not better, than experts - as long as they do the necessary research – and also, that groups fare better than individuals. There is a kind of ‘emergent property’ of groups whereby the totality is greater than the sum of the parts, as long as the group members interact cooperatively.
Overall I’d say that this book is worth the read, but I predict with 73% certainty that I’ll have forgotten it in 6 months’ time.
In a world increasingly dominated by sensationalized headlines, this book could not be a more refreshing or timely read. We are spiraling into idiocracy, and Tetlock/Gardner are doing their best to encourage people to keep score and learn. This book is filled with wisdom, not just about forecasting or process, but about human tendencies. Readers will feel encouraged to become more intellectually honest, to challenge the loudest pundits making vague claims, and to strive for facts that support or refute opinions instead of vice versa.
I had to listen to this book 3 times to build a good review. The title "Superforcasting, The Art and Science of Prediction" gives the impression the reader will learn how to be a predictive genius-or at least a learned novice. Well, not so much. The authors describe a cadre of people who are numerate, curious, and have no hard biases. Pretty much describes about 2% of the population. At least in the US, probably lower in the rest of the world. Strongly held beliefs, the inability to understand logarithms and statistics and how to use them negates the unlearned. Could a person learn these things, sure. In a perfect world we would all have time to delve into these heady practices. But, cognitive proclivities (yes the word fits, look it up) and the 'get up in the morning go to work' world outside academia, the world of retired computer programmers, and the news junkies makes it unlikely your average Jane and John can master these skills.
On the positive side (see headline) as a book to build skills as a critical thinker this one should be in the library. That is, in essence, what the art of prediction is about. Looking at a situation and thinking hard about it to divine a possible outcome. As a tutorial to develop those critical thinking skill this book accomplishes that. Beware though, to much critical thinking can lead to inertia. Gotta run with a decision sooner or later. To enhance those critical thinking skills, read someting by Nassem Talib after, or before, you read 'Superforcasting'
No answers. The book is all about the process that the writer went through and very very little as to incites into forecasting. An academic in love with academia and very little practical application.
I'm heavily guilty from confirmation bias while writing this review. The author has clearly read a lot of books that I have read or have listed for reading. However, I think this book is great in both stating a rational way of thinking and proposing it as a means to view the world and predict our future in it.
Important nuggets of wisdom are buried in an avalanche of bloated a anecdotes, personal gloating and thinly veiled, politically biased preaching.
For those of you who just want the essence, let me summarize the only parts of the book that are actually valuable
Continuously improve, see what works, what doesn't, and adapt(duh).
Use clearly defined measurements and numbers when assessing your precision.
If you are able to spend more time in forecasting, you will do better than those who don't have as much time (again, duh)
Read the news a lot to keep up with current events
Read up on and research whatever you are forecasting
Seek out opposing views, especially those that contradict your own view
Start from a reasonable base line (called an outside view) and wok from there
And that's pretty much all that was to be gained from the book. The other lessons are explained far better by superior authors such as Kahnemann.
The rest is mostly noise and can be safely skipped over.
This book takes the historical problem of poor forecasting of future events and analyzes how we all might do better by looking into the practices of a few individuals who get it right much more often than the loud, public media figures do. Great read.
This is a well written book about how to improve your predictive skills. It isn't just about predicting a major political event, like what is the likelihood of a certain dictator being overthrown. Then reading a lot of news on the topic to estimate the probability of that happening (although collecting a lot of information does help in understanding the factors affecting the possible outcome). In the book, there are many examples of people making predictions about success/failure of industries, technologies, and products... and being completely off target because of their bias or lack of relevant facts. The book walks you through the process of predicting an outcome, researching and understanding the event better, applying a baseline probability, adjusting the probability based on the particular situation and any new information, and reviewing past predictions to determine whether it was accurate or not. This skill can be applied for anything -- what is probability that the job candidate will be a good employee, what is probability of a profit in one year for this new product, or what is probability that the customer will default on the loan.
"book presents a new way of thinking"
I enjoyed the audiobook. very easy to grasp the key points on how to reach good judgement. how our approach to forecasting and analysis needs to change to include more aggregation and more variables.
gives insight on the good judgement Project and the outcomes.
few key messages for professionals:
1) consult across sectors
3) use a base score
4) incrementally improve forecasts and prediction and regularly review works
5) test the validity of data
6) don't fall for pundits :)
Firstly, most comfortable with the narration.
I thoroughly enjoyed this book. Hats off as the story weaved its way through so many facets of forecasting and what influences and differentiates forecasters from 'super forecasters'.
Fascinating, thought inspiring, I found myself gleefully immersed and entertained in and of a World I had given little prior thought to.
"Thought provoking throughout!"
A thoroughly enjoyable listen. The authors very clearly lay out what it means to be a critical thinker. The book focuses on how to use this for prediction but obviously using these life edicts you stand to make much better decisions in pretty much everything. It's certainly not an easy process but definitely worth the effort.
"one of the best books I listened to"
good use of history and examples, very straightforward language and easy to understand, concept conveyed
"Extremely thoughtful, thorough explanation"
The world I live in is one dominated by spitballing in preference to deliberating, boldness serving as the unworthy proxy of worthiness, and self-reflection at a level where personal change only happens when life smack one with a metaphorical brick. This book outlines all the things that are the opposite of that. I will be re-reading several chapters. At least, 7, 9, 10, and 12.
"Listening again to become a superforcaster"
I really like the concept. It is doable. I really enjoyed the book, although the author could've got to the point a lot quicker. You wouldn't regret listening to this brilliant audio book.
"Should be mandatory reading in every school"
Narrator was excellent, perfect reading.
This book is an excellent analysis of the dangers of pride in our forecasts and the benefits of humility coupled with a desire to perform better.
Invaluable insight into the world of Superforcasting. Very relevant post EU referendum and the British exit that very few people predicted.
"Not much substance."
Plenty of anecdotes but little in the way of superforecasting guidance. This book didn't achieve the goal in my opinion.
"very interesting ideas and thought provoking book"
The book is full of wonderful ideas and has some quite frankly mind blowing moments. but remains very straight forward and consice throughout.
lots of great quotable passages.
Report Inappropriate Content