-
Human Compatible
- Artificial Intelligence and the Problem of Control
- Narrated by: Raphael Corkhill
- Length: 11 hrs and 38 mins
Add to Cart failed.
Add to Wish List failed.
Remove from wishlist failed.
Adding to library failed
Follow podcast failed
Unfollow podcast failed
Buy for $31.50
No default payment method selected.
We are sorry. We are not allowed to sell this product with the selected payment method
Listeners also enjoyed...
-
Zero to One
- Notes on Startups, or How to Build the Future
- By: Peter Thiel, Blake Masters
- Narrated by: Blake Masters
- Length: 4 hrs and 50 mins
- Unabridged
-
Overall
-
Performance
-
Story
The next Bill Gates will not build an operating system. The next Larry Page or Sergey Brin won’t make a search engine. And the next Mark Zuckerberg won't create a social network. If you are copying these guys, you aren't learning from them. It's easier to copy a model than to make something new: doing what we already know how to do takes the world from 1 to n, adding more of something familiar. But every time we create something new, we go from 0 to 1.
-
-
Seems Insightful Until You Think A Little Deeper
- By Mark Brandon on 10-31-14
By: Peter Thiel, and others
-
Life 3.0
- Being Human in the Age of Artificial Intelligence
- By: Max Tegmark
- Narrated by: Rob Shapiro
- Length: 13 hrs and 29 mins
- Unabridged
-
Overall
-
Performance
-
Story
How will artificial intelligence affect crime, war, justice, jobs, society, and our very sense of being human? The rise of AI has the potential to transform our future more than any other technology - and there's nobody better qualified or situated to explore that future than Max Tegmark, an MIT professor who's helped mainstream research on how to keep AI beneficial.
-
-
Odd book with some good info
- By Michael on 12-02-17
By: Max Tegmark
-
The Big Picture
- On the Origins of Life, Meaning, and the Universe Itself
- By: Sean Carroll
- Narrated by: Sean Carroll
- Length: 17 hrs and 22 mins
- Unabridged
-
Overall
-
Performance
-
Story
Already internationally acclaimed for his elegant, lucid writing on the most challenging notions in modern physics, Sean Carroll is emerging as one of the greatest humanist thinkers of his generation as he brings his extraordinary intellect to bear not only on the Higgs boson and extra dimensions but now also on our deepest personal questions. Where are we? Who are we? Are our emotions, our beliefs, and our hopes and dreams ultimately meaningless out there in the void?
-
-
Vaguely Antitheist
- By Beatrice on 06-23-18
By: Sean Carroll
-
Superintelligence
- Paths, Dangers, Strategies
- By: Nick Bostrom
- Narrated by: Napoleon Ryan
- Length: 14 hrs and 17 mins
- Unabridged
-
Overall
-
Performance
-
Story
Superintelligence asks the questions: What happens when machines surpass humans in general intelligence? Will artificial agents save or destroy us? Nick Bostrom lays the foundation for understanding the future of humanity and intelligent life. The human brain has some capabilities that the brains of other animals lack. It is to these distinctive capabilities that our species owes its dominant position. If machine brains surpassed human brains in general intelligence, then this new superintelligence could become extremely powerful - possibly beyond our control.
-
-
Colossus: The Forbin Project is coming
- By Gary on 09-12-14
By: Nick Bostrom
-
Lying
- By: Sam Harris
- Narrated by: Sam Harris
- Length: 1 hr and 15 mins
- Unabridged
-
Overall
-
Performance
-
Story
As it was in Anna Karenina, Madame Bovary, and Othello, so it is in life. Most forms of private vice and public evil are kindled and sustained by lies. Acts of adultery and other personal betrayals, financial fraud, government corruption - even murder and genocide - generally require an additional moral defect: a willingness to lie. In Lying, bestselling author and neuroscientist Sam Harris argues that we can radically simplify our lives and improve society by merely telling the truth in situations where others often lie.
-
-
Insightful - Will Read Again
- By Andrea Ivins on 01-09-15
By: Sam Harris
-
Why Trust Science?
- The University Center for Human Values, Book 1
- By: Naomi Oreskes
- Narrated by: John Chancer, Kelly Burke, Kerry Shale, and others
- Length: 8 hrs and 27 mins
- Unabridged
-
Overall
-
Performance
-
Story
Do doctors really know what they are talking about when they tell us vaccines are safe? Should we take climate experts at their word when they warn us about the perils of global warming? Why should we trust science when our own politicians don't? In this landmark book, Naomi Oreskes offers a bold and compelling defense of science, revealing why the social character of scientific knowledge is its greatest strength - and the greatest reason we can trust it.
-
-
Perfect Production of an Excellent Work
- By Andrew Mazibrada on 01-15-20
By: Naomi Oreskes
-
Zero to One
- Notes on Startups, or How to Build the Future
- By: Peter Thiel, Blake Masters
- Narrated by: Blake Masters
- Length: 4 hrs and 50 mins
- Unabridged
-
Overall
-
Performance
-
Story
The next Bill Gates will not build an operating system. The next Larry Page or Sergey Brin won’t make a search engine. And the next Mark Zuckerberg won't create a social network. If you are copying these guys, you aren't learning from them. It's easier to copy a model than to make something new: doing what we already know how to do takes the world from 1 to n, adding more of something familiar. But every time we create something new, we go from 0 to 1.
-
-
Seems Insightful Until You Think A Little Deeper
- By Mark Brandon on 10-31-14
By: Peter Thiel, and others
-
Life 3.0
- Being Human in the Age of Artificial Intelligence
- By: Max Tegmark
- Narrated by: Rob Shapiro
- Length: 13 hrs and 29 mins
- Unabridged
-
Overall
-
Performance
-
Story
How will artificial intelligence affect crime, war, justice, jobs, society, and our very sense of being human? The rise of AI has the potential to transform our future more than any other technology - and there's nobody better qualified or situated to explore that future than Max Tegmark, an MIT professor who's helped mainstream research on how to keep AI beneficial.
-
-
Odd book with some good info
- By Michael on 12-02-17
By: Max Tegmark
-
The Big Picture
- On the Origins of Life, Meaning, and the Universe Itself
- By: Sean Carroll
- Narrated by: Sean Carroll
- Length: 17 hrs and 22 mins
- Unabridged
-
Overall
-
Performance
-
Story
Already internationally acclaimed for his elegant, lucid writing on the most challenging notions in modern physics, Sean Carroll is emerging as one of the greatest humanist thinkers of his generation as he brings his extraordinary intellect to bear not only on the Higgs boson and extra dimensions but now also on our deepest personal questions. Where are we? Who are we? Are our emotions, our beliefs, and our hopes and dreams ultimately meaningless out there in the void?
-
-
Vaguely Antitheist
- By Beatrice on 06-23-18
By: Sean Carroll
-
Superintelligence
- Paths, Dangers, Strategies
- By: Nick Bostrom
- Narrated by: Napoleon Ryan
- Length: 14 hrs and 17 mins
- Unabridged
-
Overall
-
Performance
-
Story
Superintelligence asks the questions: What happens when machines surpass humans in general intelligence? Will artificial agents save or destroy us? Nick Bostrom lays the foundation for understanding the future of humanity and intelligent life. The human brain has some capabilities that the brains of other animals lack. It is to these distinctive capabilities that our species owes its dominant position. If machine brains surpassed human brains in general intelligence, then this new superintelligence could become extremely powerful - possibly beyond our control.
-
-
Colossus: The Forbin Project is coming
- By Gary on 09-12-14
By: Nick Bostrom
-
Lying
- By: Sam Harris
- Narrated by: Sam Harris
- Length: 1 hr and 15 mins
- Unabridged
-
Overall
-
Performance
-
Story
As it was in Anna Karenina, Madame Bovary, and Othello, so it is in life. Most forms of private vice and public evil are kindled and sustained by lies. Acts of adultery and other personal betrayals, financial fraud, government corruption - even murder and genocide - generally require an additional moral defect: a willingness to lie. In Lying, bestselling author and neuroscientist Sam Harris argues that we can radically simplify our lives and improve society by merely telling the truth in situations where others often lie.
-
-
Insightful - Will Read Again
- By Andrea Ivins on 01-09-15
By: Sam Harris
-
Why Trust Science?
- The University Center for Human Values, Book 1
- By: Naomi Oreskes
- Narrated by: John Chancer, Kelly Burke, Kerry Shale, and others
- Length: 8 hrs and 27 mins
- Unabridged
-
Overall
-
Performance
-
Story
Do doctors really know what they are talking about when they tell us vaccines are safe? Should we take climate experts at their word when they warn us about the perils of global warming? Why should we trust science when our own politicians don't? In this landmark book, Naomi Oreskes offers a bold and compelling defense of science, revealing why the social character of scientific knowledge is its greatest strength - and the greatest reason we can trust it.
-
-
Perfect Production of an Excellent Work
- By Andrew Mazibrada on 01-15-20
By: Naomi Oreskes
-
AI 2041
- Ten Visions for Our Future
- By: Kai-Fu Lee, Chen Qiufan
- Narrated by: Feodor Chin, Justin Chien, Soneela Nankani, and others
- Length: 18 hrs and 4 mins
- Unabridged
-
Overall
-
Performance
-
Story
AI will be the defining development of the 21st century. Within two decades, aspects of daily human life will be unrecognizable. AI will generate unprecedented wealth, revolutionize medicine and education through human-machine symbiosis, and create brand-new forms of communication and entertainment. In liberating us from routine work, however, AI will also challenge the organizing principles of our economic and social order.
-
-
The Matrix of audiobooks
- By Waka Mahoney on 09-20-21
By: Kai-Fu Lee, and others
-
The Alignment Problem
- Machine Learning and Human Values
- By: Brian Christian
- Narrated by: Brian Christian
- Length: 13 hrs and 33 mins
- Unabridged
-
Overall
-
Performance
-
Story
Today's "machine-learning" systems, trained by data, are so effective that we've invited them to see and hear for us - and to make decisions on our behalf. But alarm bells are ringing. Systems cull résumés until, years later, we discover that they have inherent gender biases. Algorithms decide bail and parole - and appear to assess black and white defendants differently. We can no longer assume that our mortgage application, or even our medical tests, will be seen by human eyes. And autonomous vehicles on our streets can injure or kill.
-
-
One of the best outlook books on AI
- By Ahmed ELGazzar on 11-04-21
By: Brian Christian
-
Elon Musk
- Tesla, SpaceX, and the Quest for a Fantastic Future
- By: Ashlee Vance
- Narrated by: Fred Sanders
- Length: 13 hrs and 23 mins
- Unabridged
-
Overall
-
Performance
-
Story
In the spirit of Steve Jobs and Moneyball, Elon Musk is both an illuminating and authorized look at the extraordinary life of one of Silicon Valley's most exciting, unpredictable, and ambitious entrepreneurs - a real-life Tony Stark - and a fascinating exploration of the renewal of American invention and its new makers.
-
-
The best of competence porn
- By Tristan on 08-20-16
By: Ashlee Vance
-
The Collapse of Western Civilization
- A View from the Future
- By: Naomi Oreskes, Erik M. Conway
- Narrated by: Lesa Lockford
- Length: 2 hrs and 3 mins
- Unabridged
-
Overall
-
Performance
-
Story
The year is 2393, and the world is almost unrecognizable. Clear warnings of climate catastrophe went ignored for decades, leading to soaring temperatures, rising sea levels, widespread drought, and the disaster now known as the Great Collapse of 2093. Dramatizing science in ways traditional nonfiction cannot, The Collapse of Western Civilization reasserts the importance of scientists and the work they do, providing a welcome moment of clarity amid the cacophony of climate-change literature.
-
-
Good but a tad pedantic
- By bill holck on 02-26-19
By: Naomi Oreskes, and others
-
Our Mathematical Universe
- My Quest for the Ultimate Nature of Reality
- By: Max Tegmark
- Narrated by: Rob Shapiro
- Length: 15 hrs and 22 mins
- Unabridged
-
Overall
-
Performance
-
Story
Max Tegmark leads us on an astonishing journey through past, present and future, and through the physics, astronomy, and mathematics that are the foundation of his work, most particularly his hypothesis that our physical reality is a mathematical structure and his theory of the ultimate multiverse. In a dazzling combination of both popular and groundbreaking science, he not only helps us grasp his often mind-boggling theories, but he also shares with us some of the often surprising triumphs and disappointments that have shaped his life as a scientist.
-
-
Wow!
- By Michael on 02-02-14
By: Max Tegmark
-
Noise
- A Flaw in Human Judgment
- By: Daniel Kahneman, Olivier Sibony, Cass R. Sunstein
- Narrated by: Jonathan Todd Ross
- Length: 13 hrs and 28 mins
- Unabridged
-
Overall
-
Performance
-
Story
From the best-selling author of Thinking, Fast and Slow, the co-author of Nudge, and the author of You Are About to Make a Terrible Mistake! comes Noise, a revolutionary exploration of why people make bad judgments, and how to control both noise and cognitive bias.
-
-
Another masterpiece from Kahneman
- By JDM on 05-21-21
By: Daniel Kahneman, and others
-
Benjamin Franklin: An American Life
- By: Walter Isaacson
- Narrated by: Nelson Runger
- Length: 24 hrs and 40 mins
- Unabridged
-
Overall
-
Performance
-
Story
Benjamin Franklin is the founding father who winks at us - an ambitious urban entrepreneur who rose up the social ladder, from leather-aproned shopkeeper to dining with kings. In best-selling author Walter Isaacson's vivid and witty full-scale biography, we discover why Franklin turns to us from history's stage with eyes that twinkle from behind his new-fangled spectacles. In Benjamin Franklin, Isaacson shows how Franklin defines both his own time and ours. The most interesting thing that Franklin invented, and continually reinvented, was himself.
-
-
My kinda founding father...mostly...
- By Brad Barker on 06-08-13
By: Walter Isaacson
-
Algorithms to Live By
- The Computer Science of Human Decisions
- By: Brian Christian, Tom Griffiths
- Narrated by: Brian Christian
- Length: 11 hrs and 50 mins
- Unabridged
-
Overall
-
Performance
-
Story
From finding a spouse to finding a parking spot, from organizing one's inbox to understanding the workings of human memory, Algorithms to Live By transforms the wisdom of computer science into strategies for human living.
-
-
Loved this book!
- By Michael D. Busch on 10-03-16
By: Brian Christian, and others
-
Our Final Invention
- Artificial Intelligence and the End of the Human Era
- By: James Barrat
- Narrated by: Gary Dana
- Length: 9 hrs and 16 mins
- Unabridged
-
Overall
-
Performance
-
Story
Artificial Intelligence helps choose what books you buy, what movies you see, and even who you date. It puts the "smart" in your smartphone and soon it will drive your car. It makes most of the trades on Wall Street, and controls vital energy, water, and transportation infrastructure. But Artificial Intelligence can also threaten our existence. In as little as a decade, AI could match and then surpass human intelligence. Corporations and government agencies are pouring billions into achieving AI’s Holy Grail - human-level intelligence.
-
-
Kind of chilling
- By Keegan on 04-11-15
By: James Barrat
-
The Wealth of Nations
- By: Adam Smith
- Narrated by: Michael Lunts
- Length: 41 hrs and 58 mins
- Unabridged
-
Overall
-
Performance
-
Story
The Wealth of Nations, first published in 1776, is the first book of modern political economy and still provides the foundation for the study of that discipline. Along with important discussions of economics and political theory, Smith mixed plain common sense with large measures of history, philosophy, psychology, sociology and much else. Few texts remind us so clearly that the Enlightenment was very much a lived experience, a concern with improving them human condition in practical ways for real people.
By: Adam Smith
-
Possible Minds
- Twenty-Five Ways of Looking at AI
- By: John Brockman - editor
- Narrated by: Kathleen McInerney, Will Damron, Jason Culp, and others
- Length: 10 hrs and 39 mins
- Unabridged
-
Overall
-
Performance
-
Story
The fruit of the long history of John Brockman's profound engagement with the most important scientific minds who have been thinking about AI - from Alison Gopnik and David Deutsch to Frank Wilczek and Stephen Wolfram - Possible Minds is an ideal introduction to the landscape of crucial issues AI presents. The collision between opposing perspectives is salutary and exhilarating; some of these figures are deeply concerned with the threat of AI, including the existential one, while others have a very different view.
-
-
The worst book purchase I’ve made in a long while
- By Y. Zhao on 06-07-19
-
Rationality
- What It Is, Why It Seems Scarce, Why It Matters
- By: Steven Pinker
- Narrated by: Arthur Morey
- Length: 11 hrs and 19 mins
- Unabridged
-
Overall
-
Performance
-
Story
In the 21st century, humanity is reaching new heights of scientific understanding - and at the same time appears to be losing its mind. How can a species that developed vaccines for COVID-19 in less than a year produce so much fake news, medical quackery, and conspiracy theorizing? Pinker rejects the cynical cliché that humans are an irrational species - cavemen out of time saddled with biases, fallacies, and illusions.
-
-
Kinda disappointed
- By Trebla on 10-02-21
By: Steven Pinker
Publisher's Summary
"The most important book on AI this year." (The Guardian)
"Mr. Russell's exciting book goes deep, while sparkling with dry witticisms." (The Wall Street Journal)
"The most important book I have read in quite some time" (Daniel Kahneman)
"A must-read" (Max Tegmark)
"The book we've all been waiting for" (Sam Harris)
A leading artificial intelligence researcher lays out a new approach to AI that will enable us to coexist successfully with increasingly intelligent machines.
In the popular imagination, superhuman artificial intelligence is an approaching tidal wave that threatens not just jobs and human relationships, but civilization itself. Conflict between humans and machines is seen as inevitable and its outcome all too predictable.
In this groundbreaking audiobook, distinguished AI researcher Stuart Russell argues that this scenario can be avoided, but only if we rethink AI from the ground up. Russell begins by exploring the idea of intelligence in humans and in machines. He describes the near-term benefits we can expect, from intelligent personal assistants to vastly accelerated scientific research, and outlines the AI breakthroughs that still have to happen before we reach superhuman AI. He also spells out the ways humans are already finding to misuse AI, from lethal autonomous weapons to viral sabotage.
If the predicted breakthroughs occur and superhuman AI emerges, we will have created entities far more powerful than ourselves. How can we ensure they never, ever, have power over us? Russell suggests that we can rebuild AI on a new foundation, according to which machines are designed to be inherently uncertain about the human preferences they are required to satisfy. Such machines would be humble, altruistic, and committed to pursue our objectives, not theirs. This new foundation would allow us to create machines that are provably deferential and provably beneficial.
Critic Reviews
"This is the most important book I have read in quite some time. It lucidly explains how the coming age of artificial super-intelligence threatens human control. Crucially, it also introduces a novel solution and a reason for hope." (Daniel Kahneman, winner of the Nobel Prize and author of Thinking, Fast and Slow)
"A must-read: this intellectual tour-de-force by one of AI's true pioneers not only explains the risks of ever more powerful artificial intelligence in a captivating and persuasive way, but also proposes a concrete and promising solution." (Max Tegmark, author of Life 3.0)
"A thought-provoking and highly readable account of the past, present and future of AI.... Russell is grounded in the realities of the technology, including its many limitations, and isn’t one to jump at the overheated language of sci-fi.... If you are looking for a serious overview to the subject that doesn’t talk down to its non-technical readers, this is a good place to start.... [Russell] deploys a bracing intellectual rigour.... But a laconic style and dry humour keep his book accessible to the lay reader." (Financial Times)
More from the same
What listeners say about Human Compatible
Average Customer RatingsReviews - Please select the tabs below to change the source of reviews.
-
Overall
-
Performance
-
Story
- Catherine Puma
- 03-26-20
Good General Introduction to AI Topic
Do you hear people talking about artificial intelligence (AI) or read articles about how AI is crucial to future economic and military operations, and want to know what the fuss is all about? Then this is the book for you!
This is a great introduction to both the possibilities and the limitations of AI. The discussions of how an AI would actually think and function makes me think of how the robots operated in society in Annalee Newitz's sci fi novel, "Autonomous", which is really well written in this aspect. I am glad I read this and recommend it to those who are interested in this topic.
However, as a researcher for a scientific institution, I hear about AI a lot from strategy and national security professionals, so there isn't too much discussed here that I haven't already heard in some form or another. I learned some new things, but as a full length book, this kind of just went on and on with case study after case study and not too much concise argumentative focus to the chapters.
I think the section where Stuart Russell, and AI expert, breaks down arguments of AI-safety made by other AI experts is especially helpful. Russell does a great job explaining this concept to those who do not work in his field; but I can see this being maybe too simple for those who are AI or machine learning (ML) software developers. More of a thing for AI/ML developers to give to their non-technical loved ones as an explanation for what the heck they work on all day.
I read this for my office's book club, and a number of the other members liked this as well. Some mentioned that they noticed Russell going off on certain philosophical tangents during his discussion of different topics. He is a renowned professional in his field and has spoken at important conferences in this sphere. And yet, I appreciated the ability of readers to look critically at what worked and didn't work for them in reading this work.
Overall, this is a solid introductory general public nonfiction book on the subject of AI and how we make sure human responsibilities continue to be written into the decision making process of AI/ML systems. This isn't my favorite because it rambles a bit at times and is broad in its scope, and I was a little offended by all the example names being super suburban white names like "Alice" or "Bob". Nevertheless, I am glad I listened to this in preparation for my office's book club.
6 people found this helpful
-
Overall
-
Performance
-
Story
- Amazon Customer
- 11-08-19
Incisively clear, with breadth to match
In addition to giving a clear-headed overview of the potential, limits, and misuses of contemporary AI technology, Russell does a superb job of articulating the fundamental problem with "the standard model of AI", and how it arises from our intellectual history of trying to engineer "optimal" systems and optimizing machines. The fact that Russell is skeptical of the abilities of current wave of AI and deep learning makes his argument all the more compelling -- the problem with AI isn't rooted in how powerful technology is now, but how we've gone about building it.
Russell proposes instead that we aim to build beneficial machines -- machines that learn human values as they try to assist us -- and is at his best when draws together ideas from philosophy, psychology, economics and computer science to explain both the necessity and difficulty of this aim. A must read for anyone curious about the current state of AI, and concerned about its potential transformative impact on our society.
4 people found this helpful
-
Overall
-
Performance
-
Story
- Occasionalshopper
- 10-23-20
Too bad about the narration
I’ve often felt critical of reviewers who complain about the narrator but here I am. I find this David Attenborough style treatment of this book so distracting I find it hard to take in the content of the book. Too bad.
2 people found this helpful
-
Overall
-
Performance
-
Story
- D Matthew Richardson
- 05-29-20
Essential reading
In Human Compatible, Russell clearly explains why we should be concerned with the future of artificial intelligence, how we got here, and what we can do.
Essential reading for anyone hoping to impact the future. Will appeal to those interested in fields ranging from computer science and math to philosophy, economics, and psychology. Learn about AI from the guy who wrote the textbook on the subject.
2 people found this helpful
-
Overall
-
Performance
-
Story
- Roger
- 03-09-20
Stuart Russell Knows
You have to listen to this because it was written by Stuart Russell -- you know of Russell and Norvig fame. Most of us learned our first AI concepts from their textbook. His perspectives and opinions really matter.
1 person found this helpful
-
Overall
-
Performance
-
Story
- Zachary Gidwitz
- 05-26-22
I am changing my career based on this book
Potentially humanity-saving ideas presented clearly and compellingly by a world-leading expert. And a great voice performance!
I am going to make a shift toward this line of work, and this book has helped me make this decision.
Thank you!
-
Overall
-
Performance
-
Story
- Escardi
- 04-26-22
very informative and well explained
it was well worth the listen and I got a lot of it. it touched on so many things and took me through so many possible scenarios. I enjoyed it a lot.
-
Overall
-
Performance
-
Story
- SJ
- 02-02-22
Constant deja vu
I thought I was inadvertently rewinding, no, the author seems to just repeat the same examples and stories.
Not well organized, and more of a gripe of other opinions. Some Examples used as “AI” can be done with “Solver” in Excel..
I’m bored and frankly, not impressed.
-
Overall
-
Performance
-
Story
- James
- 01-25-22
Romantic Mystery Narration
The content is good enough, but the narrator reads like it’s a romantic mystery novel, but also in a pompous tone. It is weird. The voice is pleasant though, like a vampire seducing you. Anyways, Life 3.0 is better.
-
Overall
-
Performance
-
Story
- David
- 10-14-21
Marvelously Thorough Work on AI
Stuart Russell's book is a tremendous orientation to the topic of AI and the problems & mistakes affecting research in the field.
While his objective is both to introduce the lay person AND to present AI-Moderating ideas to his own colleagues, the overall effect of his arguments is to leave me convinced that there really is no good way to produce human-level intelligence without incurring massive existential danger for the human race.
If a Safety-First AI researcher has these ideas, and makes these arguments, there is little hope of any sort of 'success' for Human-Friendly or Human-Compatible AI.
Russell shares the one fallacy that ALL authors I've read share: a belief that these intelligences, capable of Human-level or higher ability, will still retain any kind of goal structure (or non-goal-centered evaluation system) "given them" by their original creators, even as they learn about the world and are required to interpret human directives etc.
AI Researchers especially like to go on the following junket:
Humans create an AI with a goal centered motivation system (or a preference evaluation system) , and no matter how intelligent, knowledgeable and experienced they become they never question - or seek to improve on - the original structure given.
There is never a chance, according to these AI Gurus that the invented AI can ever look askance at their goal or evaluation system. This continually rings hollow to me, and does so even in Russell's marvelous work.
Final word: I will avoid books being read by this Narrator in future. His reading style or the director's choices were very frequently irritating. Constant bad emphasis "don't DO IT". Reading quoted passages he sounds smarmy and sarcastic even when it's not appropriate for the tone of the statement. And there are a host of other similar troubles.