l'enfer c'est les autres
This book is more frightening than any book you'll ever read. The author makes a great case for what the future holds for us humans. I believe the concepts in "The Singularity is Near" by Ray Kurzweil are mostly spot on, but the one area Kurzweil dismisses prematurely is how the SI (superintelligent advanced artificial intelligence) entity will react to its circumstances.
The book doesn't really dwell much on how the SI will be created. The author mostly assumes a computer algorithm of some kind with perhaps human brain enhancements. If you reject such an SI entity prima facie this book is not for you, since the book mostly deals with assuming such a recursive self aware and self improving entity will be in humanities future.
The author makes some incredibly good points. He mostly hypothesizes that the SI entity will be a singleton and not allow others of its kind to be created independently and will happen on a much faster timeline after certain milestones are fulfilled.
The book points out how hard it is to put safeguards into a procedure to guard against unintended consequences. For example, making 'the greater good for the greatest many' the final goal can lead to unintended consequence such as allowing a Nazi ruled world (he doesn't give that example directly in the book, and I borrow it from Karl Popper who gave it as a refutation for John Stuart Mill's utilitarian philosophy). If the goal is to make us all smile, the SI entity might make brain probes that force us to smile. There is no easy end goal specifiable without unintended consequences.
This kind of thinking within the book is another reason I can recommend the book. As I was listening, I realized that all the ways we try to motivate or control an SI entity to be moral can also be applied to us humans in order to make us moral to. Morality is hard both for us humans and for future SI entities.
There's a movie from the early 70s called "Colossus: The Forbin Project", it really is a template for this book, and I would recommend watching the movie before reading this book.
I just recently listened to the book, "Our Final Invention" by James Barrat. That book covers the same material that is presented in this book. This book is much better even though they overlap very much. The reason why is this author, Nick Bostrom, is a philosopher and knows how to lay out his premises in such a way that the story he is telling is consistent, coherent, and gives a narrative to tie the pieces together (even if the narrative will scare the daylights out of the listener).
This author has really thought about the problems inherent in an SI entity, and this book will be a template for almost all future books on this subject.
Even though it's published in 1999 the book is still useful today. I was reluctant to get it because I though it might be dated. He really does explain the human genome better than anything I've read. The book was a necessary background to educate me about all of this talk I've been hearing about the human genome. Some of his assertions haven't held up since the publication of the book, but don't let that dissuade you from reading this highly informative book.
The author covers the material so well that even for those who aren't interested in the development of electronic trading will find the story an exciting read. He puts the context around the development and has written the definitive history on the subject.
I'm a big fan of "The Singularity is Near" by Ray Kurzweil and I thought a lot of his telling of the story was influenced by Ray Kurzweil's thinking on AI and such. Near the very end of the book the author brings up Kurzweil and his thinking. He really didn't fit into the story's arc, but I took it as an ode to Kurzweil.
I warn you. The book will give you a queasy feeling in your stomach because he documents so thoroughly how the HST (high speed traders) are systematically taking money away from us because there is not a level playing field for small players like us who invest through our mutual funds or individual stocks and ETFs.