In this episode of the Existential Hope Podcast, Beatrice Erkers is joined by David Duvenaud, Associate Professor at the University of Toronto and former researcher at Anthropic.

We discuss David’s work on post-AGI civilizational equilibria and the widely discussed paper Gradual Disempowerment. David reflects on why liberalism may not hold up in a world where humans are no longer needed, how UBI could be Goodharted into absurdity, and what it would take to design institutions that protect humans even when incentives don’t.

We also cover:

- Forecasting the long-term future using LLMs trained on historical data

- Robin Hanson’s idea of futarchy (governance by prediction markets)

- Asymmetrical but beneficial relationships between humans and AI

- Uploading, cultural legacies, and the possibility of “worthy successors”

On the Existential Hope Podcast hosts Allison Duettmann and Beatrice Erkers from the Foresight Institute invite scientists, founders, and philosophers for in-depth conversations on positive, high-tech futures.

Full transcript, listed resources, and more: https://www.existentialhope.com/podcasts

Follow on X.

Hosted on Acast. See acast.com/privacy for more information.

What does a genuinely positive future with AI look like? While dystopian visions are common, the most valuable—and scarcest—resource we have is a concrete, hopeful vision for where we're headed.In this episode, we're joined by Nathan Labenz, host of the popular Cognitive Revolution podcast, to explore the tangible possibilities of a beneficial AI-driven world.

Nathan shares his insights on everything from the near-term transformations in education and healthcare—like AI-driven antibiotic discovery and personalized learning—to the grand, long-term visions of curing all diseases and becoming a multi-planetary species.

We dive deep into crucial concepts like Eric Drexler's "comprehensive AI services" as a model for safety through narrowness, the transformative power of self-driving cars, and how we can collectively raise our ambitions to build the future we actually want.

On the Existential Hope Podcast hosts Allison Duettmann and Beatrice Erkers from the Foresight Institute invite scientists, founders, and philosophers for in-depth conversations on positive, high-tech futures.

Full transcript, listed resources, and more: https://www.existentialhope.com/podcasts

Follow on X.

Hosted on Acast. See acast.com/privacy for more information.

For years, the conversation about the long-term future has been dominated by a crucial question: how do we avoid extinction? But what if ensuring our survival is only half the battle? In this episode, Beatrice is joined by Fin Moorhouse, a researcher at Forethought and co-author with Will MacAskill of the Better Futures series, to make the case for focusing on the other half: flourishing. Or as we'd like to say in this podcast: Existential Hope!

Fin challenges the idea that a great future will emerge automatically if we just avoid the worst-case scenarios. Using the analogy of a grand sailing expedition, he explores the complexities of navigating towards a truly optimal world, questioning whether our current moral compass is enough to guide us.

The conversation dives into the concept of "moral catastrophes"—profound ethical failings, like industrial animal farming, that could persist even in technologically advanced futures. Fin also tackles the complex challenges posed by digital minds, from the risk of accidental suffering to the creation of "willing servants." He argues for the power of "moral trade" as a tool to build a more pluralistic and prosperous world, and explains why we should aim for a "Viatopia"—a stable and self-sustaining state that makes a great future highly likely.

On the Existential Hope Podcast hosts Allison Duettmann and Beatrice Erkers from the Foresight Institute invite scientists, founders, and philosophers for in-depth conversations on positive, high-tech futures.

Full transcript, listed resources, and more: https://www.existentialhope.com/podcasts

Follow on X.

Hosted on Acast. See acast.com/privacy for more information.

Is code just a technical skill for engineers, or is it a deeply humanistic art form capable of expanding our minds? In this episode, host Beatrice Erkers is joined by scientist, author, and Coder-in-Residence at Lux Capital, Sam Arbsman, to explore the profound ideas in his new book, The Magic of Code.

Sam reframes our relationship with computing, arguing that code is one of history's most powerful "tools for thought," standing alongside the alphabet and paper in its ability to augment human intellect. He delves into the fascinating history of this idea, from Don Swanson's concept of "undiscovered public knowledge" in scientific literature to the modern potential of AI to connect disparate ideas and accelerate discovery.

The conversation also explores the democratization of creation through "vibe coding," the power of thinking of an app as a "home-cooked meal," and the critical importance of humility as our technological systems become too complex for any single person to fully understand—a theme from his previous book, Overcomplicated. Sam connects these ideas to the ever-changing nature of knowledge itself, drawing from his first book, The Half-Life of Facts.

On the Existential Hope Podcast hosts Allison Duettmann and Beatrice Erkers from the Foresight Institute invite scientists, founders, and philosophers for in-depth conversations on positive, high-tech futures.

Full transcript, listed resources, and more: https://www.existentialhope.com/podcasts

Follow on X.

Hosted on Acast. See acast.com/privacy for more information.

The tech industry we read about every day accounts for only 2% of the global economy. So what about the other 98%? In this episode, host Beatrice Erkers talks to hacker, inventor, and author Pablos Holman about his new book, Deep Future, and why it’s time to look beyond software to solve the world’s biggest problems.

Pablos argues that for decades, our brightest minds have been focused on apps and ads while ignoring the fundamental industries that civilization depends on: energy, manufacturing, shipping, and food. He makes the case for "deep tech"—everything but software—and explains why now is the perfect moment to deploy our "software toolkit" to reinvent these stagnant, trillion-dollar sectors.

From computer-controlled sailing ships and factory-built nuclear reactors buried a mile underground, to the simple genius of a better milk jug that can double a farmer's income, Pablos shares mind-bending examples of technology that truly matters. He also offers a grounded take on AI, explaining why computational modeling for disease control is more impactful than AGI hype, and delivers a powerful vision for a future where energy abundance ends global conflict and automation frees humanity to focus on what makes us thrive: care, community, and connection.

On the Existential Hope Podcast hosts Allison Duettmann and Beatrice Erkers from the Foresight Institute invite scientists, founders, and philosophers for in-depth conversations on positive, high-tech futures.

Full transcript, listed resources, and more: https://www.existentialhope.com/podcasts

Follow on X.

Hosted on Acast. See acast.com/privacy for more information.

What if we could build an AI that doesn't just answer questions, but makes fundamental scientific discoveries on its own? That's the mission of Future House, and in this episode, host Allison Duettmann sits down with its co-founder, Andrew White.

Andrew shares the incredible journey that led him from chemical engineering to the forefront of the AI for Science revolution. He gives us a look under the hood at Future House's flock of specialized AI agents, like Crow, Finch, and Owl, and reveals how they recently accomplished in just three weeks what could have taken years: identifying an existing drug as a potential new treatment for a common cause of blindness.

But the conversation doesn't stop at the successes. Andrew offers a sharp critique of the current methods for evaluating AI, explaining what’s wrong with benchmarks like "Humanity's Last Exam" and why the ultimate test is real-world discovery. He also makes a compelling case for completely reinventing the slow and inefficient scientific publishing system for an era where machines are both the producers and consumers of research.

Andrew is also fundraising for the Frontiers Society at IPAM to advance this work. If you’d like to support, you can donate here: IPAM Donation Page.

On the Existential Hope Podcast hosts Allison Duettmann and Beatrice Erkers from the Foresight Institute invite scientists, founders, and philosophers for in-depth conversations on positive, high-tech futures.

Full transcript, listed resources, and more: https://www.existentialhope.com/podcasts

Follow on X.

Hosted on Acast. See acast.com/privacy for more information.

What if the most desirable AI future is made of powerful tools, not autonomous agents? Physicist and futurist Anthony Aguirre joins us to unpack the Tool AI pathway, how incentives, liability, and design choices could steer us toward AI that empowers people rather than replaces them. We also situate this episode in AI Pathways, our two-scenario project exploring Tool AI and d/acc futures. Explore the project: https://ai-pathways.existentialhope.com/

On the Existential Hope Podcast hosts Allison Duettmann and Beatrice Erkers from the Foresight Institute invite scientists, founders, and philosophers for in-depth conversations on positive, high-tech futures.

Full transcript, listed resources, and more: https://www.existentialhope.com/podcasts

Follow on X.

Hosted on Acast. See acast.com/privacy for more information.

Self-driving cars aren’t science fiction, they’re already here. But what kind of future are they steering us toward?

In this episode, Beatrice speaks with Andrew Miller, mobility expert and author of The End of Driving, about the transformational promise, and very real risks, of autonomous vehicles. They explore why driverless tech isn’t just about hardware or software, but about regulation, land use, curb management, jobs, and values.

From robo-taxis in San Francisco and driverless trucks in Texas, to curb chaos, job displacement, and how we reclaim space from parked cars, this episode goes far beyond the hype.

On the Existential Hope Podcast hosts Allison Duettmann and Beatrice Erkers from the Foresight Institute invite scientists, founders, and philosophers for in-depth conversations on positive, high-tech futures.

Full transcript, listed resources, and more: https://www.existentialhope.com/podcasts

Follow on X.

Hosted on Acast. See acast.com/privacy for more information.