Guiding a Safe Future for AI – Part 1

What if AI is automating the one thing that's always made us human—Intelligence itself? And how do we ensure that it's developed safely?

In this first of a two-part series, we speak with Dr. Zico Kolter, head of Carnegie Mellon University's Machine Learning Department and newly appointed OpenAI board member, where he chairs their Safety and Security Committee, to explore the critical challenge of developing artificial intelligence safely.

Dr. Kolter discusses CMU's pioneering machine learning department and outlines four essential categories of AI safety concerns: immediate security threats like data exfiltration and prompt injection; societal impacts on jobs, economy, and mental health; catastrophic risks from malicious actors wielding AI-powered capabilities; and long-term scenarios of uncontrollable superintelligence.

Unlike previous technological revolutions that automated physical labor or computation, AI represents something unprecedented—the automation of intelligence itself. Dr. Kolter argues this fundamental difference demands collaborative oversight from industry, academia, and government to ensure AI serves humanity's best interests. The conversation emphasizes why getting AI safety right matters more than ever as we integrate thinking machines into our critical infrastructure.