On this episode of Learning from Machine Learning, I had the privilege of speaking with Aman Khan, Head of Product at Arize AI. Aman shared how evaluating AI systems isn't just a step in the process—it's a machine learning challenge in of itself. Drawing powerful analogies between mechanical engineering and AI, he explained, "Instead of tolerances in manufacturing, you're designing for non-determinism," reminding us that complexity often breeds opportunity.

Aman's journey from self-driving cars to ML evaluation tools highlights the critical importance of robust systems that can handle failure. He encourages teams to clearly define outcomes, break down complex systems, and build evaluations into every step of the development pipeline.

Most importantly, Aman's insights remind us that machine learning—much like life—is less deterministic and more probabilistic, encouraging us to question how we deal with the uncertainty in our own lives.

Thank you for listening. Be sure to subscribe and share with a friend or colleague . Until next time... keep on learning.

In this episode of Learning from Machine Learning, we explore the intersection of pure mathematics and modern data science with Leland McInnes, the mind behind an ecosystem of tools for unsupervised learning including UMAP, HDBSCAN, PyNN Descent and DataMapPlot. As a researcher at the Tutte Institute for Mathematics and Computing, Leland has fundamentally shaped how we approach and understand complex data.

Leland views data through a unique geometric lens, drawing from his background in algebraic topology to uncover hidden patterns and relationships within complex datasets. This perspective led to the creation of UMAP, a breakthrough in dimensionality reduction that preserves both local and global data structure to allow for incredible visualizations and clustering. Similarly, his clustering algorithm HDBSCAN tackles the messy reality of real-world data, handling varying densities and noise with remarkable effectiveness.

But perhaps what's most striking about Leland isn't just his technical achievements – it's his philosophy toward algorithm development. He champions the concept of "decomposing black box algorithms," advocating for transparency and understanding over blind implementation. By breaking down complex algorithms into their fundamental components, Leland argues, we gain the power to adapt and innovate rather than simply consume.

For those entering the field, Leland offers poignant advice: resist the urge to chase the hype. Instead, find your unique angle, even if it seems unconventional. His own journey – applying concepts from algebraic topology and fuzzy simplicial sets to data science – demonstrates how breakthrough innovations often emerge from unexpected connections.

Throughout our conversation, Leland's passion for knowledge and commitment to understanding shine through. His approach reminds us that the most powerful advances in data science often come not from following the crowd, but from diving deep into fundamentals and drawing connections across disciplines.

There's immense value in understanding the tools you use, questioning established approaches, and bringing your unique perspective to the field. As Leland shows us, sometimes the most significant breakthroughs come from seeing familiar problems through a new lens.

Resources for Leland McInnes

Leland’s Github

• UMAP
• HDBSCAN
• PyNN Descent
• DataMapPlot
• EVoC

References

• Maarten Grootendorst
  • Learning from Machine Learning Episode 1
• Vincent Warmerdam - Calmcode
  • Learning from Machine Learning Episode 2
• Matt Rocklin
• Emily Riehl - Category Theory in Context
• Lorena Barba
• David Spivak - Fuzzy Simplicial Sets
• Improving Mapper’s Robustness by Varying Resolution According to Lens-Space Density

Learning from Machine Learning

• Youtube
• https://mindfulmachines.substack.com/

In this episode, we are joined by Chris Van Pelt, co-founder of Weights & Biases and Figure Eight/CrowdFlower. Chris has played a pivotal role in the development of MLOps platforms and has dedicated the last two decades to refining ML workflows and making machine learning more accessible.

Throughout the conversation, Chris provides valuable insights into the current state of the industry. He emphasizes the significance of Weights & Biases as a powerful developer tool, empowering ML engineers to navigate through the complexities of experimentation, data visualization, and model improvement. His candid reflections on the challenges in evaluating ML models and addressing the gap between AI hype and reality offer a profound understanding of the field's intricacies.

Drawing from his entrepreneurial experience co-founding two machine learning companies, Chris leaves us with lessons in resilience, innovation, and a deep appreciation for the human dimension within the tech landscape. As a Weights & Biases user for five years, witnessing both the tool and the company's growth, it was a genuine honor to host Chris on the show.

References and Resources

https://wandb.ai/

https://www.youtube.com/c/WeightsBiases

https://x.com/weights_biases

https://www.linkedin.com/company/wandb/

https://twitter.com/vanpelt

Resources to learn more about Learning from Machine Learning

• https://www.youtube.com/@learningfrommachinelearning
• https://www.linkedin.com/company/learning-from-machine-learning
• https://mindfulmachines.substack.com/
• https://www.linkedin.com/in/sethplevine/
• https://medium.com/@levine.seth.p