Episode 3 - Elevators Up, Stairways Down

Jeff and Seymour use stories and analogies to explain the two main approaches to AI: Bottom-Up and Top-Down. The recent wave of AI success is mostly based on the bottom up  path which includes machine learning, neural networks, and deep learning. Related links:

• The case of the construction worker with a nail in his boot
• Murray Shanahan's excellent December 2022 paper Talking About Large Language Models
• Meta / Facebook AI research's September 2020 blog post on Retrieval Augmented Generation and Segmentation
• DeepMind / Google AI's December 2021 paper on using a Retrieval-Enhanced Transformer (aka Retro) and a database of 2-trillion tokens for improved LLM capabilities. 

Questions and comments? Talk to us.