Episodios

  • Adventures in Data Corruption

    Adventures in Data Corruption
    Jul 10 2025

    Two years ago, the Oxide team encountered data corruption during a fairly simple network data transfer. The ensuing debugging sessions uncovered a truly bizarre bug involving CPU speculation! Bryan and Adam were joined by colleagues John and Rain to discuss the discovery and circuitous hunt to track down the bug.

    In addition to Bryan Cantrill and Adam Leventhal, speakers included John Gallagher, and Rain Paharia.

    Previous episodes mentioned:

    • OxF s03e09 - Get You a State Machine for Great Good
    • OxF s03e20 - Shipping the first Oxide rack: Tales from Manufacturing
    • OxF s04e25 - RTO or GTFO
    • OxF s02e38 - A Debugging Odyssey

    Some of the topics we hit on, in the order that we hit them:

    • The Update Framework
    • Omicron Issue #3441 (Oxide Computer GitHub)
    • Omicron Pull Request #3455 (Oxide Computer GitHub)
    • stlouis Issue #454 (Oxide Computer GitHub)
    • Changing psrset.out.txt (Oxide Computer)
    • Commit 5ec2885322423c0cca0d006611b5c9ac94b0f588 (Oxide Computer)
    • Omicron Pull Request #3560 (Oxide Computer GitHub)

    If we got something wrong or missed something, please file a PR! Our next show will likely be on Monday at 5p Pacific Time on our Discord server; stay tuned to our Mastodon feeds for details, or subscribe to this calendar. We'd love to have you join us, as we always love to hear from new speakers!
    Más Menos
    1 h y 44 m
  • When Async Attacks!

    When Async Attacks!
    Jun 27 2025
    What happens when the Oxide API is slow? A podcast episode! More specifically, one about how the team employed all manner of debugging techniques to track it down to one obscure and configurable async runtime feature! Bryan and Adam were joined by members of the team to talk about that journey and the tools we used (and made!) along the way.In addition to Bryan Cantrill and Adam Leventhal, we were joined by Oxide colleagues, Dave Pacheco, Eliza Weisman, and Augustus Mayo.Previous episodes mentioned:Oxide and the Chamber of MysteriesThe Saga of SagasDTrace at 20Cultural IdiosyncrasiesMr. Nagle’s Wild RideA Debugging OdysseyRTO or GTFOSome of the topics we hit on, in the order that we hit them:Falling in Love with RustTokio Runtime Builder – disable_lifo_slotmagic‑trace (GitHub)Magic Trace podcast episode from Jane Streetdiesel‑dtrace (GitHub)omicron issue commentqorbstatemaptokio‑dtracetokio issue #7411Visualizing Systems with StatemapsPostgreSQL WAL INIT ZEROStatemaps: Visualizing System Behavior (YouTube)The statemaps that we referred to:Nexus by thread, discussed starting at 55:29. (This statemap has some states coalesced; the full version is also available.)Nexus by Tokio task, tagged by thread, discussed starting at 1:15:33The D scripts that we referred to:nexus-statemap.d used to generate the initial statemapnexus-profile.d to understand what was consuming CPUtokio-statemap-tagged.d to generate the Tokio task statemapIf we got something wrong or missed something, please file a PR! Our next show will likely be on Monday at 5p Pacific Time on our Discord server; stay tuned to our Mastodon feeds for details, or subscribe to this calendar. We'd love to have you join us, as we always love to hear from new speakers!
    Más Menos
    1 h y 54 m
  • Diving In with Robert Bogart

    Diving In with Robert Bogart
    Jun 19 2025

    On the heels of Bryan's blog post about the similarities between aspiring college athletes finding a team and entrepreneurs raising a round of capital, Bryan and Adam were joined by Robert Bogart to discuss his own experiences with both--and the life lesson accrued along the way.

    In addition to Bryan Cantrill and Adam Leventhal, we were joined by special guest, Robert Bogart.
    College Baseball, Venture Capital, and the Long Maybe

    • OxF: Debugger‑Driven Development
    • Anthony Ervin – Wikipedia
    • Eddie Reese – Wikipedia
    • Metaweb – Wikipedia

    If we got something wrong or missed something, please file a PR! Our next show will likely be on Monday at 5p Pacific Time on our Discord server; stay tuned to our Mastodon feeds for details, or subscribe to this calendar. We'd love to have you join us, as we always love to hear from new speakers!
    Más Menos
    1 h y 43 m
  • Debugger-Driven Development

    Debugger-Driven Development
    Jun 16 2025

    Building systems software can be quite opaque, leading to the need for great debugging tools. At Oxide, we've found that debuggers can be even more valuable leading rather than following system development. Bryan and Adam talk with Oxide colleagues about how domain specific debugging tools help us build systems not only more robustly, but faster as well.

    In addition to Bryan Cantrill and Adam Leventhal, we were joined by Oxide colleagues, Dave Pacheco. John Gallagher, Alan Hanson, and Eliza Weisman.

    Previous episodes mentioned:

    • OxF: AI Discourse with Steve Klabnik
    • OxF: The Saga of Sagas
    • OxF: A Crate is Born
    • OxF: The Network Behind the Network
    • OxF: Bringing up Cosmo
    • OxF: RIP USENIX ATC
    • OxF: Dijkstra’s Tweetstorm

    Some of the topics we hit on, in the order that we hit them:

    • omdb ground rules

    If we got something wrong or missed something, please file a PR! Our next show will likely be on Monday at 5p Pacific Time on our Discord server; stay tuned to our Mastodon feeds for details, or subscribe to this calendar. We'd love to have you join us, as we always love to hear from new speakers!
    Más Menos
    1 h y 35 m
  • AI Discourse with Steve Klabnik

    AI Discourse with Steve Klabnik
    Jun 5 2025

    Last week, our colleague (and frequent Oxide and Friends guest) Steve Klabnik made some new friends on the Internet with a blog entry on AI discourse. Bryan and Adam were joined by Steve to try to de-polarize the discussion a little.

    In addition to Bryan Cantrill and Adam Leventhal, we were joined by special guest, Steve Klabnik, and valued listener, Julian Giamblanco (aka "Oatmealdealer").

    Some of the topics we hit on, in the order that we hit them:

    • Steve's blog post: I am disappointed in the AI discourse
    • OxF: A Baseball Startup with Paul Freedman and Bryan Carmel (The Ballers)
    • OxF: Adversarial Machine Learning with Nicholas Carlini
    • OxF: Hiring Processes with Gergely Orosz ("the RFD 3 podcast episode")
    • OxF: AI Disruption: DeepSeek and Cerebras
    • OxF: Reflecting on Founder Mode ("ego con")

    If we got something wrong or missed something, please file a PR! Our next show will likely be on Monday at 5p Pacific Time on our Discord server; stay tuned to our Mastodon feeds for details, or subscribe to this calendar. We'd love to have you join us, as we always love to hear from new speakers!
    Más Menos
    1 h y 34 m
  • AI, Materials, and Fraud with Ben Shindel

    AI, Materials, and Fraud with Ben Shindel
    May 24 2025

    Late in 2024, an economics paper captured the attention of the world. AI, it claimed, had a tremendous impact on materials research, disproportionally benefitted the most productive, and--sadly--reduced job statisfaction. It now appears that the results are entirely fabricated! Ben Shindel joins Bryan and Adam to discuss.

    In addition to Bryan Cantrill and Adam Leventhal, we were joined by special guest Ben Shindel.


    Some of the topics we hit on, in the order that we hit them:

    • Ben's blog: AI, Materials, and Fraud, Oh My!
    • OxF: Theranos, Silicon Valley, and the March Madness of Tech Fraud
    • Topic
    • [@M:SS](link into recording) Leventhal's Conundrum
    • PRs needed!

    If we got something wrong or missed something, please file a PR! Our next show will likely be on Monday at 5p Pacific Time on our Discord server; stay tuned to our Mastodon feeds for details, or subscribe to this calendar. We'd love to have you join us, as we always love to hear from new speakers!
    Más Menos
    1 h y 11 m
  • RIP USENIX ATC

    RIP USENIX ATC
    May 15 2025
    Bryan and Adam discuss the recent announcement of the discontinuation of the USENIX Annual Technical Conference (ATC), reminiscing about their own visits to the ATC and the impact of the conference. Long-time Oxide Friend, Tom Lyon, joined to dial the reminiscence back a couple more decades!In addition to Bryan Cantrill and Adam Leventhal, we were joined by Tom Lyon.Some of the topics we hit on, in the order that we hit them:Bryan's blog 2025: RIP USENIX ATCOxF s1e13: Put the OS back in OSDIBryan's Lisa 2011 talk: Fork Yeah! The Rise and Development of illumosBryan's USENIX 2016 talk: A Wardrobe for the EmperorUSENIX 2004Gnutella not NutellaUSENIX DTrace paperUSENIX Summer 1994Slab AllocatorNFSv3WSJ 2006 Technology Innovation Awards0xF s1e18: Dijkstra's TweetstormMeeting Dennis RitchieBoF sessionBirds of a feather flock togetherFreenix20032004Rik Farrow ;login: editorial on USENIX 2016Bryan's blog 2004: Wither USENIX?blog comments from Werner VogelsSystems We LoveAdam's blog 2004: nohup -pillumos sourceOxF s1e4: from /proc to proc_macroThings that don't work as advertisedDiffracting treesCold FusionAdam's blog 2009: Triple-Parity RAID-ZRob Pike 2000: Systems Software Research is IrrelevantZFS paperLiving Computer Museum (now-dead)SDFAll the Chips that Fit by Tom LyonOxF s2e22: RIP OptaneHistory of Programming Languages ConferenceIf we got something wrong or missed something, please file a PR! Our next show will likely be on Monday at 5p Pacific Time on our Discord server; stay tuned to our Mastodon feeds for details, or subscribe to this calendar. We'd love to have you join us, as we always love to hear from new speakers!
    Más Menos
    1 h y 25 m
  • Solutions Software Engineering with Matthew Sanabria

    Solutions Software Engineering with Matthew Sanabria
    May 7 2025

    Matthew Sanabria joins Bryan and Adam to talk about his role at Oxide--Solutions Software Engineer--and how it fits in with engineering, sales, support and marketing. It takes everyone in Busytown! Sound good? Apply!

    In addition to Bryan Cantrill and Adam Leventhal, we were joined by Oxide colleague, Matthew Sanabria.

    Some of the topics we hit on, in the order that we hit them:

    • Solutiuons Software Engineer application
    • OxF: the "squeezefish" episode
    • The Fallthrough podcast
    • Busytown

    If we got something wrong or missed something, please file a PR! Our next show will likely be on Monday at 5p Pacific Time on our Discord server; stay tuned to our Mastodon feeds for details, or subscribe to this calendar. We'd love to have you join us, as we always love to hear from new speakers!
    Más Menos
    1 h y 31 m