• Compiled autograd

  • Feb 19 2024
  • Length: 18 mins
  • Podcast

Compiled autograd By cover art

Compiled autograd

Listen for free

View show details

  • Summary

  • Compiled autograd is an extension to PT2 that permits compiling the entirety of a backward() call in PyTorch. This allows us to fuse accumulate grad nodes as well as trace through arbitrarily complicated Python backward hooks. Compiled autograd is an important part of our plans for compiled DDP/FSDP as well as for whole-graph compilation.
    Show more Show less
Show more Show less

What listeners say about Compiled autograd

Average customer ratings

Reviews - Please select the tabs below to change the source of reviews.

Audible.com reviews

Amazon reviews
No Reviews are Available