PyTorch Developer Podcast Podcast Por Edward Yang Team PyTorch arte de portada

PyTorch Developer Podcast

PyTorch Developer Podcast

De: Edward Yang Team PyTorch
Escúchala gratis

Acerca de esta escucha

 The PyTorch Developer Podcast is a place for the PyTorch dev team to do bite sized (10-20 min) topics about all sorts of internal development topics in PyTorch.2021 - PyTorch Developer Podcast
Episodios
  • Compiler collectives

    Compiler collectives
    Aug 4 2024

    Compiler collectives are a PT2 feature where by compiler instances across multiple ranks use NCCL collectives to communicate information to other instances. This is used to ensure we consistently decide if inputs or static or dynamic across all ranks. See also PR at https://github.com/pytorch/pytorch/pull/130935
    Más Menos
    17 m
  • TORCH_TRACE and tlparse

    TORCH_TRACE and tlparse
    Apr 29 2024
    TORCH_TRACE and tlparse are a structured log and log parser for PyTorch 2. It gives useful information about what code was compiled and what the intermediate build products look like.
    Más Menos
    15 m
  • Higher order operators

    Higher order operators
    Apr 21 2024
    Higher order operators are a special form of operators in torch.ops which have relaxed input argument requirements: in particular, they can accept any form of argument, including Python callables. Their name is based off of their most common use case, which is to represent higher order functions like control flow operators. However, they are also used to implement other variants of basic operators and can also be used to smuggle in Python data that is quite unusual. They are implemented using a Python dispatcher.
    Más Menos
    17 m
Todavía no hay opiniones