3
0

index.rst 1.4 KB

1234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950515253
  1. .. PyTorch documentation master file, created by
  2. sphinx-quickstart on Fri Dec 23 13:31:47 2016.
  3. You can adapt this file completely to your liking, but it should at least
  4. contain the root `toctree` directive.
  5. :github_url: https://github.com/nvidia/apex
  6. Apex (A PyTorch Extension)
  7. ===================================
  8. This site contains the API documentation for Apex (https://github.com/nvidia/apex),
  9. a Pytorch extension with NVIDIA-maintained utilities to streamline mixed precision and distributed training. Some of the code here will be included in upstream Pytorch eventually. The intention of Apex is to make up-to-date utilities available to users as quickly as possible.
  10. Installation instructions can be found here: https://github.com/NVIDIA/apex#quick-start.
  11. Some other useful material, including GTC 2019 and Pytorch DevCon 2019 Slides, can be found here: https://github.com/mcarilli/mixed_precision_references.
  12. .. toctree::
  13. :maxdepth: 1
  14. :caption: AMP: Automatic Mixed Precision
  15. amp
  16. .. toctree::
  17. :maxdepth: 1
  18. :caption: Distributed Training
  19. parallel
  20. .. toctree::
  21. :maxdepth: 1
  22. :caption: Fused Optimizers
  23. optimizers
  24. .. toctree::
  25. :maxdepth: 1
  26. :caption: Fused Layer Norm
  27. layernorm
  28. .. .. toctree::
  29. :maxdepth: 1
  30. :caption: Deprecated mixed precision API
  31. fp16_util
  32. .. RNN
  33. Indices and tables
  34. ==================
  35. * :ref:`genindex`
  36. * :ref:`modindex`