3
0

layernorm.rst 307 B

1234567891011121314151617
  1. .. role:: hidden
  2. :class: hidden-section
  3. apex.normalization.fused_layer_norm
  4. ===================================
  5. .. automodule:: apex.normalization
  6. .. currentmodule:: apex.normalization
  7. .. FusedAdam
  8. ----------
  9. .. autoclass:: FusedLayerNorm
  10. :members:
  11. .. autoclass:: FusedRMSNorm
  12. :members: