Shortcuts

torch.nn.functional.rms_norm

torch.nn.functional.rms_norm(input, normalized_shape, weight=None, eps=None)[source]

Apply Root Mean Square Layer Normalization.

See RMSNorm for details.

Return type

Tensor

Docs

Access comprehensive developer documentation for PyTorch

View Docs

Tutorials

Get in-depth tutorials for beginners and advanced developers

View Tutorials

Resources

Find development resources and get your questions answered

View Resources