Adds fast gradient clipping support for the Embedding layer.#694

Closed

pagarwl wants to merge 4 commits intometa-pytorch:mainfrom

Commits on Dec 9, 2024

Adds fast gradient norm calculation for the embedding layer. The algorithm is described in the 'A Unified Fast Gradient Clipping Framework for DP-SGD' paper: https://proceedings.neurips.cc/paper_fi…
pagarwl
committed

Commits on Jan 12, 2025

Incorporate code review feedback on PR #694
pagarwl
committed

Commits on Feb 3, 2025

Fix isort issue in PR #694
pagarwl
committed

Commits on Feb 11, 2025

Merge branch 'pytorch:main' into main
pagarwl
authored