Skip to content

Per sample grad correctness util #532

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 38 commits into from
Closed

Per sample grad correctness util #532

Changes from 1 commit
Commits
Show all changes
38 commits
Select commit Hold shift + click to select a range
b8a2ff7
support empty batches in memory manager and optimizer
Oct 25, 2022
2e1b9d7
restore warning
Oct 25, 2022
df9d1ab
disable functorch test for 1.13+
Oct 25, 2022
0268fa1
Merge branch 'main' of github.com:pytorch/opacus into ffuuugor_522
Oct 26, 2022
b952c2a
0-batch tests
Oct 27, 2022
5c7fc6f
lint
Oct 27, 2022
64f08ad
EW test fix
Oct 27, 2022
df7c355
docstring up
Oct 27, 2022
b64b06a
Implement per sample grads util and refactor code
Oct 27, 2022
9b4d5ee
Merge branch 'pytorch:main' into per-sample-grad-correctness-util
psolikov Oct 27, 2022
3f9f9cd
Add docs and refactor
Oct 28, 2022
765b84e
Apply code style fixes
Oct 28, 2022
16477ac
Merge branch 'main' into per-sample-grad-correctness-util
psolikov Oct 28, 2022
585be68
Fix flake8 errors
Oct 28, 2022
82c8f52
Implement per sample grads util and refactor code
Oct 27, 2022
1d957fa
Fixed issue with missing argument in MNIST example (#520)
Oct 27, 2022
4e3a979
Add docs and refactor
Oct 28, 2022
3d0a5db
Apply code style fixes
Oct 28, 2022
36dd386
Functorch gradients: investigation and fix (#510)
Oct 28, 2022
c06ebec
Fix flake8 errors
Oct 28, 2022
5168e20
Add type hints
Oct 31, 2022
b71fb30
Refactor
Oct 31, 2022
cdcae86
Update docstrings
Oct 31, 2022
ab1d6a7
Fix reduction modes for EW
Oct 31, 2022
206a042
Rebase on #530, separate utils tests, refactor
Nov 1, 2022
f9a35de
Optimize imports
Nov 1, 2022
a8aac48
Merge remote-tracking branch 'origin/per-sample-grad-correctness-util…
Nov 1, 2022
f7880d8
Fix test
Nov 1, 2022
1ae50cb
Add utility description to tutorial
Nov 1, 2022
8c67f40
Fix grad samples test
Nov 7, 2022
0faf661
Fixed isort warnings
Nov 7, 2022
a95c95a
Fix grad samples zero batch test
Nov 7, 2022
786a093
Skip functorch test when unavailable
Nov 7, 2022
42866b1
Merge branch 'main' into per-sample-grad-correctness-util
Nov 8, 2022
6402c18
Fix merge
Nov 8, 2022
0b9a1ec
Isort fix
Nov 8, 2022
05fdb4f
Fix docstring
Nov 8, 2022
fd8fbde
Merge branch 'main' into per-sample-grad-correctness-util
psolikov Nov 17, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
disable functorch test for 1.13+
  • Loading branch information
Igor Shilov committed Oct 25, 2022
commit df9d1ab3b5750e428dab8f0b77b0d943b2af6aaf
3 changes: 3 additions & 0 deletions opacus/tests/batch_memory_manager_test.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -237,5 +237,8 @@ def test_empty_batch(self):
pass


@unittest.skipIf(
torch.__version__ >= API_CUTOFF_VERSION, "not supported in this torch version"
)
class BatchMemoryManagerTestWithFunctorch(BatchMemoryManagerTest):
GSM_MODE = "functorch"