Skip to content

Functorch gradients: investigation and fix #510

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 8 commits into from
Closed

Functorch gradients: investigation and fix #510

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
1685719
functorch tests
Sep 16, 2022
7642579
Merge branch 'main' of github.com:pytorch/opacus into ffuuugor_476
Oct 26, 2022
ba61607
fix double-computing grad_samples with functorch
Oct 26, 2022
e1feb93
lint
Oct 26, 2022
64448e1
walk method rename
Oct 26, 2022
6d165ac
disable functorch tests if not available
Oct 26, 2022
90f48f6
comment upd
Oct 27, 2022
735a607
relative imports for utils
Oct 28, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
relative imports for utils
  • Loading branch information
Igor Shilov committed Oct 28, 2022
commit 735a607d9883f0cfcd15f469961bf193b3f567c8
3 changes: 2 additions & 1 deletion opacus/tests/privacy_engine_test.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,6 @@
from opacus.layers.dp_multihead_attention import DPMultiheadAttention
from opacus.optimizers.optimizer import _generate_noise
from opacus.scheduler import StepNoise
from opacus.tests.utils import CustomLinearModule, LinearWithExtraParam
from opacus.utils.module_utils import are_state_dict_equal
from opacus.validators.errors import UnsupportedModuleError
from opacus.validators.module_validator import ModuleValidator
Expand All @@ -41,6 +40,8 @@
from torchvision import models, transforms
from torchvision.datasets import FakeData

from .utils import CustomLinearModule, LinearWithExtraParam


def _is_functorch_available():
try:
Expand Down
5 changes: 3 additions & 2 deletions opacus/tests/privacy_engine_validation_test.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,13 +3,14 @@
import torch
from opacus import PrivacyEngine
from opacus.grad_sample.gsm_exp_weights import API_CUTOFF_VERSION
from opacus.tests.utils import (
from torch.utils.data import DataLoader

from .utils import (
BasicSupportedModule,
CustomLinearModule,
LinearWithExtraParam,
MatmulModule,
)
from torch.utils.data import DataLoader


class PrivacyEngineValidationTest(unittest.TestCase):
Expand Down