-
Notifications
You must be signed in to change notification settings - Fork 3.6k
Deprecate nvidia/apex #16039
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Deprecate nvidia/apex #16039
Conversation
024d6dc to
15ed1ce
Compare
2f286e1 to
ea40f56
Compare
⚡ Required checks status: All passing 🟢Groups summary🟢 pytorch_lightning: Tests workflowThese checks are required after the changes to 🟢 pytorch_lightning: Azure GPU
These checks are required after the changes to 🟢 pytorch_lightning: Azure HPU
These checks are required after the changes to 🟢 pytorch_lightning: Azure IPU
These checks are required after the changes to 🟢 pytorch_lightning: Docs
These checks are required after the changes to 🟢 lightning_lite: CPU workflow
These checks are required after the changes to 🟢 lightning_lite: Azure GPU
These checks are required after the changes to 🟢 mypy
These checks are required after the changes to 🟢 installThese checks are required after the changes to Thank you for your contribution! 💜
|
60683d6 to
e24f958
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
🦦
What does this PR do?
Fixes #14416
PyTorch Lightning package changes:
NativeMixedPrecisionPluginin favor ofMixedPrecisionPluginLightningModule.optimizer_step(..., using_native_amp=bool)argumentTrainer(amp_backend)Trainer.amp_backendTrainer(amp_level). This was already deprecated but the previous deprecation has been replaced with the one in this PR for consistency.ApexMixedPrecisionPlugin. The deprecation message triggered by Apex internally is replaced by ours.AMPTypeenum and updates the codebase to avoid it. The_DeprecatedEnumMetaclass is re-introduced to do this.DeepSpeedPrecisionPlugin(amp_type, amp_level)arguments.Lite package changes:
NativeMixedPrecisionclass toMixedPrecisionDeepSpeedPrecision(amp_type, amp_level)arguments and their supportAMPTypeenum and its uses.Follow-up items (out of scope for this PR):
Does your PR introduce any breaking changes? If yes, please list them.
None intended
Before submitting
PR review
cc @Borda @tchaton @carmocca @justusschock @awaelchli