Skip to content

Deprecation for Float8DynamicActivationFloat8WeightConfig (version 1) and Float8WeightOnlyConfig (version 1) and the models #2649

@jerryzh168

Description

@jerryzh168

This issue is tracking the deprecation of the (1) configs (2) model checkpoints quantized with these configs.

What is deprecated:

  1. We added version 2 config in Add Float8Tensor #2463, and switched the default version to 2 in Bump version for float8 dynamic quant and weight only quant configs #2650, the version 1 config is now deprecated, please use version 2 config to quantize the model
  2. the quantized checkpoints quantized with version 1 config previously is deprecated as well, and we plan to remove the support to load these checkpoints after pytorch 2.11 release (around 9 months from now)

Timeline:
0.13.0: annouce deprecation for version 1 config
after we migrated all tensor subclasses: remove support for version 1 config
after pytorch 2.11 release: remove support for version 1 checkpoints

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions