Skip to content

[CvT] Tensorflow implementation #18597

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 15 commits into from
Oct 11, 2022
Merged

[CvT] Tensorflow implementation #18597

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
75eaedb
implemented TFCvtModel and TFCvtForImageClassification and modified r…
mathieujouffroy Aug 9, 2022
eb8bd90
added docstring + testing file in transformers testing suite
mathieujouffroy Aug 9, 2022
e4ed73f
added test in testing file, modified docs to pass repo-consistency, p…
mathieujouffroy Aug 9, 2022
f4ded54
refactoring + passing all test
mathieujouffroy Aug 10, 2022
9aa1843
small refacto, removing unwanted comments
mathieujouffroy Aug 11, 2022
28c8e00
improved testing config
mathieujouffroy Aug 16, 2022
7cd0a38
corrected import error
mathieujouffroy Aug 16, 2022
b3e59ad
modified acces to pretrained model archive list, to pass tf_test
mathieujouffroy Aug 16, 2022
70986b0
corrected import structure in init files
mathieujouffroy Aug 16, 2022
9958039
modified testing for keras_fit with cpu
mathieujouffroy Aug 26, 2022
1bbe27d
correcting PR issues + Refactoring
mathieujouffroy Sep 1, 2022
5a7ec2e
Refactoring : improving readability and reducing the number of permut…
mathieujouffroy Sep 9, 2022
5caea7f
corrected momentum value + cls_token initialization
mathieujouffroy Oct 7, 2022
4b84c80
removed from_pt as weights were added to the hub
mathieujouffroy Oct 11, 2022
1e33bfc
Update tests/models/cvt/test_modeling_tf_cvt.py
gante Oct 11, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs/source/en/index.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -225,7 +225,7 @@ Flax), PyTorch, and/or TensorFlow.
| ConvBERT | ✅ | ✅ | ✅ | ✅ | ❌ |
| ConvNeXT | ❌ | ❌ | ✅ | ✅ | ❌ |
| CTRL | ✅ | ❌ | ✅ | ✅ | ❌ |
| CvT | ❌ | ❌ | ✅ | ❌ | ❌ |
| CvT | ❌ | ❌ | ✅ | ✅ | ❌ |
| Data2VecAudio | ❌ | ❌ | ✅ | ❌ | ❌ |
| Data2VecText | ❌ | ❌ | ✅ | ❌ | ❌ |
| Data2VecVision | ❌ | ❌ | ✅ | ✅ | ❌ |
Expand Down
11 changes: 11 additions & 0 deletions docs/source/en/model_doc/cvt.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -51,3 +51,14 @@ This model was contributed by [anugunj](https://huggingface.co/anugunj). The ori

[[autodoc]] CvtForImageClassification
- forward

## TFCvtModel

[[autodoc]] TFCvtModel
- call

## TFCvtForImageClassification

[[autodoc]] TFCvtForImageClassification
- call

14 changes: 14 additions & 0 deletions src/transformers/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2357,6 +2357,14 @@
"TFCTRLPreTrainedModel",
]
)
_import_structure["models.cvt"].extend(
[
"TF_CVT_PRETRAINED_MODEL_ARCHIVE_LIST",
"TFCvtForImageClassification",
"TFCvtModel",
"TFCvtPreTrainedModel",
]
)
_import_structure["models.data2vec"].extend(
[
"TFData2VecVisionForImageClassification",
Expand Down Expand Up @@ -5022,6 +5030,12 @@
TFCTRLModel,
TFCTRLPreTrainedModel,
)
from .models.cvt import (
TF_CVT_PRETRAINED_MODEL_ARCHIVE_LIST,
TFCvtForImageClassification,
TFCvtModel,
TFCvtPreTrainedModel,
)
from .models.data2vec import (
TFData2VecVisionForImageClassification,
TFData2VecVisionForSemanticSegmentation,
Expand Down
2 changes: 2 additions & 0 deletions src/transformers/models/auto/modeling_tf_auto.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,7 @@
("convbert", "TFConvBertModel"),
("convnext", "TFConvNextModel"),
("ctrl", "TFCTRLModel"),
("cvt", "TFCvtModel"),
("data2vec-vision", "TFData2VecVisionModel"),
("deberta", "TFDebertaModel"),
("deberta-v2", "TFDebertaV2Model"),
Expand Down Expand Up @@ -184,6 +185,7 @@
[
# Model for Image-classsification
("convnext", "TFConvNextForImageClassification"),
("cvt", "TFCvtForImageClassification"),
("data2vec-vision", "TFData2VecVisionForImageClassification"),
("deit", ("TFDeiTForImageClassification", "TFDeiTForImageClassificationWithTeacher")),
("mobilevit", "TFMobileViTForImageClassification"),
Expand Down
28 changes: 27 additions & 1 deletion src/transformers/models/cvt/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@
# limitations under the License.
from typing import TYPE_CHECKING

from ...utils import OptionalDependencyNotAvailable, _LazyModule, is_torch_available
from ...utils import OptionalDependencyNotAvailable, _LazyModule, is_tf_available, is_torch_available


_import_structure = {"configuration_cvt": ["CVT_PRETRAINED_CONFIG_ARCHIVE_MAP", "CvtConfig"]}
Expand All @@ -36,6 +36,18 @@
"CvtPreTrainedModel",
]

try:
if not is_tf_available():
raise OptionalDependencyNotAvailable()
except OptionalDependencyNotAvailable:
pass
else:
_import_structure["modeling_tf_cvt"] = [
"TF_CVT_PRETRAINED_MODEL_ARCHIVE_LIST",
"TFCvtForImageClassification",
"TFCvtModel",
"TFCvtPreTrainedModel",
]

if TYPE_CHECKING:
from .configuration_cvt import CVT_PRETRAINED_CONFIG_ARCHIVE_MAP, CvtConfig
Expand All @@ -53,6 +65,20 @@
CvtPreTrainedModel,
)

try:
if not is_tf_available():
raise OptionalDependencyNotAvailable()
except OptionalDependencyNotAvailable:
pass
else:
from .modeling_tf_cvt import (
TF_CVT_PRETRAINED_MODEL_ARCHIVE_LIST,
TFCvtForImageClassification,
TFCvtModel,
TFCvtPreTrainedModel,
)


else:
import sys

Expand Down
Loading