Update ML Decoder #2045

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Draft

fffffgggg54 wants to merge 109 commits into huggingface:main

from fffffgggg54:ml-decoder

Draft

Update ML Decoder #2045

fffffgggg54 wants to merge 109 commits into huggingface:main from fffffgggg54:ml-decoder

+419 −43

Conversation

fffffgggg54

Copy link

Contributor

@fffffgggg54 fffffgggg54 commented Nov 27, 2023 •

edited

Loading

Update ML Decoder's TransformerDecoderLayerOptimal module to comply with what nn.TransformerDecoder expects. Current changes work with resnet50.

add_ml_decoder_head needs to be updated for other models. In my limited testing, the following case works with RegNet:

elif hasattr(model, 'head'): # ClassifierHead and ConvNext
 if hasattr(model.head, 'flatten'): # ConvNext case
 model.head.flatten = nn.Identity()
 model.head.global_pool = nn.Identity()
 del model.head.fc
 num_classes = model.num_classes
 num_features = model.num_features
 model.head.fc = MLDecoder(num_classes=num_classes, initial_num_features=num_features)

fffffgggg54 added 2 commits

November 27, 2023 11:57

@fffffgggg54


 Update ml_decoder.py

8997ccf

@fffffgggg54


 Update ml_decoder.py

69f3634

@HuggingFaceDocBuilderDev

Copy link

HuggingFaceDocBuilderDev commented Nov 27, 2023

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

fffffgggg54 added 27 commits

December 8, 2023 13:17

@fffffgggg54


 Update beit.py

92f0b7f

@fffffgggg54


 Update beit.py

d10f002

@fffffgggg54


 Update beit.py

f59c1f1

@fffffgggg54


 Update davit.py

318369a

@fffffgggg54


 Merge branch 'davit_head_update' into ml-decoder

08b7837

@fffffgggg54


 Update edgenext.py

03606ab

@fffffgggg54


 Update edgenext.py

4f8898a

@fffffgggg54


 Update edgenext.py

c0206b8

@fffffgggg54


 Merge branch 'edgenext_head_update' into ml-decoder

babdb21

@fffffgggg54


 Merge branch 'huggingface:main' into ml-decoder

13b33c6

@fffffgggg54


 vectorize GroupFC

95bd9dc

@fffffgggg54


 Update ml_decoder.py

1448b7d

@fffffgggg54


 Update ml_decoder.py

ab3eacb

@fffffgggg54


 Update ml_decoder.py

b4afe6c

@fffffgggg54


 Update ml_decoder.py

dd8d231

@fffffgggg54


 Update ml_decoder.py

51c85bd

@fffffgggg54


 Update ml_decoder.py

36d69a4

@fffffgggg54


 Update ml_decoder.py

@fffffgggg54


 Update ml_decoder.py

aa19600

@fffffgggg54


 Update ml_decoder.py

6b99c91

@fffffgggg54


 Update ml_decoder.py

db24aea

@fffffgggg54


 Update ml_decoder.py

09749be

@fffffgggg54


 Update ml_decoder.py

2a05a28

@fffffgggg54


 Update ml_decoder.py

50fe44f

@fffffgggg54


 Update ml_decoder.py

565a57a

@fffffgggg54


 Update ml_decoder.py

95a24fc

@fffffgggg54


 Update ml_decoder.py

7ebfb85

fffffgggg54 added 30 commits

December 29, 2024 04:19

@fffffgggg54


 Update ml_decoder.py

5c32658

@fffffgggg54


 Update ml_decoder.py

fbeed51

@fffffgggg54


 Update ml_decoder.py

5cac39c

@fffffgggg54


 Update ml_decoder.py

bf81448

@fffffgggg54


 Update ml_decoder.py

566a843

@fffffgggg54


 Incorrect indexing in GroupLinear

86c1104

@fffffgggg54


 bias incorrect

d6bb62f

@fffffgggg54


 contiguous

ca3b3f0

@fffffgggg54


 metaformer monkeypatch

9000e79

@fffffgggg54


 monkeypatch ml-decoder + metaformer

a8b90bf

@fffffgggg54


 Merge branch 'ml-decoder' of https://github.com/fffffgggg54/pytorch-i...

7479d45

...mage-models into ml-decoder

@fffffgggg54


 Add MLDecoderHead query passthrough

8d704b7

@fffffgggg54


 Experimental options for smaller head

4e35692

@fffffgggg54


 Update ml_decoder.py

@fffffgggg54


 Update ml_decoder.py

94b56db

@fffffgggg54


 pool input

41d36dc

@fffffgggg54


 Update ml_decoder.py

28954e7

@fffffgggg54


 Update ml_decoder.py

8ef74c0

@fffffgggg54


 Update ml_decoder.py

9388b52

@fffffgggg54


 not useful

@fffffgggg54


 Update ml_decoder.py

808d797

@fffffgggg54


 Update ml_decoder.py

f2d4781

@fffffgggg54


 Update ml_decoder.py

be3902c

@fffffgggg54


 Merge remote-tracking branch 'upstream/main' into ml-decoder

bd3516d

@fffffgggg54


 ml-decoder query proj defeat, reset fix

b7a9aa7

@fffffgggg54


 experimental davit version

fbee52e

@fffffgggg54


 Update ml_decoder.py

14f6170

@fffffgggg54


 Update ml_decoder.py

90fbbc5

@fffffgggg54


 Update ml_decoder.py

9cb895c

@fffffgggg54


 Update ml_decoder.py

7d9991d

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

Update ML Decoder #2045

Are you sure you want to change the base?

Update ML Decoder #2045

Conversation

@fffffgggg54 fffffgggg54 commented Nov 27, 2023 •

edited

Loading

Uh oh!

Uh oh!

HuggingFaceDocBuilderDev commented Nov 27, 2023

Uh oh!

Uh oh!

Uh oh!

Update ML Decoder #2045

Are you sure you want to change the base?

Update ML Decoder #2045

Conversation

@fffffgggg54 fffffgggg54 commented Nov 27, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

HuggingFaceDocBuilderDev commented Nov 27, 2023

Uh oh!

Uh oh!

@fffffgggg54 fffffgggg54 commented Nov 27, 2023 •

edited

Loading