Skip to content

Conversation

philipbutler
Copy link
Contributor

@cpuhrsch
Installing was not so obvious, so this should help others trying to test and contribute.

There's some extra commits from amending, I'm still kinda garbage at git

Copy link

pytorch-bot bot commented Nov 24, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/1337

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures

As of commit 3dcb54f with merge base ed76e9c (image):

NEW FAILURES - The following jobs have failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 24, 2024
cd examples/sam2_amg_server/
```

Download `sam2.1_hiera_large.pt` from https://github.com/facebookresearch/sam2?tab=readme-ov-file#download-checkpoints and put it into `~/checkpoints/sam2`
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The download part I guess doesn't apply anymore now that the user can get this via the model type argument.

@cpuhrsch
Copy link
Contributor

Looks good, let me know once you got a chance to give this another commit or two and then we can merge.

# Model
model:
_target_: sam2.modeling.sam2_base.SAM2Base
_target_: torchao._models.sam2.modeling.sam2_base.SAM2Base
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah, these are the sam2 configs. There's sam2 and then there's sam2.1. I had to switched to sam2.1, but maybe sam2 is still useful? I updated the sam2.1 configs in b2e42ff#diff-12caf984b30e7028df7fb867a984c5ccad3fde0a0783df2af26db9cef860fbe5 , but in any case it doesn't hurt to have sam2 support as well.

yanbing-j pushed a commit to yanbing-j/ao that referenced this pull request Dec 9, 2024
…h#1337)

* [AOTI] Remove the original model weights in Python deployment

Summary: Fixes pytorch/torchchat#1302. Because AOTI-compiled model contains a copy of model weights, we need to release the corresponding eager model weights in the Python deployment path.

* Revert "[AOTI] Remove the original model weights in Python deployment"

This reverts commit 962ec0d913bbf6c30496560f12b4726445dce7da.

* Refactor the code

* Add setup_cache for aoti_package_path

---------

Co-authored-by: Jack-Khuu <[email protected]>
Copy link

@bhack bhack left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we recap in the Readme also the optimizations we have introduced with AO?

@cpuhrsch
Copy link
Contributor

cpuhrsch commented Dec 9, 2024

@bhack - Yes, we're working a more detailed description of this.

@cpuhrsch cpuhrsch added the topic: improvement Use this tag if this PR is an improvement (doesn't fit into any of the other categories) label Dec 9, 2024
@cpuhrsch cpuhrsch merged commit a6f8676 into pytorch:main Dec 9, 2024
16 of 18 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. topic: improvement Use this tag if this PR is an improvement (doesn't fit into any of the other categories)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants