-
Notifications
You must be signed in to change notification settings - Fork 30
head_size = getattr(model.config, "head_dim",...) #149
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
rzbhatti
wants to merge
22
commits into
main
Choose a base branch
from
config_head_dim
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…/ model.config.nheads ) Signed-off-by: Rashed Z. Bhatti, PhD <[email protected]>
…_default_validation_prefix, enable sample_key Signed-off-by: kcirred <[email protected]>
…uad_v2 sampler Signed-off-by: kcirred <[email protected]>
Signed-off-by: kcirred <[email protected]>
…oo long Signed-off-by: kcirred <[email protected]>
Signed-off-by: kcirred <[email protected]>
Signed-off-by: kcirred <[email protected]>
Signed-off-by: kcirred <[email protected]>
… as modeling code changed Signed-off-by: Joshua Rosenkranz <[email protected]>
…le names now sorted, testing of file names modified for new order Signed-off-by: kcirred <[email protected]>
Signed-off-by: Joshua Rosenkranz <[email protected]>
Signed-off-by: Avery Blanchard <[email protected]> Signed-off-by: Alex-Brooks <[email protected]>
Signed-off-by: Alex-Brooks <[email protected]>
commit ed571f728a351f8dd92737be5554c3dc46f71a30 Author: Alex-Brooks <[email protected]> Date: Tue Jul 29 09:20:06 2025 -0600 Remove cache tests commit 2848f7b2785b91c60c536b8993c3193c40c381ea Author: Alex-Brooks <[email protected]> Date: Mon Jul 28 08:07:01 2025 -0600 Add leading underscores, revert model name commit c30b7b70a0f6e464d3212fd9bed4f9ea33f9de93 Author: Alex-Brooks <[email protected]> Date: Mon Jul 28 07:15:08 2025 -0600 Explictly clear cache paths commit 42aaf666d7f8ffb2fb611df7ad2d06b48e480dd7 Author: Alex-Brooks <[email protected]> Date: Mon Jul 28 07:14:23 2025 -0600 Set the cache dir in conftest commit b978e7225f02bf1d9a5f7b919ca6cbe2ee8d641a Author: Alex-Brooks <[email protected]> Date: Mon Jul 28 06:15:10 2025 -0600 run formatting commit 8d64df08333991927c45f9a982ddaf95f39c94cf Author: Alex-Brooks <[email protected]> Date: Fri Jul 25 11:18:13 2025 -0600 refactor cache miss into fixture commit 0b524b8c818495cb646add2adfc27a2884ac8de5 Author: Alex-Brooks <[email protected]> Date: Fri Jul 25 07:11:09 2025 -0600 Consolidate cache test with common commit d8a36d405a101e101ab9ede3b8d12fa3026cd01f Author: Alex-Brooks <[email protected]> Date: Fri Jul 25 06:41:13 2025 -0600 Run cache test first commit 2efb797fb21587e9136b314c44ec56c658636826 Author: Alex-Brooks <[email protected]> Date: Fri Jul 25 05:48:25 2025 -0600 Finish splitting out common shape test helpers commit 4ae73dea18848005f86d1c9bcdf29f153711330f Author: Alex-Brooks <[email protected]> Date: Fri Jul 25 05:28:31 2025 -0600 refactor most of common shape test commit 083afdc3a468649ec4b0bbadc921d40b47e37498 Author: Alex-Brooks <[email protected]> Date: Thu Jul 24 14:08:20 2025 -0600 Move torch sendnn cache dir to common commit e9b576381a738c59f91d5fc904ceaa2a0e410864 Author: Alex-Brooks <[email protected]> Date: Thu Jul 24 14:02:06 2025 -0600 Use caps for constants, common post proc Signed-off-by: Alex-Brooks <[email protected]>
Signed-off-by: Alex-Brooks <[email protected]>
Signed-off-by: Alex-Brooks <[email protected]>
Signed-off-by: Alex-Brooks <[email protected]>
Signed-off-by: Alex-Brooks <[email protected]>
Signed-off-by: Alex-Brooks <[email protected]>
Signed-off-by: Alex-Brooks <[email protected]>
Signed-off-by: Alex-Brooks <[email protected]>
Signed-off-by: Rashed Z. Bhatti, PhD <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
To support the smaller models where
model.config.emb_dim // model.config.nheads != head_dim -
head_size = getattr(model.config, "head_dim", model.config.emb_dim // model.config.nheads )