Skip to content

Conversation

@WoosukKwon
Copy link
Collaborator

Fixes #73

This PR adds CONTRIGUING.md and mypy configs. While the repository currently does not completely pass the mypy tests, it helps me identify some type bugs in our codebase. Those bugs are also fixed in this PR.

@WoosukKwon WoosukKwon requested a review from zhuohan123 May 23, 2023 08:18
@WoosukKwon
Copy link
Collaborator Author

@zhuohan123 Sorry for updating the PR after requesting the review. Now the PR is ready for review.

Copy link
Member

@zhuohan123 zhuohan123 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thanks!

@WoosukKwon WoosukKwon merged commit a283ec2 into main May 24, 2023
@WoosukKwon WoosukKwon deleted the mypy branch May 24, 2023 00:58
hongxiayang pushed a commit to hongxiayang/vllm that referenced this pull request Feb 13, 2024
yukavio pushed a commit to yukavio/vllm that referenced this pull request Jul 3, 2024
SUMMARY:
- Miscellaneous updates to benchmarking infrastructure to support Github
benchmarking UI
  - cleanup configs - Remove default arguments.
- Add a `description` field to the benchmarking scripts so we may
communicate intent to the UI
- Move benchmark_result.py to logging folder
- Add gha_benchmark_logging script that consumed BenchmarkResult JSON
and outputs a JSON that the Github Benchmark UI can understand.
- Add a minimal_test.json config that can be used for infra testing
- Make config list as nightly explicity and add the remote-push job to
nightly for fair comparison


TEST PLAN:
Manual testing
nm-benchmark manual trigger :
https://github.com/neuralmagic/nm-vllm/actions/runs/8284500798
nightly manual trigger :
https://github.com/neuralmagic/nm-vllm/actions/runs/8285535882

---------

Co-authored-by: Varun Sundar Rabindranath <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Use mypy

3 participants