Skip to content

cherrypick: #2804 to branch fp8_trt10 #2867

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 150 commits into from
Closed

cherrypick: #2804 to branch fp8_trt10 #2867

wants to merge 150 commits into from

Conversation

zewenli98
Copy link
Collaborator

Description

Cherrypick #2804 to branch fp8_trt10

Type of change

Please delete options that are not relevant and/or add your own.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update

Checklist:

  • My code follows the style guidelines of this project (You can use the linters)
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas and hacks
  • I have made corresponding changes to the documentation
  • I have added tests to verify my fix or my feature
  • New and existing unit tests pass locally with my changes
  • I have added the relevant labels to my PR in so that relevant reviewers are notified

peri044 added 30 commits March 12, 2024 02:11
@peri044
chore: Upgrade to TRT 10.0
9ad87ac
@peri044
chore: updates to trt api
a655c9a
@peri044
feat: Add save API for torch-trt compiled models
cd86660
@peri044
feat: Add FP8 support including dtype and converters
31285e5
@peri044
chore: minor fixes
7c9c646
@peri044
Merge branch 'main' into trt_10
4eabeb0
@peri044
Merge branch 'trt_10' into fp8_trt10
a320e56
@peri044
chore: resolve merge conflicts
3ece71b
@peri044
chore: Fix save failures
eab0dba
@peri044
chore: update to 2.3 rc build
b191d62
@peri044
chore: rebase with release/2.3 branch
ce606fe
@peri044
chore: minor fixes
8674a3c
@peri044
chore: remove duplicate bert test case
f4e8fe9
@peri044
chore: remove comments
4ae6ab9
@peri044
chore: Upgrade to TRT 10.0
fff1b80 
chore: updates to trt api

chore: trt 10 fixes

chore: more fixes
@peri044
chore: more fixes
39ca77d
@peri044
chore: update trt version
5431ee3
@peri044
chore: more updates
0c03de5
@peri044
parent f39e89e
982dbd2 
author Dheeraj Peri <[email protected]> 1711393059 -0700
committer Dheeraj Peri <[email protected]> 1711393072 -0700

chore: minor updates

chore: Fix save failures

chore: minor fixes

chore: remove duplicate bert test case

chore: remove comments

chore: add load api

chore: minor updates

chore: minor updates

chore: minor updates

chore: more updates
@peri044
chore: more updates
1ae46e9
@peri044
chore: rebase with save
ae87fba
@peri044
chore: Update versions
beb5920
@peri044
chore: update tensorrt version in CI
f0068c6
@peri044
chore: more updates
39261b9
@peri044
chore: more fixes
3753150
@peri044
Merge branch 'release/2.3' into trt_10
16a191c
@peri044
chore: remove NvUtils.h
c355766
@peri044
chore: more updates
2d237dc
@peri044
chore: change lib64 to lib in rhel BUILD file
e4b4429
@peri044
chore: more updates
fa4fb9c
@github-actions github-actions bot added documentation Improvements or additions to documentation component: core Issues re: The core compiler component: build system Issues re: Build system component: api [Python] Issues re: Python API labels May 29, 2024
@zewenli98 zewenli98 requested a review from peri044 May 29, 2024 21:17
@zewenli98 zewenli98 self-assigned this May 29, 2024
@github-actions github-actions bot requested a review from narendasan May 29, 2024 21:17
@github-actions github-actions bot added component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: runtime component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths labels May 30, 2024
@peri044 peri044 changed the base branch from fp8_trt10 to release/2.3 May 30, 2024 06:55
@peri044
Copy link
Collaborator

peri044 commented May 31, 2024

This PR has strange CI issues. Closing this in favor of #2870.

@peri044 peri044 closed this May 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@peri044 peri044 Awaiting requested review from peri044

@narendasan narendasan Awaiting requested review from narendasan

Assignees

@zewenli98 zewenli98

Labels

cla signed component: api [Python] Issues re: Python API component: build system Issues re: Build system component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: core Issues re: The core compiler component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: runtime documentation Improvements or additions to documentation

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@zewenli98 @peri044 @facebook-github-bot @narendasan