-
Notifications
You must be signed in to change notification settings - Fork 3.7k
[Fix] Codegen fix for relax cutlass #18190
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
| default_headers << "#include <cutlass/coord.h>\n"; | ||
| default_headers << "#include <cutlass/tensor_ref.h>\n"; | ||
| default_headers << "#include <cutlass/util/host_tensor.h>\n"; | ||
| default_headers << "#include <tvm/runtime/logging.h>\n"; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
To reduce overall dependency, assuming the codegen part did not use ICHECK or (or change to TVM_FFI_ICHECK), LOG(INFO), instead to #include <tvm/ffi/function.h> to minimize deps
|
Thanks @jcf94 ! some minor nit |
|
@jcf94 would be great to do the followup minor change and see if we can bring it in. thank you |
Sorry for just seeing your comment. 😂 |
|
Thanks @jcf94 I made a minor change and once it is green we can merge it in |
* Codegen fix --------- Co-authored-by: Tianqi Chen <[email protected]>
Seems the migration from TVMValue to PackedArgs/AnyView missed the codegen part when I tried to test relax cutlass.
With this fix, now the codegened cutlass .cu can pass nvcc compile.
BTW, the relax/cutlass part has not been guarded by CI?