Skip to content

[Dev][TL] Decouple 3rdparty TileLang Backend with TVM#217

Closed
LeiWang1999 wants to merge 54 commits intomicrosoft:mainfrom
LeiWang1999:migrate_tilelang
Closed

[Dev][TL] Decouple 3rdparty TileLang Backend with TVM#217
LeiWang1999 wants to merge 54 commits intomicrosoft:mainfrom
LeiWang1999:migrate_tilelang

Conversation

@LeiWang1999
Copy link
Contributor

@LeiWang1999 LeiWang1999 commented Oct 10, 2024

This pull request includes updates to submodule configurations and references. The changes primarily involve adding a new submodule and updating existing submodule references.

Submodule reference updates:

  • 3rdparty/tile-lang: Added a subproject commit reference for the new submodule.
  • 3rdparty/tvm: Updated the subproject commit reference to a new commit hash.

TODO Items must be done before this pull request be merged:

  • Make sure we merge the latest update of upstream tvm.tl (e.g. ThreadPartialSync and tl.Simplify)
  • Refactor all tl related items with tilelang
  • Test Pass
  • Ensure that both the PyPI and local release build scripts function correctly after this pull request.

The select_scheduler function in the dense/__init__.py module has been refactored to use a fine-grained interface. This change provides more flexibility and enables the implementation of high-performance kernels.

Update MatmulScheduler class in matmul_tensorcore.py

The MatmulScheduler class in the matmul_tensorcore.py module has been updated to calculate the number of threads based on the block size and warp size. This ensures optimal GPU warp configuration for NVIDIA GPUs.

Improve test_general_matmul_tilelang_kernel.py

The test_general_matmul_tilelang_kernel.py module has been improved to include additional test cases and assertions for correctness.
…_tilelang_kernel.py to use centered random values for input tensors
@LeiWang1999 LeiWang1999 marked this pull request as ready for review October 11, 2024 15:00
@LeiWang1999
Copy link
Contributor Author

We came across some segment related bugs during the test.

@LeiWang1999
Copy link
Contributor Author

closed as been implemented through pull request #290

@LeiWang1999
Copy link
Contributor Author

closed as has been resolved via pr #290

@LeiWang1999 LeiWang1999 closed this Feb 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant