Skip to content

[Dev] Fix FP8 Codegen Issue for tilelang backend#291

Merged
LeiWang1999 merged 20 commits intomicrosoft:mainfrom
LeiWang1999:separate_tilelang
Feb 4, 2025
Merged

[Dev] Fix FP8 Codegen Issue for tilelang backend#291
LeiWang1999 merged 20 commits intomicrosoft:mainfrom
LeiWang1999:separate_tilelang

Conversation

@LeiWang1999
Copy link
Contributor

This pull request includes several changes to the bitblas project, focusing on updating type mappings, improving data type handling, and modifying backend configurations. Below are the most important changes grouped by theme:

Type Mapping Updates:

  • Updated type mappings in TLCUDASourceWrapper to use new type names for float16, bfloat16, e4m3_float8, and e5m2_float8 in bitblas/builder/wrapper/tl.py.

Data Type Handling:

  • Improved data type handling in gemv_simt.py by ensuring that elements are cast to accum_dtype before accumulation.

Backend Configuration:

  • Changed the backend from "tir" to "tl" in test_general_matmul_fp8.py for both matmul_torch_forward and matmul_torch_forward_weight_dequantize functions to align with the new backend configuration. [1] [2]

Submodule Update:

  • Updated the submodule commit reference in 3rdparty/tilelang to the latest commit.

@LeiWang1999 LeiWang1999 merged commit 812b98d into microsoft:main Feb 4, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant