Skip to content

Support bfloat16 in DAT and HAT - #319

Merged
joeyballentine merged 1 commit into
chaiNNer-org:mainfrom
KurtBoehm:main
Sep 17, 2025
Merged

joeyballentine merged 1 commit into
chaiNNer-org:mainfrom
KurtBoehm:main

Conversation

@KurtBoehm

Copy link
Copy Markdown
Contributor

As it stands, both DAT and HAT do not support bfloat16 because the attention masks always have float32 as their dtype. This pull request ensures that the masks have the appropriate dtype.

@joeyballentine
joeyballentine merged commit cd26fe4 into chaiNNer-org:main Sep 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants