FA2 Fully Shared QKV SMEM🎉

DefTruth released this 19 Dec 08:10

· 232 commits to main since this release

4687e1d

What's Changed

[FA2] Update flash-attn-mma shared-kv/qkv🎉 by @DefTruth in https://github.com/DefTruth/CUDA-Learn-Notes/pull/163
[FA2] Update flash-attn-mma shared-kv/qkv🎉 by @DefTruth in https://github.com/DefTruth/CUDA-Learn-Notes/pull/164
[FA2] Update flash-attn-mma shared-qkv🎉 by @DefTruth in https://github.com/DefTruth/CUDA-Learn-Notes/pull/165
[FA2] Update flash-attn-mma shared-kv🎉 by @DefTruth in https://github.com/DefTruth/CUDA-Learn-Notes/pull/166
[FA2] Update flash-attn-mma split-kv/q🎉 by @DefTruth in https://github.com/DefTruth/CUDA-Learn-Notes/pull/167
[FA2] Update flash-attn-mma shared-qkv🎉 by @DefTruth in https://github.com/DefTruth/CUDA-Learn-Notes/pull/168
[FA2] flash-attn-mma get rid of transpose-k✔️ by @DefTruth in https://github.com/DefTruth/CUDA-Learn-Notes/pull/169

Full Changelog: DefTruth/CUDA-Learn-Notes@v2.6.8...v2.6.9

Contributors

DefTruth

Assets 2