flash-mla

Here are 3 public repositories matching this topic...

DefTruth /Awesome-LLM-Inference

📖A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, Flash-Attention, Paged-Attention, MLA, Parallelism, Prefix-Cache, Chunked-Prefill, etc. 🎉🎉

mla vllm llm-inference awesome-llm flash-attention tensorrt-llm paged-attention deepseek flash-attention-3 deepseek-v3 minimax-01 deepseek-r1 flash-mla

UpdatedMar 4, 2025

DefTruth /CUDA-Learn-Notes

Star2.9k

📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).

cuda cuda-kernels cutlass cudnn cuda-toolkit gemm cuda-programming gemv hgemm flash-attention flash-mla

UpdatedMar 19, 2025
Cuda

DefTruth /ffpa-attn-mma

Star147

📚FFPA(Split-D): Yet another Faster Flash Prefill Attention with O(1) GPU SRAM complexity for headdim > 256, ~2x↑🎉vs SDPA EA.

cuda attention sdpa mla mlsys tensor-cores flash-attention deepseek deepseek-v3 deepseek-r1 fused-mla flash-mla

UpdatedMar 17, 2025
Cuda

Improve this page

Add a description, image, and links to theflash-mla topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with theflash-mla topic, visit your repo's landing page and select "manage topics."

Learn more

Movatterモバイル変換

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

Saved searches