add att backend#1165

Merged

hiworldwzj merged 114 commits intomainfrom

Jan 9, 2026

Commits on Jan 9, 2026

add att backend impl
wangzaijun
committed
fix alibi att backend
wangzaijun
committed
fix llama triton att backend
wangzaijun
committed
fix att
wangzaijun
committed
fix att
wangzaijun
committed
fix att
wangzaijun
committed
add att_control params

hiworldwzj
authored and
wangzaijun
committed
fix int8kv

hiworldwzj
authored and
wangzaijun
committed
fix
wangzaijun
committed
add new int8kv dequant triton kernel
wangzaijun
committed
fix int8kv prefill attention kernel
wangzaijun
committed
fix unittest

root
authored and
wangzaijun
committed
fix int8kv att backend.

hiworldwzj
authored and
wangzaijun
committed
fix

hiworldwzj
authored and
wangzaijun
committed
fix diverse att.

hiworldwzj
authored and
wangzaijun
committed
fix

hiworldwzj
authored and
wangzaijun
committed
add int4kv.

hiworldwzj
authored and
wangzaijun
committed
add int4 kernel

hiworldwzj
authored and
wangzaijun
committed
fix all

hiworldwzj
authored and
wangzaijun
committed
fix unit test

hiworldwzj
authored and
wangzaijun
committed
fix unit test

hiworldwzj
authored and
wangzaijun
committed
fix

hiworldwzj
authored and
wangzaijun
committed
fix all
wangzaijun
committed
fix all
wangzaijun
committed
add int4kv backend
wangzaijun
committed
fix
wangzaijun
committed
add fa3
wangzaijun
committed
add fa3
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix memmanager
wangzaijun
committed
fix memmanager
wangzaijun
committed
fix all
wangzaijun
committed
add fp8 flashattention
wangzaijun
committed
fix llama
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix all
wangzaijun
committed
fix
wangzaijun
committed
fix all
wangzaijun
committed
fix all
wangzaijun
committed
fix flashinfer
wangzaijun
committed
fix
wangzaijun
committed
remove chatglm2

hiworldwzj
authored and
wangzaijun
committed
fix

hiworldwzj
authored and
wangzaijun
committed
fix

hiworldwzj
authored and
wangzaijun
committed
fix

hiworldwzj
authored and
wangzaijun
committed
fix

hiworldwzj
authored and
wangzaijun
committed
fix

hiworldwzj
authored and
wangzaijun
committed
add triton mla decode.

hiworldwzj
authored and
wangzaijun
committed
remove

hiworldwzj
authored and
wangzaijun
committed
fix deepseek

hiworldwzj
authored and
wangzaijun
committed
fix

hiworldwzj
authored and
wangzaijun
committed
add triton mla prefill
wangzaijun
committed
add flashinfer mla decode
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix all
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix all
wangzaijun
committed
remove mode
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix mode
wangzaijun
committed
fix mode.
wangzaijun
committed
remove max_len_in_batch
wangzaijun
committed
remove max_len_in_batch
wangzaijun
committed
fix cuda graph.
wangzaijun
committed
fix cuda graph
wangzaijun
committed
fix

hiworldwzj
authored and
wangzaijun
committed
fix

hiworldwzj
authored and
wangzaijun
committed
fix

hiworldwzj
authored and
wangzaijun
committed
fix

hiworldwzj
authored and
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix.
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed