feat(hardware): add KV cache memory estimator with 256-token rounding#65

inureyes merged 2 commits into

mainlablup/mlxcel:mainfrom

feature/issue-54-kv-cache-estimatorlablup/mlxcel:feature/issue-54-kv-cache-estimatorCopy head branch name to clipboard