AttnVQ — attention-aware KV-cache quantization · Laguna-XS.2
Components: real
vqkv
package. GPU: yes. Codebooks: found.
Memory vs baselines
Live generation
Memory vs baselines
Live generation
Context length (tokens)
↺
2048
131072
Plot