Sparse Prefix Caching for Hybrid and Recurrent LLM Serving

Препринт

Sparse Prefix Caching for Hybrid and Recurrent LLM Serving

M. Shirokikh, S.I. Nikolenko

arXiv · 2026

BibTeX

@misc{shirokikh2026_747,
  author = {Shirokikh, Mikhail and Nikolenko, Sergey I.},
  title = {{Sparse Prefix Caching for Hybrid and Recurrent LLM Serving}},
  year = {2026},
  eprint = {2605.05219},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2605.05219}
}