[Neurips 2025] R-KV: Redundancy-aware KV Cache Compression for Reasoning Models
-
Updated
Jun 23, 2026 - Python
#
kvcache
Here are 15 public repositories matching this topic...
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
serverless inference-engine llm llm-serving vllm llm-inference ollama llm-framework sglang kvcache gpu-sharing kvcached gpu-mutiplexing kvcache-optimization elastic-kvcache online-offline-coserve
-
Updated
Jun 12, 2026 - Python
PiKV: KV Cache Management System for Mixture of Experts [Efficient ML System]
distributed-systems parallel-computing moe mixture-model management-system mixture-of-experts mlsystem kv-cache kvcache
-
Updated
Jun 12, 2026 - Python
High-Performance KV Cache Sharing Library
-
Updated
Apr 2, 2026 - Python
An empirical study of benchmarking LLM inference with KV cache offloading using vLLM and LMCache on NVIDIA GB200 with high-bandwidth NVLink-C2C .
-
Updated
Dec 20, 2025 - Python
KV-cache compression for LLMs: reference implementations of TurboAngle and TurboQuant codecs with Triton GPU kernels
-
Updated
Apr 5, 2026 - Python
KV Cache with PagedAttention vs PagedAttention + TurboQuant - experiments across token sizes comparing memory, latency, and accuracy.
inference large-language-models llm llms llm-inference kvcache kvcache-optimization kvcache-compression turboquant
-
Updated
Mar 26, 2026 - Python
晚上下班不刷手机，学点什么。系列二：从 0 手写大模型推理框架，完成 Qwen3-4B 模型的本地单卡部署和 GPU 推理优化，显存不够可用 Qwen3-0.5B。
-
Updated
Feb 23, 2026 - Python
[MLSys-26] FlexiCache: Leveraging Temporal Stability of Attention Heads for Efficient KV Cache Management
-
Updated
Mar 9, 2026 - Python
Prime Power Transformer: A Number-Theoretic Architecture for Compute
machine-learning ai machine-learning-algorithms distributed-computing transformers attention-mechanism distributed-ledger attention-model attention-is-all-you-need attention-mechanisms transformer-architecture mathematical-proof llm kvcache kvcache-optimization kvcache-compression
-
Updated
Jun 28, 2026 - Python
[SIGMOD 2025] PQCache: Product Quantization-based KVCache for Long Context LLM Inference
-
Updated
Feb 3, 2025 - Python
Design and audit autonomous agent loops using a tested framework for triggers, verification, guardrails, and human escalation.
automation deep-dive devtools inference multi-agent ai-engineering ai-agent prompt-engineering anthropic agentic-framework agentic-rag kvcache agentic-ai agent-memory coding-agent context-engineering agent-harness loop-engineering
-
Updated
Jun 28, 2026 - Python
Improve this page
Add a description, image, and links to the kvcache topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the kvcache topic, visit your repo's landing page and select "manage topics."