arXiv:2611.06138v1 Announce Type: new Abstract: Modern LLM serving systems manage the KV cache through PagedAttention, a custom GPU allocator that partitions a single CUDA-allocated region into fixed-size physical blocks and maps each request to those blocks through a CPU-built block table.

Read the full article at arXiv cs.CR →