https://ashimsharma10.github.io/blog Software engineer sharing projects, notes, and guides on ML infrastructure. en-us sharmaashim00@gmail.com (Ashim Sharma) sharmaashim00@gmail.com (Ashim Sharma) Thu, 13 Aug 2026 00:00:00 GMT https://ashimsharma10.github.io/blog/vllm-how-a-token-gets-served https://ashimsharma10.github.io/blog/vllm-how-a-token-gets-served What happens inside a serving engine: why the GPU fills up with something other than the model, what paging the cache buys you, why reading a prompt and writing an answer fight each other, and which knobs settle the fight. Thu, 13 Aug 2026 00:00:00 GMT sharmaashim00@gmail.com (Ashim Sharma) vllmllminferencegpukv-cache