https://dasya.itu.dk/tags/kv-cache/ Recent content in kv-cache on DASYA Hugo -- gohugo.io en-us © DASYA, IT University of Copenhagen Wed, 05 Aug 2026 00:00:00 +0000 https://dasya.itu.dk/for-students/proposals/current/pito-llm-kvcache/ Wed, 05 Aug 2026 00:00:00 +0000 https://dasya.itu.dk/for-students/proposals/current/pito-llm-kvcache/ This project would investigate key-value(KV)-cache offloading in large language model (LLM) inference engines, with particular emphasis on data placement and storage efficiency. First, the project would use an emulator such as FEMU to characterize workload access patterns, including hot-key distributions, write intensity, and write amplification factor (WAF). Then, we would evaluate the potential of Flexible Data Placement (FDP) for improving data placement decisions on SSDs for KV-cache accesses. The project will use open source state-of-the-art KV-cache types such as LMCache or the ones implemented by the inference frameworks such as vLLM and SGLang.