Agents and Storage Interaction

This project would investigate the storage access patterns of LLM agents using open-source state-of-the-art inference frameworks such as vLLM and SGLang and workload traces such as the ones released by Mooncake, Alibaba, Swiss AI Initiative, etc. Depending on the size and duration of the project, it can also propose or implement optimizations for the storage access.

This project would be suitable as a standalone project, a research project with an MSc thesis followup, or BSc thesis. If you are interested in LLM serving efficiency, storage devices, benchmarking, and performance analysis, this project would be a great fit for you. Furthermore, there is a possibility of collaborating with Samsung Research Denmark.