Machine Learning Models for the Edge

To enable efficient data processing and machine learning on resource-constrained devices has many challenges. One is fitting the models into the restrictive memory and compute resources of these devices. In this project, first, we would like to explore the landscape of foundational, generative-AI, language, etc. models with respect to their size and compute needs to understand what could be a fit to be deployed at the edge. Then, we would like to characterize the performance of some edge model deployments on a chosen edge device and building on the analysis in the first step.

If you are interested in resource-constrained hardware, benchmarking, and machine learning in general, this project would be a great fit for you.

This project would be suitable as a standalone project or BSc or MSc thesis at ITU during Fall 2024. Depending on the size of the project and the interest of the student(s), we can look at a subset of AI model domains and investigate one or more edge devices.