Tagged with: resource interference

PROPOSAL

Evaluating the Impact of Collocating Deep Learning Training Tasks on Jetson Orion Nano GPUs

This project investigates how running multiple deep learning training tasks simultaneously (collocation) affects performance on resource-constrained edge devices, specifically the NVIDIA Jetson Orion Nano. Students will deploy and benchmark various models (e.g., CNNs, Transformers) in isolated vs. different collocated scenarios, measure metrics such as GPU utilization, memory usage, training time, …
Supervisors: Pınar Tözün, Ehsan Yousefzadeh-Asl-Miandoab
Semester: Fall 2025
Tags: machine learning systems, GPU Utilization, resource management, resource interference

PROPOSAL

Predicting GPU utilization for Deep learning training

GPU offers massive computational power and parallelism through its Streaming Multiprocessors (SMs). Efficient GPU utilization is critical for maximizing performance and optimizing compute resource usage, which is measured using various metrics such as SMACT (SM Activity) and SMOCC (SM Occupancy), and DRAMA (DRAM Active). These metrics provide insight into how effectively the GPU’s SMs and …
Supervisors: Pınar Tözün, Ehsan Yousefzadeh-Asl-Miandoab
Semester: Fall 2025
Tags: machine learning systems, GPU Utilization, resource management, resource interference