Tagged with: GPU Utilization

PROPOSAL

Analysis of Predicting GPU Utilization Metrics Using Deep Learning Models and infering number of required SMs

GPU offers massive computational power and parallelism through its Streaming Multiprocessors (SMs). Efficient GPU utilization is critical for maximizing performance and optimizing compute resource usage, which is measured using various metrics such as SMACT (SM Activity) and SMOCC (SM Occupancy), and DRAMA (DRAM Active). These metrics provide insight into how effectively the GPU’s SMs and …
Supervisors: Pınar Tözün, Ehsan Yousefzadeh-Asl-Miandoab
Semester: Spring 2024
Tags: machine learning systems, GPU Utilization, resource management, resource interference