Below the API

Multi-GPU and Sharing

AdvancedModule4 topics~3h 45m
completed

Topics, in order

About this module

One GPU is a component. Real systems have two opposite problems: a job too big for one GPU, and a GPU too big for one job. This module covers both, and how a cluster scheduler hands GPUs out.

#LessonThe question it answers
01Interconnects and TopologyHow are GPUs wired to each other, and why does the wiring matter?
02Splitting Work Across GPUsWhat are the ways to use several GPUs, and what does each cost?
03Sharing One GPUHow do several jobs use one GPU safely?
04GPUs in KubernetesHow does a cluster discover, allocate and monitor GPUs?

↑↓ navigate ↵ open