GPU Fragmentation
A cluster can report plenty of idle GPUs while a job waits, because the idle devices are scattered across nodes. Packing, reservation, and defragmentation keep large blocks of free capacity available.
A cluster can report plenty of idle GPUs while a job waits, because the idle devices are scattered across nodes. Packing, reservation, and defragmentation keep large blocks of free capacity available.