Module 8 - GPU / TPU Infrastructure

GPU architecture, CUDA memory, distributed training (DDP, FSDP, ZeRO), training clusters, and inference hardware.