GPU and AI data-centre fundamentals, covering compute, networking, storage and operations. Professional follow-ons include NCP-AII ($400) and NCP-AIO ($500).
Who it's for: Infrastructure, DevOps and data-centre engineers moving into AI.
Describe DGX/HGX systems, NVLink and NVSwitch for GPU-to-GPU traffic, and scale-up vs scale-out
Compare InfiniBand with Ethernet/RoCE for east-west AI traffic, and explain what BlueField DPUs offload
Size storage for training (parallel file systems, GPUDirect Storage) and plan power, cooling and rack density for GPU clusters
Choose between on-premises, cloud and hybrid AI infrastructure by cost and utilisation
Hands-on: Rent a cloud GPU VM (or use a free Colab/Kaggle GPU) and run nvidia-smi and nvidia-smi topo -m. Write down GPU model, memory, driver/CUDA versions and interconnect, then run an NGC PyTorch container with the NVIDIA Container Toolkit.
Monitor GPU health and utilisation with DCGM and export metrics to Prometheus/Grafana
Run GPU workloads on Kubernetes with the GPU Operator and on HPC clusters with Slurm, and know when each scheduler fits
Partition GPUs with MIG and know when time-slicing or vGPU fits better
Hands-on: On a single-GPU cloud VM, install k3s and the NVIDIA GPU Operator, schedule a pod that requests nvidia.com/gpu, and scrape its utilisation with the DCGM exporter while the job runs.