NVLink

NVLink is a scalable interlink created by NVIDIA which connects multiple GPUs at a high speed across either a single or multiple system(s).

NVLinks permits higher bandwidth as the GPUs are interlinked with NVLink allowing faster data sharing.

Configure NVLink for non-ML-in-a-Box or terminal/ssh-only (headless) machines.
Disable NVLink to ensure CUDA runs on your machines.