05You need to upgrade GPU drivers across a live inference and training fleet. What is your plan?▼hardNewNVIDIAGoogleMicrosoft2 repliesunlockedThe driver, the container toolkit, the CUDA runtime inside the image and the framework build all have to agree. Upgrade the wrong one first and every pod on the node fails to start with an error that names none of them.Open full answer →
33A training run from three months ago cannot be reproduced. Same code, same data, different result. Where does the difference come from?▼hardNewNVIDIADatabricksGoogle2 replies◆ premiumCode and data are the two things people pin, and they are rarely the two things that changed. The driver, the framework build, the kernel selection and the data ordering all vary underneath a pinned repository.Open full answer →