06Six teams share a GPU cluster. Two of them are idle most nights. Design the quota model.▼hardNewDatabricksUberMicrosoft2 repliesunlockedHard quotas strand idle GPUs and soft quotas mean the loudest team owns the cluster. Borrowing with reclaim is the shape that works, and the interesting decisions are all about what happens when the lender comes back.Open full answer →
15One customer's batch job is making your interactive chat slow. Fix it at the serving layer.▼hardNewDatabricksSalesforceStripe2 replies○ sign inBoth workloads are legitimate and they want opposite things from the same GPU. Combine tenant rate limits with fair admission and measured capacity reservations; separate fleets are an option when shared scheduling cannot meet the targets.Open full answer →