15Databases will be provisioned by a Kubernetes Operator. What must the reconcile loop get right, and what when it cannot reach the API?▼expertNewRed HatOracleDatabricks○ sign inThe senior tells are level-triggered reconciliation and finalizer semantics. The partition question separates people who have written a controller from people who have installed one.Open full answer →
26Walk me through what the kubelet does between PodScheduled and a running container. Why do nodes flap NotReady while pods keep serving?▼expert★ EssentialNewGoogleRed HatDatadog◆ premiumThe kubelet is a local reconcile loop with its own event stream, probe workers and eviction brain. Staff-level candidates can narrate it and explain why Ready status can reflect either reported health failure or missing heartbeats.Open full answer →
32Your operator is the top API consumer and etcd is sweating. Explain informers, resourceVersion and the real cost of LIST.▼expert★ EssentialNewDatadogLinkedInUber◆ premiumControllers should never poll, yet most home-grown operators do. This question separates people who run controllers at ten-thousand-object scale from those who copied a tutorial: watch semantics, cache behaviour, and which LISTs touch etcd.Open full answer →
18kubectl takes ten seconds, operator leader elections flap, and etcd fsync latency is the only red metric. What now?▼expertNewGoogleRed HatDatabricks○ sign inOne disk metric explaining a whole cluster's weirdness is the point of this question. Candidates who restart etcd first turn a slow cluster into a down one.Open full answer →
27After moving a shared directory onto NFS, app threads pile into D state and load average tops 50 while CPUs sit idle. Explain it.▼expert★ EssentialNewNVIDIAGoldman SachsJPMorgan Chase◆ premiumNFS waits can stall shutdown and inflate load average while CPUs stay idle. Check the blocked kernel path before deciding whether signals or mount recovery can release it.Open full answer →
40New connections to one partner API fail at peak, only through the NAT gateway, while established flows sail on. What is the ceiling?▼expertNewAmazon & AWSMicrosoftStripe◆ premiumBandwidth graphs look healthy and the partner swears they are fine. The wall is ports, not bits: the available source-port budget depends on the gateway and its address allocation.Open full answer →
37Your platform is connecting agents to internal tools through MCP servers. How do you handle identity and authorisation?▼expertNewMicrosoftCloudflareGitLab2 replies◆ premiumAn agent is a workload that acts on behalf of a person, holds credentials for several systems, and decides what to call based on text it read. Every one of those properties breaks an assumption in your existing access model.Open full answer →
38A model's output feeds a shell command, a SQL query and a web page. What is your threat model?▼expertNewCloudflareGitHubMicrosoft2 replies◆ premiumModel output is attacker-influenced data by construction, because the model reads attacker-influenced input. Every rule you already apply to user input applies here, and teams forget because the text came from a system they built.Open full answer →
06Design an authentication service for 100,000 QPS across three regions: 2KB payloads, 10ms processing, 16-core VMs. Do the math out loud.▼expert★ EssentialNewGoogleMetaAmazon & AWSunlockedThe Google-style NALSD round in miniature. The boxes are easy; what is being scored is whether the numbers fall out of Little's law before you draw them.Open full answer →
27Two pods both believed they held the lock, so the nightly job ran twice. Design locking that survives stalls, pauses, and clock lies.▼expert★ EssentialNewHashiCorpUberCloudflare◆ premiumLeases prevent dead holders but not overlapping ones. The staff-level answer is fencing tokens and a candid account of why quorum lock services without downstream checks are still probabilistic.Open full answer →
36Design real-time collaborative editing for documents. Where does operational transform win, and where does CRDT?▼expertNewAtlassianGoogleMicrosoft◆ premiumReciting both acronyms is the median answer. Expert level chooses by connectivity assumptions and undo semantics, then defends CRDT metadata growth with numbers.Open full answer →
39Design the platform that decides whether a model change is safe to ship, for twenty teams shipping weekly.▼expertNewDatabricksMicrosoftSalesforce2 replies◆ premiumTeams need comparable evaluations before they approve a model change. Design versioned test data, recorded runs and release thresholds that a pipeline can enforce.Open full answer →
40Design log search for four hundred services and fifty teams, at ten terabytes a day.▼expertNewDatadogElasticSnowflake2 replies◆ premiumThe hard parts are not search. They are deciding what to keep before you pay to store it, isolating one team's query from everyone else's, and making the cost visible to the people generating it.Open full answer →
41Forty teams want to call models. Design the gateway that sits between them and the providers.▼expertNewStripeSalesforceAtlassian2 replies◆ premiumWithout one, every team implements its own retries, its own key handling, its own logging policy, and nobody can answer what the company spends or what a model change would break.Open full answer →
07Training throughput is 40 percent below what the GPU count predicts. The GPUs look fine. Where do you look?▼expertNewNVIDIAMetaMicrosoft2 repliesunlockedAt sixteen GPUs and above, the network is the computer. Collectives run at the speed of the worst link in the group, and placement decides which link that is.Open full answer →
13How is rolling out a new model different from rolling out new code, and what does a model canary actually measure?▼expertNewMetaGoogleDatabricks○ sign inCode rollouts ask 'does it work'; model rollouts ask 'is it better', and the second question has no HTTP status code. Shadow traffic, offline eval gates and quality canaries replace the 500-rate dashboards you cannot use.Open full answer →
14You have eight 80GB GPUs and a 70B model. Tensor parallel across all eight, or two replicas of four? Defend the choice.▼expertNewNVIDIADatabricksMeta2 replies○ sign inBoth configurations fit the weights. Compare cache capacity, collective overhead and replica placement under the actual traffic shape; neither layout wins every workload.Open full answer →
19Long prompts are making short requests slow on the same replica. What is happening, and how would you fix it?▼expertNewNVIDIADatabricksMicrosoft2 replies○ sign inPrefill and decode are two different workloads sharing one GPU. Their resource demands differ, and an unchunked long prefill can delay active decodes. Profile the actual model and batch shape before choosing a scheduling change.Open full answer →
22Speculative decoding promises a big latency win. When does it not deliver, and what does it cost you?▼expertNewNVIDIADatabricksMicrosoft2 replies◆ premiumIt trades compute for latency, so it wins on an underloaded fleet and can lose on a saturated one. The acceptance rate decides everything, and the acceptance rate depends on traffic you do not control.Open full answer →
29How do you detect that a model in production got worse, when nothing in your infrastructure metrics changed?▼expertNewDatabricksDatadogMicrosoft2 replies◆ premiumLatency is flat, errors are zero, and the answers are worse. Quality regression is invisible to every metric a platform team normally owns, which is why it needs its own pipeline.Open full answer →
34At 512 GPUs something fails every few hours. How does a training run survive that?▼expertNewNVIDIAMetaMicrosoft2 replies◆ premiumFailure stops being an event and becomes a rate. Once mean time between failures drops below the length of a run, the design question is not how to avoid interruption but how cheaply you can absorb one.Open full answer →
40A coding agent runs in CI and reads pull request descriptions. An attacker opens a PR. What is the attack, and what stops it?▼expertNewGitHubGitLabCloudflare2 replies◆ premiumUntrusted text reaching a privileged agent is the whole vulnerability. It is the pull_request_target mistake again, with a model in the middle that will follow instructions it finds in the data.Open full answer →
50A customer asks what stops their prompts from reaching another tenant on your inference platform. What is your answer?▼expertNewSalesforceSnowflakeMicrosoft2 replies◆ premiumShared batching puts two tenants' data in one process on one device. That is defensible, and it is not what most customers assume they bought, so the answer has to be specific about which boundary exists where.Open full answer →