- Service code
- BH-MNT-01
- Family
- Maintenance
- Cadence
- Continuous telemetry review, monthly on-site inspection, quarterly deep audit
- Response
- Thermal excursion acknowledged in 30 minutes; on-site response within 4 business hours at affected facility
Overview
Accelerator racks at 40–130 kW behave nothing like the 8 kW general-compute racks most facilities were designed around. Hot spots develop at the rack and row level long before a facility alarm fires, and the first visible symptom is usually silent clock throttling rather than a shutdown. This product instruments the cooling path end to end — from chiller and CDU through to per-node inlet temperature — and schedules intervention on predicted drift rather than on observed failure.
What is covered
- Baseline thermal mapping of every rack, cold aisle and return path under representative load
- Inlet and outlet temperature instrumentation at accelerator node granularity
- Coolant loop inspection: CDU performance, flow balance, delta-T across the rack, and coolant condition sampling
- Air-side audit where liquid and air cooling are mixed: blanking, containment leakage, bypass and recirculation paths
- Correlation of thermal drift against observed throttling events and utilisation loss
- Filter, coil and strainer replacement scheduled from measured pressure drop rather than calendar
- Setpoint review against manufacturer envelope and workload profile
Deliverables
- Thermal baseline report with per-rack kW density and delta-T profile
- Drift register: every anomaly, its predicted trajectory and the intervention it triggered
- Quarterly cooling-efficiency review with recommended setpoint changes
- Escalation runbook for thermal events, mapped to your on-call rota
Who this is for
Operators running sustained training loads where a few degrees of drift translates directly into lost GPU-hours.
Specification
- Rack density supported
- Up to 130 kW per rack, liquid or hybrid cooled
- Instrumentation granularity
- Per-node inlet/outlet, per-rack, per-row, per-CDU
- Drift detection window
- 7-day rolling trend with 48-hour forward projection
- Coolant types
- PG25, deionised water, single-phase and two-phase dielectric
- Reporting cadence
- Monthly drift register, quarterly efficiency review
Related services
| Service | Scope |
|---|---|
| Power Distribution & UPS Upkeep | The utility path to the rack, maintained so that a single component failure never becomes a training run. |
| Accelerator Fleet Lifecycle Maintenance | Node-level servicing for accelerator fleets, measured against the metric that matters: good GPU-hours delivered. |