Ai-OPs
Ai-OPsKOIOS PLATFORM
Technical White PaperData Center Cooling Optimization
PUE & WUE Optimization · Reinforcement Learning

Lower PUE and WUE together, on the cooling plant you already run.

Cooling is the largest controllable overhead in a data center, and the two numbers that measure it, PUE (power) and WUE (water), are usually in tension. Koios runs a reinforcement-learning controller that holds the thermal envelope while continuously trading power against water to the balance you choose. It is hardware agnostic and control-system agnostic, deploys today on top of your existing plant, and starts producing value without ripping anything out.

+7.8%
PUE savings, peak season
cooling energy vs. tuned PID baseline
+38%
WUE savings, same run
water and power cut at the same time
0
envelope violations
held inside 18–30 °C across 7-day tests
Today
time to first value
any hardware, any control system
Executive summary

Most cooling plants are run by rule-based and PID control with fixed setpoints. That control is safe, but it is static: it cannot anticipate the weather, it cannot read a time-of-use tariff, and it has no notion of the power-versus-water trade it makes every minute. When the outside air gets hot, a PID loop simply commands more fan and more water until it saturates, and PUE climbs to its ceiling exactly when energy is most expensive.

Koios replaces that static policy with a learned one. A Proximal Policy Optimization (PPO) agent is trained against a physics model of the hall and a shaped reward that puts thermal safety first, then prices in energy, water, actuator wear and time-of-use cost. The reward is the product's main lever: changing a small set of weights moves the controller along the PUE–WUE frontier, so each site, each season and each tariff gets its own balance. This paper details the PPO setup, the reward shape, and a seven-day seasonal validation showing power and water cut together while the cold aisle never leaves its envelope. Koios is hardware and control-system agnostic, so the same policy framework deploys across every site you operate.

Phillip Hansel, Chief Executive Officer
Ai‑OPs · Industrial Intelligence, Reimagined
ai-ops.com
61 St. Joseph Street, Suite 300
Mobile, Alabama 36602
Ai-OPs ·PUE & WUE Optimization
Data Center Cooling

01

Two efficiency numbers, pulling against each other

A data center is judged on PUE, total facility power divided by IT power, and increasingly on WUE, litres of water consumed per kWh of IT. Cooling drives both, and the cheapest way to win one is often to lose the other.

Evaporative and adiabatic cooling spend water to avoid running compressors and fans hard, which lowers PUE but raises WUE. Mechanical and air-side cooling spend electricity to keep water down, which does the reverse. Every cooling plant lives somewhere on this power-versus-water frontier, and the right point on it moves constantly, with the outdoor wet-bulb, the IT load, the price of electricity and the local cost or scarcity of water.

Conventional control does not see that frontier. A fan PID holds a cold-aisle setpoint; an evaporative-cooling PID holds a supply-air setpoint; a damper PID chases free cooling. Each loop is locally correct and globally blind. None of them knows that power is expensive at 4 p.m., that the utility is in a drought surcharge, or that there is thermal headroom to coast. So they hold their setpoints by brute force, and on a hot afternoon they saturate, pushing PUE to its ceiling precisely when a demand charge is being set.

Why this is worth solving now

AI build-outs are pushing rack densities and total cooling load up sharply, water-stressed regions are putting WUE under public and regulatory scrutiny, and time-of-use and demand tariffs make when you cool nearly as important as how much. The gap between static control and an optimum that respects all of these signals at once is now large enough to matter on the bill.

The static-setpoint tax

A PID can only hold a number. It cannot price energy against water, cannot use thermal headroom, and cannot anticipate a hot afternoon, so it saturates at peak and sets PUE at its worst exactly when power costs the most.

PUETotal facility power / IT power. Cooling is the dominant controllable term.
WUEWater consumed / IT energy (L/kWh). Driven by evaporative cooling use.
The tensionSpend water to cut power, or spend power to cut water.
Moves withWet-bulb · IT load · electricity price · water cost
PID seesOne setpoint per loop. None of the above.
The objective, in one line
minimize  cost(PUE, WUE, tariffs)  subject to  Tcold ∈ [18°C, 30°C]  at all times
Hard constraint thermal envelope, never violated Soft objective the PUE–WUE–cost blend you choose Decision fan & evaporative modulation, every 5 min

FIG. 1: THE CONTROL PROBLEM. Safety is a hard constraint; efficiency is a soft, multi-objective cost that shifts with weather, load and price. A learned policy can optimize the second while guaranteeing the first, which is the gap conventional loops leave on the table.

Ai-OPs · Koios Platformai-ops.comPage 2 / 8
Ai-OPs ·PUE & WUE Optimization
Data Center Cooling

02

Deploys today, on whatever you already run

Koios does not replace your control system; it sits on top of it. It connects to the plant over the protocols already in place, reads every relevant point, and writes optimized setpoints back, first as advice, then in closed loop. There is no new hardware to standardize on and no controller to rip out.

Hardware agnostic

Air-side or evaporative, fan wall or CRAH, one vendor's chillers or another's, Koios models the plant from its live points, not from a fixed equipment template. The same agent framework runs on a 2‑MW hall and a 40‑MW campus.

Control-system agnostic

It speaks to whatever holds your loops today, a BMS, a DCS, PLCs, or a hyperscale building controller, as a peer over standard protocols. Koios computes the setpoints; your existing controllers still actuate and still enforce their own safeties.

OPC-UAModbus TCPBACnetEtherNet/IPRESTSQLMQTT

On-prem, air-gapped, no data leaves site

The model trains and runs inside the facility. Live inference executes on the edge in the same Koios runtime that handles connectivity and historization, so latency is low and the control loop never depends on a cloud round-trip. Each site stays autonomous; only KPIs and history travel north.

Sits besideExisting BMS / DCS / PLC, as advisory or closed-loop
SafetiesNative plant interlocks remain authoritative
DeployVM · server · Kubernetes · fully air-gapped
Koios Lensfleet KPIs · data viewing · cross-site analysis
DashboardsKPIsTrendsBenchmarking
Campus A24 MW
KOIOS
edge · control + history + AI
reads tags ↑  /  writes setpoints ↓
DCSPLCSCADA
Cooling plant · fan wall · evap · dampers
Campus B40 MW
KOIOS
edge · control + history + AI
reads tags ↑  /  writes setpoints ↓
DCSBMSPLC
Cooling plant · CRAH · chillers · pumps
Campus C12 MW
KOIOS
edge · control + history + AI
reads tags ↑  /  writes setpoints ↓
SCADAPLCBMS
Cooling plant · evap wall · fans · dampers

FIG. 2: ONE FRAMEWORK, MANY SITES. At each campus a Koios edge node speaks bidirectionally with the existing DCS, PLC and SCADA, reading live tags and writing optimized setpoints while native interlocks stay authoritative. Every campus federates northbound to Koios Lens for fleet-wide KPIs, data viewing and analysis, no site data leaves its facility except the aggregated metrics you choose to share.

Graduated rollout, value from day one

The same policy moves at your pace: shadow (proposes setpoints with no write access, so you compare on your own data) → advisory (operator-surfaced, supervised writes) → closed loop (continuous control inside an operator-set envelope, one-click handback). The side-by-side PUE and WUE comparison is visible before a single setpoint is written.

Ai-OPs · Koios Platformai-ops.comPage 3 / 8
Ai-OPs ·PUE & WUE Optimization
Data Center Cooling

03

The PPO controller

We frame cooling control as a Markov decision process and train a policy with Proximal Policy Optimization, an on-policy, actor-critic reinforcement-learning algorithm that is stable, sample-robust and well suited to continuous setpoint control.

Policy πθ  ·  PPO agent
A neural-net actor maps the observed plant state to two continuous setpoints; a critic estimates value to keep updates stable and conservative.
ACTION a = [ fan_speed , evap_modulation ] ∈ [0,1]²
Environment  ·  the hall
A reduced-order physics model: psychrometrics, an evaporative wall, a fan wall, multi-zone thermal dynamics and actuator lag, stepped at 5-minute intervals.
STATE s · weather, temps, load, forecasts, prices  |  REWARD r
act → step physics → observe → reward → update θ → repeat  ·  500k steps

FIG. 3: THE LEARNING LOOP. At each 5-minute step the policy emits fan and evaporative setpoints, the plant model advances, and a scalar reward grades the outcome. PPO improves the policy over hundreds of thousands of steps spanning every season.

What the agent sees and does

The observation is a compact picture of the hall: outdoor dry- and wet-bulb, per-zone cold-aisle temperatures, supply-air temperature, IT load, recent control history, short forecasts, and two normalized price signals for electricity and water. The action is just two continuous knobs, fan speed and evaporative modulation; regulatory damper loops stay on their own PIDs, so the agent optimizes efficiency without owning safety-critical actuation.

Training spans summer, fall, winter, spring and shoulder weather, with randomized start times, so the single policy generalizes across the conditions a real site sees rather than overfitting one design day.

PPO configuration
Stable-Baselines3
AlgorithmPPO · MLP actor-critic
Rollout / batchn_steps 2048 · batch 128
Learning rate2.5e-4, linear decay
γ · GAE λ0.99 · 0.95
Clip · entropy0.20 · ent_coef 0.03
Horizon500k steps · 5‑min control
Action space2‑D continuous [0,1]²
Why PPO

Its clipped objective bounds how far the policy can move per update, which keeps a controller that drives real cooling equipment from making large, unsafe jumps while it learns. Combined with a reward that makes thermal safety dominant, exploration stays inside the envelope.

Ai-OPs · Koios Platformai-ops.comPage 4 / 8
Ai-OPs ·PUE & WUE Optimization
Data Center Cooling

04

The reward shape is the product

A reinforcement-learning controller does exactly what its reward tells it to. Ours is built as a strict priority stack: thermal safety first, by a wide margin, then a tunable blend of energy, water, smoothness and time-of-use cost. The shape, not the algorithm, is what makes the policy match a given site.

Thermal safetyhard + barrier
Steep penalties outside 18–30 °C, with a quadratic barrier inside the edges. Dominant by design, so cooling is never traded away for efficiency.
−200 … −120
Warn & target bandcomfort shaping
A positive bonus for sitting near the 26.5 °C target with a quadratic falloff; gentle penalties as zones approach the 23 / 29 °C warn lines.
+4 … −10
Energy → PUEenergy_weight
Penalizes cooling-to-IT power ratio, normalized so a 0.2 ratio scores one unit. This is the lever that pushes fan power, and therefore PUE, down.
−wE·ẽE
Water → WUEwater_weight
Penalizes water draw per step. Set it light and the policy leans on evaporative cooling; set it heavy and it shifts toward air-side, raising fan use to spare water.
−wW·w̃W
Slew & smoothnessactuator wear
L1 slew plus an L2 step-change penalty on the action, so setpoints move smoothly and the controller does not chatter the equipment.
−ws·slew
Economics · time-of-usetariff multipliers
Time-varying multipliers scale the energy and water penalties by price, so the policy cools cheaply off-peak and eases off when power or water is dear.
× m̃E, m̃W

FIG. 4: THE PRIORITY STACK. Safety terms are an order of magnitude larger than efficiency terms, so the policy optimizes power and water only within the room thermal safety allows. Every weight maps to a single configuration key.

Composed step reward (safe-band regime)
r = wT·temp − m̃E·wE·energy − m̃W·wW·water − ws·slew − smooth
wT 6.0 temp wE 2.5 energy wW 0.8 water ws 0.2 slew E,m̃W TOU price, clip 0.5–2.0

When the hottest zone runs above the warn line, the controller switches to a cooling-efficiency regime that re-weights the same terms toward removing heat, and the reward floor drops so a genuine excursion is punished hard. The structure is identical; only the weights and clip change. Those defaults, shown above, are the starting point we tune per site.

Ai-OPs · Koios Platformai-ops.comPage 5 / 8
Ai-OPs ·PUE & WUE Optimization
Data Center Cooling

05

Validation: power and water, cut together

We evaluate the trained policy against a carefully tuned PID baseline over seven-day runs with realistic diurnal weather and IT load. In peak summer conditions, the regime where conventional control saturates, Koios wins on both numbers at once.

+7.8%
PUE savings
cooling energy vs. PID, summer
+38.2%
WUE savings
water vs. PID, same run
2.00→1.72
Peak PUE capped
baseline saturates, Koios holds
100%
in envelope
zero thermal violations
Power Usage Effectiveness · summer
PUE · 3-day · lower better
Baseline (PID) Koios (RL)
The peak-shaving result, every afternoon. Each day the PID drives fan and water to maximum through the heat and PUE pins at its 2.0 ceiling, setting the day's worst demand charge. Koios anticipates the diurnal swing, uses thermal headroom, and holds PUE near 1.72 across all three peaks.
Water Usage Effectiveness · summer
WUE L/kWh · 3-day · lower better
Baseline (PID) Koios (RL)
Lower power did not cost water. Across the same three days, Koios meters evaporation against the wet-bulb and cold-aisle headroom, drawing water only when it pays off thermally and falling to near zero overnight, so it spends roughly a third less water than the PID while still cutting energy.
Ai-OPs · Koios Platformai-ops.comPage 6 / 8
Ai-OPs ·PUE & WUE Optimization
Data Center Cooling

06

Thermal safety, then the dial

Across every season tested, the cold aisle stayed inside its envelope, the non-negotiable result. Beyond that, the gains track the weather, and the reward weights set where on the PUE–WUE frontier each site lands.

Cold aisle max temperature · summer
°C · envelope 18–30
Never an excursion. Both controllers hold the hottest zone well inside the 18–30 °C limits. Koios runs closer to the 26.5 °C target, using the headroom conventional control leaves unused.

Gains scale with the heat

The hotter the day, the more a saturating PID leaves on the table, and the more Koios recovers. In peak summer it cut both power and water; in shoulder seasons it banked steady PUE savings; in cold, dry winter, where free-air cooling already makes the baseline near-optimal on power, PUE essentially ties.

One dial per site · the PUE–WUE frontier
reward weights → operating point
Energy weightw E · favors low PUE
2.5
Water weightw W · favors low WUE
0.8
Time-of-use stretchpricing_strength
2.0

Raise wW in a drought and the policy trades water for fan power. Raise wE under a demand charge and it leans evaporative. The same trained framework, retuned in minutes, not re-engineered.

FIG. 5: THE FRONTIER IS A SETTING, NOT A FIXED POINT. Each site, season and tariff gets its own balance of power against water by moving a handful of reward weights, while the thermal-safety stack stays fixed and dominant.

Ai-OPs · Koios Platformai-ops.comPage 7 / 8
Ai-OPs ·PUE & WUE Optimization
Data Center Cooling

07

From one hall to the whole fleet

Koios runs the optimized cooling policy on the edge, inside each facility, and federates the fleet upward for monitoring and continuous improvement, so efficiency gains compound across every site you operate.

What you get on day one

  • A side-by-side baseline. Shadow mode quantifies the PUE and WUE gap on your own plant before a single setpoint is written.
  • A tuned reward. We set the energy, water and tariff weights to your site's economics and constraints.
  • A safe rollout. Shadow → advisory → closed loop at your pace, with one-click handback and native interlocks untouched.
  • Portability. The proven policy redeploys to the next site as configuration, not a new project.

Validation summary

MethodPPO vs. tuned PID, 7-day runs
ConditionsSummer · spring · shoulder · winter
PUE savingsup to +7.8% (peak season)
WUE savingsup to +38% (same peak run)
Thermal safety0 envelope violations, all seasons
Control rate5-minute setpoints, 3-zone hall

Results are from a reduced-order physics simulation of an outside-air / evaporative hall; absolute figures are calibrated against your site's data during deployment.

Honest about the dial

In cold, dry conditions the baseline is already efficient on power, so Koios's headline is water management, not PUE. That is the point: the reward weights decide which number to chase, and you set them per site and per season rather than accepting one fixed trade.

Quantify the gap on your own plant
We connect Koios in shadow mode, benchmark PUE and WUE against your current control, and tune the reward to your tariffs and water constraints, no hardware change required.
ai-ops.com
Phillip Hansel, CEO
Mobile, Alabama 36602
Ai-OPs · Koios Platformai-ops.comPage 8 / 8