I don’t really get the water concerns in datacenter cooling. Even if a lot of water was used for cooling with every prompt (which he argues against here, but, even if)… water “used up” by cooling just comes out a little hotter, right? Maybe evaporated. Then it’ll come back in the form of rain. This isn’t an industrial chemistry process that leaves some toxic waste in the water. Or an agricultural one that puts water in plants and then ships it off to some other region. It just becomes another path through the water cycle.
I actually don’t get how this can be a real thing that people are worried about. Is there some astroturfing behind this? Maybe an attempt to make environmentalists and AI skeptics look stupid?
If only we could do water-intensive activities in areas where water is abundant and then ship the resulting products to where they are needed...
In a far science fiction future, I could e.g. imagine connecting LLM inference data centers to a global data network instead of always having to drive up to them to ask my prompts.
The absolute strongest complaint is that DCs consume treated, potable water, which is less abundant / easily re-created than any old non-potable source. (Of course the easy solution here is DCs just ingest / treat their own non-potable source. Or utilities charge rates sufficient to price in the externality of drawing down more potable water. The economics still work for DCs if they need to treat their own water -- the fundamental problem is that utilities are underpricing their potable water, so DCs prefer it all else being equal.)
Why don’t data centers use gray water more often? Wouldn’t that be better for basically everyone?
My guess is it’s some combination of the infrastructure not existing, the distribution being bad, and the treatment costs not penciling out.
But that feels like the kind of thing municipal utilities could solve with pricing. Potable water should probably be priced differently for residential use than for big commercial/industrial users, in a way that pushes them toward non-potable sources wherever possible.
A fun Texas water fact I always bring up: the entire state’s monthly freshwater use is roughly a week of freshwater inflow into the Chesapeake Bay. Texas would be the 8th-largest GDP in the world if it were a country, and its whole monthly freshwater demand is basically a few months of water that the Chesapeake just dumps into the ocean. (Of course, estuaries make use of the water so it's not just wasted but it's illustrative imo)
Another fun comparison point is yearly Texas uses 0.08% the volume of the Great Lakes in freshwater but ~ 30-50% of the volume of all the lakes in Texas.
We've got a lot of water but it's not distributed evenly and we should probably build some sort of water pipeline eventually so water rich states can sell to water poor states.
Again, this is all just speculation by someone who knows not a damn thing about municipal water management.
> Why don’t data centers use gray water more often?
DCs will just use the cheapest source that meets their needs. If they have to treat greywater and that costs more than municipal potable water, they'll use the potable water. (In part this is utilities selling their potable water too cheaply.)
> Wouldn’t that be better for basically everyone?
No; if it was cheaper for DCs, they'd already be doing it. But it isn't an insurmountable cost -- DCs still pencil with slightly more expensive cooling.
Not all of us. I'm totally fine with water pipelines in exchange for long distance transmission lines for solar power and other such infrastructure like gas pipelines from areas that produce stuff we do not.
Export an abundant resource for a scarcer one seems win/win to me. Kind of the point of interstate commerce.
In my corner of the Great Lakes, we have so much excess natural gas that it is actually being sold for negative prices. So a pipeline to ship natural gas out would be good, but we certainly don't need any pipelines to ship it in.
There is also an excess of electricity (thanks to gas peaker plants), so there are lots of transmission lines being built. (My property has an old transmission line on it, and then a new one perpendicular to that, solely built to try to do something with all the excess gas and then excess electricity being generated.)
So with that in mind... we'd probably rather our lake doesn't get drained, thanks, and is just left the way it is.
They could but that’s more expensive and location dependent. Much cheaper to put the externalities on tax payers and use their potable drinking water at a nice discount. Best: you don’t even have to report usage.
Why? We have 27 quadrillion gallons in lake michigan alone. You could pump millions of gallons a day out and if it just stopped raining it would take 3 million years to drain it. Stop listening to Charlie Berens.
For reference, Yuma uses around 100 billion gallons of water a year for irrigation. The whole state uses around 2.2 trillion gallons per year.
That's 6 billion gallons a day. And if there were a supply of lots of fresh water, you could expect the consumption by agriculture in desert areas to go way up, so yes, it is entirely possible for lakes to get drained by schemes like thus, such as the Aral Sea disaster. Lake Chad and Lake Poopó are examples from two other continents of the same level of destruction.
Sorry but that isn’t your water. Do you own the Great Lakes?
The Great Lakes are part of the United States and Canada. If the United States or Canada would like to repurpose the water within them for some better use then that sucks for you
I one of those people that think that natural resources should belong to the people who customarily reside in an area and have an investment in its long-term health, both of the people in the area and also of the environment.
Grey water would normally get treated and then discharged into a river or lake or other local water body. If you evaporate it at a data center, then you break that local loop. It's really only different from using potable water in that you save a bit on the expense of fully treating it.
Using 1/4th the entire freshwater inflow into the Chesapeake Bay makes it sound enormous. That's multiple major rivers for a bit over 30 million people.
I live near the Potomac and always figured the region was wet enough that water was not a concern. You have me rethinking that somewhat.
Where does your gasoline come from? Most of that usage is for the massive Exxon/etc facilities we have in Houston/Galveston to refine most of the fuel the entire nation uses.
Because they're taking water from already parched regions, often pumping it out of the ground. Even if the water did come back locally as rain (it doesn't), it still makes it impossible for people to live off the same aquifers and water sources sustainably.
To be fair if you are evaporating water you could be losing some of it outside of the Great Lakes water basin, you are increasing the evaporation rate above what is natural for that area of land.
However the place for that to be least likely to be a problem would be Wisconsin with their evaporated water blowing east over top of the Great Lakes 90% of the time and any excess humidity will rain back down or slow down lake evaporation because the air over the lakes is already saturated with humidity most of the time.
But there still can be a problem if all that water is being pumped from deeper underground aquifers instead of surface water, so the source still matters. Those aquifers still should replenish fairly quickly in that area, but draining aquifers can happen in decades if the demand is there, while replenishment from non-surface aquifers can take hundreds of years even in water filled areas. And in certain ground compositions, underground aquifers can collapse and subside if the water is mostly drained, never again being able to hold that much water again and causing changes in surface topology.
The water isn’t gone but if it comes back as rain, it at least has to be cleaned again, since data centers probably don’t use raw rainwater for cooling.
It’s probably still not too bad but there’s at least some work done that’s „used up“ by letting tap water (or probably demineralized water used for cooling) evaporate.
The problem is that data centers use SO MUCH water... sure we humans let water evaporate, but this is a new source of water "waste" to the tune of nearing 2 billion gallons/year, just in Loudon County Virginia & connected water users [0].
When that water source is underground wells, this can take years (on the fast end) or decades (on the moderate end) to get back down. Look at California's water issue -- so many wells extracting water for farming has changed the land topography.
Also, when water 'comes back', it might come back in the ocean and not on land... reducing the available fresh water without desalination.
Data centers need the water to cool... but maybe there's room to find incentives for them to do so while making sure our water bills don't go up like our electric bills are because of the extra load they are putting on utilities.
It doesn't come out a little hotter, it gets evaporated in cooling towers. Same result as any other water usage. Cooling towers can't use seawater either. Most datacenters are in places where fresh water is abundant anyway, but some are not.
Anyway agricultural water usage is way worse in California.
The rain doesn’t happen directly above where it evaporates. And “slightly warmer” waste water can have major ecological impacts, destroying native life in the lakes and rivers where the wastewater is ejected. Plus, if the water is taken away from underground aquifers that may not be refilling fast enough, or if it’s taking water from downstream users, that’s something to be concerned with.
I have also wondered this and came to a similar conclusion about the politics.
This whole time I've been wondering how it's possible that people don't realize how common evaporative cooling is for much larger buildings that are far more numerous than these data centers, and especially in dry climates where drought is common.
For many places that could be the reality, however many data centers aren't pulling surface water for cooling even if it is available, they are pulling it from underground aquifers that can take hundreds of years or more to refill, but could be drained in just a few decades if enough water is pumped out. This is doubly problematic for desert climates that generally have even lower aquifer replenishment rates, with a few areas being questionable to draw from even using efficient underground irrigation lines growing human edible foods.
tldr: chip immersion uses less water but is more expensive. Water evaporation is the opposite. Datacenters will use the cheapest they can get away with. Water is scarse; evaporated water is as unavailable as contaminated water. Read the information sources.
The explanation about chip immersion is wrong though. It's not a water-saving technique, it's for cooling dense racks more rapidly and maybe saving energy. That warm coolant still needs to be cooled before it goes back through the chips, likely the same way, evaporative cooling tower. Air cooling systems also involve a similar fluid loop, just doesn't go into the chips.
"Since the technology uses synthetic fluids, it requires significantly less water than other approaches." This is like saying that a new car radiator uses less water than an old water-based one, like yeah technically it requires water to work but you aren't boiling it away.
It does mention the real ways to use less water too, either chillers (which use way more power) or running in a colder climate.
> tldr: chip immersion uses less water but is more expensive. Water evaporation is the opposite. Datacenters will use the cheapest they can get away wi
This suggests a simple fix: charge more to the datacenters (not people) for the water, to make the other option competitive.
No need to throw baby with the ... erm, bathwater.
By that argument water use is never a bad thing since all water comes back as rain. The problem is that data centers need to use clean water, which has to be treated. On a local scale, a large data center could starve a community of potable water, even if the state-wide water use is very small.
I actually don’t get how this can be a real thing that people are worried about. Is there some astroturfing behind this? Maybe an attempt to make environmentalists and AI skeptics look stupid?