A few years ago with ARM arriving at the data centers I envisioned there would be a day that density would go up and new data centers would be less in demand. I’m either too early or wrong.
I’m thinking you might have been wrong. Even without AI, I don’t foresee demand for compute going down. Even if everything went over to ARM, I think that would have just slowed the rate of new builds.
Working for a fairly large open source project and we began testing arm hardware for in house use and it was ridiculous how much compute we could fit in the same U space.
We were doing nothing with GPU though, so CPU and memory speed was our bottleneck.
We were definitely more compute dense with our arm cluster but we couldn’t get as large. Yet. Maybe it’s changed now
In economics, the Jevons paradox, or Jevons effect, is said to occur when technological improvements that increase the efficiency of a resource’s use lead to a rise, rather than a fall, in total consumption of that resource.
Unfortunately using less of a good thing isn’t how we do things.
A few years ago with ARM arriving at the data centers I envisioned there would be a day that density would go up and new data centers would be less in demand. I’m either too early or wrong.
I’m thinking you might have been wrong. Even without AI, I don’t foresee demand for compute going down. Even if everything went over to ARM, I think that would have just slowed the rate of new builds.
Working for a fairly large open source project and we began testing arm hardware for in house use and it was ridiculous how much compute we could fit in the same U space.
We were doing nothing with GPU though, so CPU and memory speed was our bottleneck.
We were definitely more compute dense with our arm cluster but we couldn’t get as large. Yet. Maybe it’s changed now
Unfortunately using less of a good thing isn’t how we do things.
Also known as induced demand. Most of a thing drives more demand for that thing.
ARM for big compute isn’t much more efficient than x86.