Discussion about this post

User's avatar
Richard Self's avatar

"If there is an AI (LLM) bubble, what happens to the infrastructure? That’s what I will return to next."

Is there any use for millions of high-powered GPUs?

There will be many useless data centres in the wrong places.

LLMs do not need to be near their users, almost all other technologies need to be close to their users.

LLMs response latency is of the order of tens of seconds, All other technologies need to respond in one to two to three seconds. Communication latency doesn't matter for LLMs, but it is critical for all other technologies.

Expand full comment

No posts