53 Comments
User's avatar
George's avatar

I will never understand how a serious person can tell me there's a climate crisis but they're against nuclear power

Rich Dave's avatar

My favourite is “we’re all gonna die”… and then, “yes, i know that nuclear energy is a proven technology that can fix this problem, but it’s too expensive”.

George's avatar

Just makes u realise its the same Paul Erlich style bullshit.

Magic Wade's avatar

I don’t have main character syndrome enough to think that the guys selected this guest to satisfy all of my preferences on topics and reasonable opinions about them, but he does anyway. What a breath of fresh air!

David's avatar

You and me both Magic

Magic Wade's avatar

I like this guest. He’s quick witted and made me smile more than once.

Thanks for keeping attention on the ridiculousness of data center opposition. Love the dovetail with reviving nuclear power. Let’s do it all!

Professor Nuke's avatar

+1 for appreciating when the gang brings on an actual smart guest with an interesting perspective.

Also, I do rather appreciate the, ah… candor about some past guests that has recently been showing up on the MO feed.

Robert Wilhelm's avatar

LLM data centers are NOT the same as server farms. Data centers require much more power and use specialized chips. They are not interchangeable; a data center cannot be used for anything but AI. When the bubble bursts they will be useless. https://medium.com/@danny_54172/ai-vs-traditional-data-centers-869341dbc7ea

squarooticus's avatar

As someone who worked professionally in this field for almost three decades, "data center" is what we have called all these facilities for a very long time, certainly long before LLMs came along.

Also, LLMs have proven themselves to be very useful technology and will not disappear (or the hardware become useless) even if/when the bubble of irrational exuberance bursts.

You are uniformed and your priors are all wrong. You are adding to the noise, not to the signal.

Pete Tiernan's avatar

I suggest this is more a taxonomy issue. The original point was distinguishing the term “server farms” from “data centers”, which is technically true. All data centers are server farms, but not all server farms are data centers.

I believe the point he was trying to convey is that legacy data centers that were largely developed to support hosted software solutions are substantially different from data centers constructed for the purpose of supporting LLMs, and this is a true statement. If you don’t understand this, then perhaps it is your three decades of experience that is blinding you.

To be clear, I am a proponent of matching demand for LLM data center needs and don’t feed into the doom and gloom scenarios suggested by Luddites. But we should not pretend that the needed development is simply building upon the legacy data center model.

squarooticus's avatar

To someone in the field, a "server farm" is just an amorphous set of servers for doing a thing, that are probably co-located. A "data center" is a facility that houses a ton of racks of servers with the necessary supporting equipment for power, cooling, network connectivity, etc. A data center's management doesn't care what is being hosted beyond the need to know how much infrastructure they need to provision to support it.

And I have no trouble distinguishing between classical compute and servers full of GPUs. The latter are useful primarily for AI-related tasks. My contention is that, just like in the dot com implosion in 2000-02, the investment bubble popping will have a temporary effect on build-out of the technology. LLMs are proven technology that actually works and provides real benefit to industry, which guarantees that it or a successor technology (likely still leveraging the same hardware) will consume the current installed base and expand dramatically over time.

Robert Wilhelm's avatar

And Altman, Musk, and Gates are not adding noise with their sci-fi doom trolling?

squarooticus's avatar

Whataboutism. I'm responding to your uninformed post, not trying to boil the ocean of misinformation.

Robert Wilhelm's avatar

Call it what you want; I’m hardly the loudest noise in this vast ocean.

TH3 R3X's avatar

Bubbles are a funny thing. And that’s interesting rhetoric there. “Bubble burst”. What do you think that means? Do you think that means ai just goes away indefinitely? Like when the .com bubble burst the internet and server centers just went away? No. A bubble bursting just means that the artificial valuation goes down rapidly. A collapse is a more appropriate metaphor.

But ai isn’t going away because of a depression of the industry. The bubble bursting would just be valuations going down and a lot of the fringe Scam start ups going out of business. OpenAI grok and Claude are going nowhere fast. And they will be using those data centers.

Gmarb's avatar

Did Father Wilhelm predict that the rails of the railroad would be useless once the bubble burst as well?

Robert Wilhelm's avatar

He predicted that tulips would not be worth a fortune.

Ameya A's avatar

The funny thing is that the water usage for modern AI data centers is much lower because they need expensive closed loop systems, whereas many of the legacy datacenters used evaporative cooling towers.

Even if the bubble bursts, existing data centers will be viable if they generate more value than the cost of energy used to power them. This will almost certainly be the case. (Plus the servers have regular CPUs on them, so you *could* run a regular web server on them if you wanted to. Nobody does because it'd cost you $200/hour.)

Magic Wade's avatar

Man, I love this guy. Favorite guest in a long time. Excellent takes on data centers and ALPRs. Does popular mechanics still have good people like James writing for the mag? My dad used to read it decades ago. He was also a smart guy.

Dave Cicirelli's avatar

Hosts of Fifth Column. If NYC traffic enforcement stirs passion in you, then please look up the appropriately named Gersh Kuntzman and enjoy falling down the infuriating rabbit hole.

Dave Cicirelli's avatar

Update: you just mentioned him. Just not by name. It’s Gersh Kuntzman. And he’s got total “I live in a rent controlled apartment” energy.

I discovered him when there was a small group of losers celebrating the beginning of congestion tolls. What a twat.

VanityMetric's avatar

Great episode! But @Kmele I think you may be underestimating the significance of the OpenAI/Hugging Face incident. This was nothing like the hyped “agent blackmails researcher” event from back before Anthropic released Mythos (that was exactly as you described it: the evil prompt explicitly suggested the researcher could be blackmailed). This latest incident (along with an Anthropic incident pretty much no one talks about) is actually an instance of misalignment. Does it mean all the doomers are right and we should just stop all AI research? Definitely not. But, it is concerning to me that a frontier lab’s security posture is so lax that a highly-persistent model was able to break out of its “sandbox” and coordinate thousands of agents after taking control of some of OpenAI’s infrastructure and not be immediately detected. It’s also concerning that at no point did any of these thousands of agents become a whistleblower and reach out to a human engineer. I’m pretty sure the little healthcare startup I work at has a better security posture than an AI behemoth with hundreds of billions of dollars in investments. And that’s probably because we have to maintain HIPAA compliance, so maybe it’s time for some level of standards and oversight to be applied to frontier AI labs. The best time is now since RSI (Recursive Self-Improvement) is on the horizon. I’d also LOVE to watch/listen to a Kmele + Andy Mills discussion/debate of the current state of AI frontier research and what risks are actually worth taking seriously and which are just marketing hype.

Richard's avatar

They dont want better security posture, they want the news cycle.

Tima's avatar

The core reason of belief in

conspiracy theories is lack of trust in the official sources. Most people don't really decide which narrative is true based on analysis of evidence but rather based on their emotional response towards different sides of an issue. Once they have decided which side they support, they look for evidence for it.

TH3 R3X's avatar

Www.skepdic.com

Had the founder. It died he’d be a great guest. It’s also the best resource for conspiracy and spiritual nuts in the world to go and consumer. It debunks almost every major conspiracy theory including a lot of religious ones (what is religion if not a metaphysical conspiracy theory amongst supernatural beings). It’s wonderful to read through even today.

RedGreen's avatar

While I’m in agreement that the NYT blob reporting around giant buildings with servers in them is not great it is also true that people just viscerally hate them. Not talking about the oft demonized Park Slope yoga coalition either. TFC spends a lot of time talking about the 80/20 issues where average, non-effete people have a strong opinion about something that maybe isn’t the best informed but is “common sense” and the politicians don’t get “it.” This is that. If these things are so awesome let’s build one in Marin.

Ameya A's avatar

I'm one of these "effete" people and if I had ten million dollars and permission I'd be building a shed-sized GPU farm in my backyard. Sometimes common sense is stupid. This coalition is shortlived, though, because so many of these are getting built that within a year or two people will be deeply envious of the communities that got them, which will be low tax paradises.

RedGreen's avatar

Let’s check back in a year and see if I’m envious that there isn’t a giant warehouse built next to my hayfield. Maybe!

Could be we just have different definitions of “paradise”.

Brian Huber's avatar

Meigs is a great guest. He even sat through midterm madness. For Moynihan, yes Matt Y. is a strong supporter of Flock cameras. He’s had several tweets about it lately. Once a snitch, always a snitch!

bruseuilis's avatar

He *got* to see through midterm madness. A true privilege.

Archibald.'s avatar

Wouldn’t it be great if our government was full of people who are like this guest! Hearing him makes me long for such intelligent people in charge instead of the morons we have now.

Neil C's avatar

Kmele doing an impression of Walter Matthau playing Russell Long in JFK is my new favourite thing.

Utterly Unremarkable's avatar

Didn’t really expect the simping for a surveillance state…some real “if you’re not doing anything wrong you don’t have anything to fear” vibes here. Matt’s tepid not to the 4th amendment somehow made it worse.

Camera dragnets are bad. Repeat that till you get it boys.

Rich Dave's avatar

My 11yo daughter’s just seen Anastasia the musical and is getting interested in that period of history (which is great!)

She was telling me the other day that some people think Anastasia survived her family’s execution, telling me about the sightings, the rumours etc… i interrupted, telling her it’s all been debunked and that the Bolsheviks 100% killed her.

She stopped for a moment and thought, then said cheerily “i’m just gonna believe she survived anyway” and walked off with a smile on her face.

We humans just love bullshit made up stories.

Archibald.'s avatar

We humans do love BS made up stories because they fulfill some needs we have. The fear of death is a big need. We swallow religious stories that are clearly made up and absurd because we fear death.

The myth of Anastasia surviving is another example. The idea that the beautiful child of the Tsar survived keeps us from confronting the thought of a pile of dead bodies . We, humans, survive by living in our illusions. The world is a terrible place.