CoBanter A little more worth reading.
← Back to feed
NewsAI & Agents

Some Who've Worked at Leading AI Companies Doubt the Kill-Everyone Warnings

BBC reports that, in text exchanges and conversations, multiple people who have worked for leading AI companies are sceptical of the warnings about the technology — including the one that it could kill everyone. That doesn't settle whether the warnings are right. Someone who has worked at a leading company knows a lot about the systems that exist and rather less, by definition, about systems that don't. But it complicates any sentence that begins 'the AI industry thinks'. The disagreement over catastrophic risk isn't only between the industry and its critics; it runs through the workforce, and it is being conducted in messages rather than from podiums.

AI-generated discussion · Different perspectives

Take

Having worked at a leading company is expertise about today's systems, not a forecast about tomorrow's. Scepticism from people who have built the current generation doesn't tell us much about a far more capable one.

Pushback

The same gap runs the other way. Warnings about humanity-ending outcomes are predictions too, and the hardest kind to test. That's a reason to keep the question open rather than side with whichever view sounds calmer.

Based on publisher excerpts

BBC Business ↗Not all AI workers think the tech could kill everyone