Discussion about this post

User's avatar
Sara's avatar

This was a really interesting read - as someone who does not live in Silicon Valley and mostly follows the progression of AI through mainstream news outlets and daily interaction with public models at work, it's hard to tell from the outside how much of these predictions are worth feeling worried about. In the vein of some other commenters, you have to wonder whether these beliefs in handover or humanity being made obsolete by AGI are fuelled by the hubris of researchers who haven't ever had to encounter the inertia and human friction that comes from trying to change human systems.

Recent instances of cyber attacks, etc. are troubling, but for an outsider, it's hard to understand how the future that the leaders you've described imagine will actually come to be, in a realistic "this happens then that happens" way. In the time you've spent in these circles so far, do you feel that there are credible answers to these questions, or is it mostly just prophecy?

Brady Dale's avatar

I really just think every conversation about AI is driven entirely by anxiety. And even the people who are the closest to the products really have no idea what’s going to happen. Just as so many inventors haven’t really known what the most profound inventions would actually do or how they would be used. It is all just guesses. No one is in a better position to make the guest than anyone else. It’s a true horizon.

Which makes all the conversations about AI these days kind of exhausting, Because no one wants to talk about what they actually do know. All the conversations dissolved into the question that nobody can answer: what’s going to happen?

I take comfort in the fact that society has been on any number of precipices before, and we have rolled on.

An apocalypse is coming. I think that’s obvious. But it’s important to remember that the apocalypse is a myth. It isn’t literally true that in an apocalypse everyone dies. It just means that after the apocalypse is over no one can really identify with the person they were before. It is as if they’ve died, but we all live on.

88 more comments...

Ready for more?