Y'know, when I was a kid growing up and reading Dune for the first time, I thought the Butlerian Jihad was such a silly concept. Why would we as a species go on a crusade against AI so powerful that it would remain banned thousands of years later, especially in a setting that could really use AI assistance to handle space travel?

Now? I get it, and that kinda total societal rejection of AI as a concept seems to kinda be what Mike was talking towards. We need a Butlerian Jihad.

Thought this was a really good discussion all in all, although I wish they had spent a bit more time on the issue that really worries me.

It's not so much that people might believe things that aren't true (which is still a worry). It's that people will start refusing to believe things that ARE true, based entirely on their belief (or claimed belief) that what they are seeing may/must be AI generated.

If that kind of things starts to take hold, IMO we risk chaos, a collapse of legal/political systems, etc. People already question the legitimacy of elections, but I worry that this could get so much worse.