this is what I keep trying to tell the AI bros but they just won't listen. AI isn't thinking. It isn't gathering new information and creating new things from it. Yes, it makes us redefine what "learning" is, but I've had some real annoying conversations with people even here on Lemmy that think AI is truly "learning".

It's not. It is only an approximation of probabilities of what it was trained on. If you tell an AI that 2+2 is 5 and train it on that it will start to tell you that 2+2 is 5. It doesn't have the complexities to know that you're adding anything, it doesn't have nuance, it doesn't actually learned. It is a summation of what it has been trained on.