It’s just weird that we get so much humanlike reasoning from them, anyways. The jury’s still out whether our brains learn in an autoregressive manner like that, too. I’m finding a lot of really cool results in my research by tinkering with the idea that a developing brain might just be constantly trying to guess what’s happening next.
Seems pretty plausible to me that passive learning in humans works similar to next-token prediction in transformers.