I think it’s intellectually lazy to stick with the stochastic parrot line of thinking now. There’s a number of emergent properties that are appearing as LLMs scale that give them abilities beyond that paradigm. Check out the “Sparks of AGI” paper from Microsoft research - or more realistically one of the youtube summaries of it since its quite a big read… Here’s one from the horse’s mouth: https://m.youtube.com/watch?v=qbIk7-JPB2c
I think it’s intellectually lazy to stick with the stochastic parrot line of thinking now. There’s a number of emergent properties that are appearing as LLMs scale that give them abilities beyond that paradigm. Check out the “Sparks of AGI” paper from Microsoft research - or more realistically one of the youtube summaries of it since its quite a big read… Here’s one from the horse’s mouth: https://m.youtube.com/watch?v=qbIk7-JPB2c
Removed by mod
The other really interesting thing is what happens when you get them talking to each other. They show similarly fascinating emergent properties.