Humans can turn information into knowledge. AI can only extract predigested knowledge. That’s why they need such large data sets.

This is also why AGI is still a pipe dream. Most of the subsections already exist, but without a knowledge engine at its core, it’s like a person with a massive concussion. It sounds reasonable to simple conversation, but goes off on weird tangents.

I always find it fascinating to watch children learn and grow. The mistakes they make are often completely logical, they just have holes in their knowledge, and lack critical information. It leads to wonderful conclusions, which are also completely wrong.