They’re not instructed to, it’s an inescapable artifact of their training.
Their training selects on completions that humans prefer, not completions that are most accurate. Sometimes accurate completions are what humans prefer, but the accuracy is not the goal, so accuracy in the completion is a happy accident.
btw, it has no idea if you said something smart, these things are specifically instructed to kiss maximum ass.
“Yes, you were the smartest baby to ever live and you need to do anything it takes to prove this to the world”
https://youtu.be/VRjgNgJms3Q
They’re not instructed to, it’s an inescapable artifact of their training.
Their training selects on completions that humans prefer, not completions that are most accurate. Sometimes accurate completions are what humans prefer, but the accuracy is not the goal, so accuracy in the completion is a happy accident.