cannot confirm. have used chatgpt many times to check my physics homework (after doing it myself first) and it was basically correct about 90% of the time.
I can’t say that particularly shocks me. I imagine that Chat GPT has probably swallowed dozens of Physics textbooks.
The bigger part of the problem is knowing where we are on the human knowledge novelty / training data available curve, or rather, when we need to get off of the ride.
Edit: Any chance your chosen AI has access to Wolfram Alpha as an MCP Tool? Because that would be very different, too.
If it’s successful at math, there’s likely much more than a leanring model in play.
Which brings us back to the opacity problem. :(
If the answer machine has been cleverly rigged (and weighted) to pass off math questions to more capable software, things can be great.
But a person who just hears that AI can do math now can have a very bad time if they go blindly use a brute force pleasant answer machine on a math problem. :(
cannot confirm. have used chatgpt many times to check my physics homework (after doing it myself first) and it was basically correct about 90% of the time.
these were not standard exercises (i think)
Thanks. I think every data point helps people.
I can’t say that particularly shocks me. I imagine that Chat GPT has probably swallowed dozens of Physics textbooks.
The bigger part of the problem is knowing where we are on the human knowledge novelty / training data available curve, or rather, when we need to get off of the ride.
Edit: Any chance your chosen AI has access to Wolfram Alpha as an MCP Tool? Because that would be very different, too.
If it’s successful at math, there’s likely much more than a leanring model in play.
Which brings us back to the opacity problem. :(
If the answer machine has been cleverly rigged (and weighted) to pass off math questions to more capable software, things can be great.
But a person who just hears that AI can do math now can have a very bad time if they go blindly use a brute force pleasant answer machine on a math problem. :(