The false positive rate is pretty low, but a false negative of 35% is pretty concerning in terms of whether they’re fit for purpose. Like it’ll rarely misclassify human writing as AI generated, but it’s somewhat closer to a coin flip in correctly identifying AI generated language. It’s a signal, but I imagine it’s a poor substitute for the judgement of a person who has spent time teaching teenagers / young adults to write.
Which to the original point isn’t totally snake oil, but it’s maybe not a great tool for the professionals who it’s targeting.
The false negative rate for creative writing is exceedingly low as well, sub 1%. False negatives aren’t the critique of this meme, and the examples I gave for GPTZero were worst case scenarios for very specific types of technical writing.
Props for responding constructively.
The false positive rate is pretty low, but a false negative of 35% is pretty concerning in terms of whether they’re fit for purpose. Like it’ll rarely misclassify human writing as AI generated, but it’s somewhat closer to a coin flip in correctly identifying AI generated language. It’s a signal, but I imagine it’s a poor substitute for the judgement of a person who has spent time teaching teenagers / young adults to write.
Which to the original point isn’t totally snake oil, but it’s maybe not a great tool for the professionals who it’s targeting.
The false negative rate for creative writing is exceedingly low as well, sub 1%. False negatives aren’t the critique of this meme, and the examples I gave for GPTZero were worst case scenarios for very specific types of technical writing.