Sometimes a journal editor tells me, with the serenity of a seasoned customs officer, that they can always recognize a manuscript written with the help of AI. Colleagues say the same over coffee about student essays. The tells are recited like a liturgy: the word “delve,” adjectives marching in threes, the paragraph that ends on a note of cautious uplift, a voice sanded down until no grain remains. The short sentences for emphasis in a trope "it is not this. Is it not that. It is something else." Reviewers mourn a flattened cadence, polish laid over a hollow. I do not doubt that these readers have met such texts. I doubt the verdict they pronounce afterward.
Skeptics have a name for this error: the toupee fallacy. Its canonical form runs, all toupees look fake, because I have never seen one that did not. The flaw surfaces the moment the sentence is spoken aloud. A toupee that succeeds is a toupee you never noticed. The speaker has inspected only the failures and from them has drawn a general theory of hairpieces. The term’s lineage is murky. It appeared on the Skeptics’ Guide to the Universe podcast in August 2006 as a “name that fallacy” puzzle, and at least one catalog of fallacies credits Rebecca Watson, the founder of Skepchick, with coining it. Natalie Reed carried it further in 2012, using it to dismantle the claim that trans women are always discernible in public. The deeper structure belongs to Nassim Taleb, who called the missing cases “silent evidence,” and before him to Abraham Wald, who told the Navy to armor the unscarred parts of returning bombers, since the planes struck there never came home.
Transpose the structure onto scholarly writing. An editor who claims to detect AI assistance has detected something narrower: AI assistance done lazily. The author who pasted an abstract into a model and submitted the output unread. The literature review with “Certainly! Here is” still clinging to its first line. These manuscripts betray themselves, and the betrayal is real. But the leap from them to a general claim about AI-assisted prose is the leap from bad toupees to all toupees. The author who drafted with a model, then pruned the triplets, restored her own rhythm, replaced generic citations with ones she had actually read, and reread the whole thing twice, produced a paper the editor accepted without a flicker of suspicion. The editor did not count her; she is the silent evidence.
My own position spares me the dilemma. I urge students to use AI freely, so detection is a game I never have to play. The claims I hear come from people whose work is gatekeeping, and gatekeepers are especially prone to this bias, because the only cases that reach their attention are the ones that trip the wire. Describe to them the competent, undetectable submissions and the reply arrives on cue: those authors must not have used AI much. That reply is the fallacy tending its own garden, reclassifying the disconfirming cases so they cannot be counted.
Most complaints about AI prose, examined closely, are complaints about mediocre human prose that editors have been rejecting for a century; what changed is volume. A model produces the median text of its training data effortlessly, and the median of the internet is beige. Publish it unedited and the reader meets a flood of beige, then names the flood after its source. So when a colleague tells me the AI texts are everywhere and all dreadful, I grant half the sentence. The dreadful ones are everywhere. The rest sit in the same issue, unnoticed, wearing hair piece that fits.

No comments:
Post a Comment