Wednesday, June 26, 2024

Chatbots and the Problems of Life

With increasing availability and sophistication of chatbots, we teachers are seeing a drastic decline in the cost of what in Great Britain is called “commissioning”—that is, getting someone else to do your academic work for you. There are many forms of academic cheating, at various levels of schooling, but commissioning by university students is the one I want to discuss today.

Long, long ago, in a pre-Internet galaxy far away, commissioning was costly and therefore rare. It was a bespoke commodity: Typically you’d find someone smart and pay him or her to write an essay for you, or even (this could be done only in large lecture classes whose students were anonymous to their professors) take an exam for you. The talent was almost always local; in a large university, cynical or broke graduate students could supplement their meager stipends quite significantly by catering to the anxieties of academically marginal undergrads. Such commissions did not always involve money; money is, after all, only one medium of exchange. But you had to have something of value to exchange for the academic work—drugs, sex, the willingness to clean a filthy apartment—and not everyone had what was required. Also, some planning in advance was necessary: If you were ten hours away from the deadline for a paper, you would be hard-pressed to find someone competent to write it for you, even if you were willing to pay extra for a rush job.

With the advent of the Internet, the costs of commissioning dropped, for several reasons. Online essay-writing services keep on hand a library of essays written on common topics—Hamlet’s indecisiveness, the Federalist on the dangers of political faction, Durkheim’s theory of religion—which could be bought for reasonable prices and at short notice. If something better or less common were required, then bespoke work could be arranged, though, as in the earlier dispensation, with more time and more money. (But, if you were an American, thanks to the mighty dollar you could save a bit by commissioning work from people in the Global South, or those who were not native English speakers.)

Also, only the bespoke work was really safe, at least if your professors used Turnitin to discover pre-existing material. Turnitin and similar services arose when the costs of commissioning dropped and its frequency (naturally) increased: Professors who barely have time to grade the papers they assign certainly don’t have time, and maybe not the ability either, to search databases of papers. Googling peculiar phrases for signs of plagiarism often marks the limit of what they can do to detect cheating. And even then your quest could conclude in uncertainty about whether a particular passage was or was not plagiarized. It was much simpler to run all the papers through Turnitin and accept its verdict.

But note what’s happening here: an arms race. Students use certain Internet technologies to enable teaching, and teachers call in other Internet technologies to detect that cheating. Commissioning services arise that promise essays with undetectable provenance; ed-tech companies introduce new tools that promise to detect the undetectable; the alternation bids fair to go on forever. One begins to wonder after a while whether the paper mills and the cheating-detection services are in cahoots, because the longer the alternation goes on, the more money all of them make. And, as I have argued on this site, the heaviest costs are paid by teachers and students, not in money, but in trust—a rapidly vanishing commodity.

I don’t like this collapse of trust; I don’t like being in a technological arms race with my students. So over the years I have developed a series of eccentric assignments. These days I rarely assign the traditional thesis essay—an assignment I always hated anyway, because it makes both the writing and the grading utterly mechanical—but instead assign dialogues between two literary theorists, or an imaginary correspondence between two novelists, or just an old-fashioned textual explication: Take this passage and explain to me, I ask them, without paraphrase, what it’s doing, what’s going on in it. And those assignments have, as it were, taken us back in time, back to the time when commissioning was expensive and therefore rare: the online paper mills, after all, don’t have a stack of conversations about The Brothers Karamazov featuring Dostoevsky and Jane Austen. It’s been a very successful strategy…until now.

The advent of the chatbots has suddenly made my life much more difficult, for several reasons.

First: No one has to be a committed cheater to use them. You only have to be someone who, in the face of an onrushing deadline, experiences either extreme fatigue or disabling anxiety. You don’t even need any money—though money to purchase a more recent and powerful version of, say, ChatGPT will probably help. All you need is a computer that’s connected to the Internet and the ability to write an appropriate prompt. (The skill that’s going to improve the most, among the most people, in the coming years is prompt engineering.) The cost of commissioning has dropped almost to zero.

Second: Very few, if any, colleges and universities have developed clear and consistent rules for the use of chatbots. Is it okay for students to ask for an outline of an assignment, if they then go on to write the substance of the essay? Are they allowed to request a draft of the essay, if they then alter that draft significantly? But wait, what counts as “significantly”? Students can very plausibly claim ignorance on these and many other questions.

Third: Chatbots can already do some of my “eccentric assignments” and do them very well. When I asked for a dialogue between Michel Foucault and Judith Butler on gender and power I got a very good one indeed. Ditto a conversation on colonialism between Gayatri Spivak and Franz Fanon. And when I asked for an exchange of letters between Jane Austen and Fyodor Dostoevsky…Well. ChatGPT’s response was historically insensitive boilerplate: “I trust this letter finds you in good health and spirits. I have recently had the pleasure of reading your novel, The Brothers Karamazov, and I felt compelled to write to you to express my admiration for your work.” But Google’s Gemini was another thing altogether:
My Dear Mr. Dostoevsky,

It is with a peculiar mixture of curiosity and trepidation that I take up my pen to address you today. Curiosity, because your novel, The Brothers Karamazov, has caused quite a stir in English literary circles. The depth of emotion you portray, the exploration of faith and morality – it is a far cry from the quiet manners and matchmaking concerns that typically occupy my own pen. Trepidation, I confess, because the world you paint is one of such stark contrasts, such turmoil, that it feels worlds away from the drawing rooms and landed estates of Hampshire.
It was with a peculiar mixture of admiration and despair that I read that letter. 

by Alan Jacobs, The Hedgehog Review |  Read more:
Image: THR Illustration