The Atlantic

ChatGPT Is Dumber Than You Think

Treat it like a toy, not a tool.
Source: Tyler Comrie / The Atlantic; Getty

As a critic of technology, I must say that the enthusiasm for ChatGPT, a large-language model trained by OpenAI, is misplaced. Although it may be impressive from a technical standpoint, the idea of relying on a machine to have conversations and generate responses raises serious concerns.

First and foremost, ChatGPT lacks the ability to truly understand the complexity of human language and conversation. It is simply trained to generate words based on a given input, but it does not have the ability to truly comprehend the meaning behind those words. This means that any responses it generates are likely to be shallow and lacking in depth and insight.

Furthermore, the reliance on ChatGPT for conversation raises ethical concerns. If people begin to rely on a machine to have conversations for them, it could lead to a loss of genuine human connection. The ability to connect with others through conversation is a fundamental aspect of being human, and outsourcing that to a machine could have detrimental side effects on our society.

Hold up, though. I, Ian Bogost, did not actually write the previous three paragraphs. A friend sent them to me as screenshots from his session with ChatGPT, a program released last week by OpenAI that one interacts with by typing into a chat window. It is, indeed, a large language model (or LLM), a type of deep-learning software that can generate new text once trained on massive amounts of existing written material. My friend’s prompt was this: “Create a critique of enthusiasm for ChatGPT in the style of Ian Bogost.”

ChatGPT wrote more, but I spared you the rest because it was so boring. The AI wrote another paragraph about accountability (“If ChatGPT says or does something inappropriate, who is to blame?”), and then a concluding paragraph that restated the rest (it even began,

You’re reading a preview, subscribe to read more.

More from The Atlantic

The Atlantic4 min read
KitchenAid Did It Right 87 Years Ago
My KitchenAid stand mixer is older than I am. My dad bought the white-enameled machine 35 years ago, during a brief first marriage. The bits of batter crusted into its cracks could be from the pasta I made yesterday or from the bread he made then. I
The Atlantic17 min read
How America Became Addicted to Therapy
A few months ago, as I was absent-mindedly mending a pillow, I thought, I should quit therapy. Then I quickly suppressed the heresy. Among many people I know, therapy is like regular exercise or taking vitamin D: something a sensible person does rout
The Atlantic5 min read
The Strangest Job in the World
This is an edition of the Books Briefing, our editors’ weekly guide to the best in books. Sign up for it here. The role of first lady couldn’t be stranger. You attain the position almost by accident, simply by virtue of being married to the president

Related Books & Audiobooks