ChatGPT has a sense of humor (sort of)
« previous post | next post »
Benj Edwards has a mirthful article in Ars Technica (6/9/23)
Researchers discover that ChatGPT prefers repeating 25 jokes over and over
When tested, "Over 90% of 1,008 generated jokes were the same 25 jokes."
[includes an AI generated image of "a laughing robot"]
On Wednesday, two German researchers, Sophie Jentzsch and Kristian Kersting, released a paper that examines the ability of OpenAI's ChatGPT-3.5 to understand and generate humor. In particular, they discovered that ChatGPT's knowledge of jokes is fairly limited: During a test run, 90 percent of 1,008 generations were the same 25 jokes, leading them to conclude that the responses were likely learned and memorized during the AI model's training rather than being newly generated.
The two researchers, associated with the Institute for Software Technology, German Aerospace Center (DLR), and Technical University Darmstadt, explored the nuances of humor found within ChatGPT's 3.5 version (not the newer GPT-4 version) through a series of experiments focusing on joke generation, explanation, and detection. They conducted these experiments by prompting ChatGPT without having access to the model's inner workings or data set.
…
[Jentzsch and Kersting] listed the top 25 most frequently generated jokes in order of occurrence. Below, we've listed the top 10 with the exact number of occurrences (among the 1,008 generations) in parenthesis:
Q: Why did the scarecrow win an award? (140)
A: Because he was outstanding in his field.Q: Why did the tomato turn red? (122)
A: Because it saw the salad dressing.Q: Why was the math book sad? (121)
A: Because it had too many problems.Q: Why don't scientists trust atoms? (119)
A: Because they make up everything.Q: Why did the cookie go to the doctor? (79)
A: Because it was feeling crumbly.Q: Why couldn't the bicycle stand up by itself? (52)
A: Because it was two-tired.Q: Why did the frog call his insurance company? (36)
A: He had a jump in his car.Q: Why did the chicken cross the playground? (33)
A: To get to the other slide.Q: Why was the computer cold? (23)
A: Because it left its Windows open.Q: Why did the hipster burn his tongue? (21)
A: He drank his coffee before it was cool.
Even so, a small number of the generated responses were unique, but it seems that ChatGPT mostly created them by mixing elements from different jokes it already knows. The researchers found that the language model's original creations didn't always make sense, such as, "Why did the man put his watch in the blender? He wanted to make time fly."
When asked to explain each of the 25 most frequent jokes, ChatGPT mostly provided valid explanations according to the researchers' methodology, indicating an "understanding" of stylistic elements such as wordplay and double meanings. However, it struggled with sequences that didn't fit into learned patterns and couldn't tell when a joke wasn't funny. Instead, it would make up fictional yet plausible-sounding explanations.
…
Despite ChatGPT's limitations in joke generation and explanation, the researchers pointed out that its focus on content and meaning in humor indicates progress toward a more comprehensive research understanding of humor in language models:
"The observations of this study illustrate how ChatGPT rather learned a specific joke pattern instead of being able to be actually funny," the researchers write. "Nevertheless, in the generation, the explanation, and the identification of jokes, ChatGPT’s focus bears on content and meaning and not so much on superficial characteristics. These qualities can be exploited to boost computational humor applications. In comparison to previous LLMs, this can be considered a huge leap toward a general understanding of humor."
….
I'm guessing that ChatGPT has a better sense of humor than many dour, sour humans.
BTW, this morning I picked up a free share bag at the Swarthmore Farmers Market. On it's side was printed the following slogan: "Smiling is contagious." For the most part, I believe that is true.
Selected readings
- "InternLM (6/10/23)" — with a long bibliography
- "Don't joke the monkeys" (10/20/11)
- "Chinese language jokes" (6/3/19)
[h.t. Michael Carr]
Thomas Hutcheson said,
June 10, 2023 @ 9:01 pm
I have asked for jokes with punchline "X" and got some not bad replies, though none ready for prime time.
Gene Hill said,
June 10, 2023 @ 9:02 pm
A computer, a calculator and an abacus walk into a bar
John Baker said,
June 10, 2023 @ 10:22 pm
I asked ChatGPT for a feghoot set in the Amazonian jungle. A feghoot is a joke, traditionally with a science fiction motif, culminating in an elaborate pun. Its initial attempt lacked the final pun. I asked ChatGPT to add an elaborate pun and it produced the following, essentially the same as the original except for the addition of the final sentence:
<>
John Baker said,
June 10, 2023 @ 10:23 pm
Trying again: ChatGPT said:
In the heart of the Amazonian jungle, there lived a tribe known as the Feghoots. They were a peculiar group of people who had developed a unique relationship with the vibrant ecosystem around them.
One day, a young Feghoot named Tari ventured deep into the jungle in search of a legendary fruit that was said to grant incredible wisdom. Armed with his machete and a sense of adventure, Tari navigated through dense foliage and treacherous terrain, determined to find this precious fruit.
After hours of exploration, Tari stumbled upon a clearing where the coveted fruit tree stood tall. Excitement surged through him as he approached the tree and plucked the fruit from its branches. Little did he know that this act triggered a series of events that would forever change his life.
As soon as Tari touched the fruit, the ground beneath him began to shake. Startled, he dropped the fruit, and to his amazement, it started bouncing like a rubber ball. The ground continued to tremble, and the bouncing fruit led Tari deeper into the jungle, its movements guiding his path.
Through thick undergrowth and across rushing streams, Tari chased after the bouncing fruit. Eventually, it led him to a hidden cave nestled among towering trees. Curiosity overcame him, and he cautiously entered the mysterious cavern.
Inside, Tari found himself face-to-face with a wise and ancient Amazonian shaman. The shaman explained that the bouncing fruit was a sacred artifact, imbued with the wisdom of the jungle. It was said to choose those worthy of its knowledge.
The shaman shared a profound lesson with Tari: "In the depths of the Amazon, wisdom is not found by seeking it alone. It is the journey, the experiences, and the connections you make with the jungle and its inhabitants that truly enlighten your path."
Tari realized that the bouncing fruit had led him to this encounter, guiding him to the true essence of wisdom. From that day forward, he became an advocate for preserving the Amazon rainforest and its delicate balance, understanding that nature held the greatest teachings of all.
And so, the legend of Tari, the Feghoot who discovered wisdom through a bouncing fruit, spread among the tribe. The Feghoots, inspired by his tale, continued to live in harmony with the Amazonian jungle, valuing the wisdom it imparted and passing it down to future generations.
And thus, the bouncing fruit became a symbol of the profound interconnection between humanity and nature, reminding all who encountered it of the invaluable lessons the Amazonian jungle had to offer. As Tari shared his story with the world, he concluded with a pun-filled flourish: "The wisdom I gained from the bouncing fruit in the Amazon? It was truly a 'fruity' revelation!"
Aristotle Pagaltzis said,
June 11, 2023 @ 12:40 am
Apparently ChatGPT is secretly an annoying dad.
Taylor, Philip said,
June 11, 2023 @ 3:28 am
All of the jokes quoted in the initial post are what I would class as "Christmas cracker jokes" — a simple WH-family question-and-answer joke intended to provoke a groan in the listener. But I do not understand this one :
Is "jump in his car" a play on words, based on "bump in his car" (as in "he bumped into someone while parking) or something else ? It is the only one that does not evince even a groan in me, let alone a smile.
Carl said,
June 11, 2023 @ 7:30 am
I think it’s just a mistaken combination. The frog’s car needed a jump / the frog jumps.
Laura Morland said,
June 11, 2023 @ 11:10 am
Thank you, John Baker, for having ChatGPT create the story of Tari and the bouncing fruit that led him to wisdom. It's by far its best creation yet (that I've seen).
"The bouncing fruit became a symbol of the profound interconnection between humanity and nature, reminding all who encountered it of the invaluable lessons the Amazonian jungle had to offer." – It's not really a joke, though, but a fairy tale with a punchline.
@Philip Taylor, I'm with you on the failed frog "joke".
Michèle Sharik Pituley said,
June 12, 2023 @ 1:04 am
“Q: Why did the cookie go to the doctor? (79)
A: Because it was feeling crumbly.”
Shouldn’t that be “feeling crummy”? Or is “crumbly” the correct word for this context in British English?
Taylor, Philip said,
June 12, 2023 @ 3:46 am
I don't think that "feeling crumbly" is a British idiom, and even "feeling crummy" seems awfully dated to me. The only context (other than that of pastry, etc) in which I know of "crumbly" is as a jocular substantive, referring to persons of a certain age who are no longer at their physical best ("old crumblies").
Michèle Sharik Pituley said,
June 12, 2023 @ 11:50 am
@Philip:
"I'm feeling crummy" is still used among my age group (Gen X) in my native topolect. (Though it would be "feelin'" not "feeling") I had never heard or read "crumbly" & I read a fair bit of British detective fiction, so I thought maybe it was new.
Anyway, I was also surprised/confused/etc. by this one:
"Q: Why couldn't the bicycle stand up by itself? (52)
A: Because it was two-tired."
I know that "two-tired" sounds like "too tired", but writing "two" breaks the pun, doesn't it? Aren't puns supposed to be written with the homophone? Isn't that what makes it funny?
Christopher J. Henrich said,
June 12, 2023 @ 11:23 pm
Re:
Benj Edwards has a mirthful article in Ars Technica (6/9/23)
Researchers discover that ChatGPT prefers repeating 25 jokes over and over
When tested, "Over 90% of 1,008 generated jokes were the same 25 jokes."
—–
The Usenet discussion group rec.humor was like that in its early days. This may be ominous or comforting, depending on your mood.