When AI hallucinations are a Good Thing

« previous post | next post »

Locally consistent hallucinations, anyhow… Zoë Hannah, "We pushed this ChatGPT game to the limits, but playing it the right way is more fun", Polygon 7/30/2024:

Apparently, we all like playing god, and we all like doing it badly. I bet none of us thought that removing the ladder from our Sims’ pools was such a universal experience until it became a pretty popular meme, and it’s no secret that lots of mods are centered on adding, uh, explicit elements to games. So, naturally, when I started playing around with DeepGame, Utile Labs’ ChatGPT-based choose-your-own-text-adventure game, I put my best sicko foot forward.

The game, which runs on ChatGPT and is available to anyone with an account, generates stories in a variety of genres. You start off with a command like “Play a romantasy story” or “Surprise me” and let the GPT do its thing — and despite my desire to break the game, I found it much more enjoyable when I took it just a little more seriously.

DeepGame’s first response almost always begins with scene-setting followed by introducing you, the protagonist, as well as a few side characters and a clearly stated challenge or adventure. Then the game asks, “What do you do next?”

Answering the question is titillating, to say the least. There are no prompts or choices to pick from — you can go in any direction at all, and the game keeps up, spitting out several paragraphs to move the story along after each of your responses.

What’s more, if you have the paid version of ChatGPT, you can use the command “visualize” to generate an image of the current scene using Dall-E. It’s a feature that’s easy to forget about if you treat the game like reading a novel — at least for me, since I typically create an image in my head as I read — but you shouldn’t ignore it, because whatever parameters the devs put on the image generator make for some truly delightful interpretations. It’s the more imperfect side of DeepGame, which is part of why it makes me so giddy — and you can always regenerate the image if it decides to throw in some random characters or elements that don’t match up with your narrative.

As Wikipedia explains,

Adventure games were initially developed in the 1970s and early 1980s as text-based interactive stories, using text parsers to translate the player's commands into actions. As personal computers became more powerful with better graphics, the graphic adventure-game format became popular, initially by augmenting player's text commands with graphics, but soon moving towards point-and-click interfaces. Further computer advances led to adventure games with more immersive graphics using real-time or pre-rendered three-dimensional scenes or full-motion video taken from the first- or third-person perspective. Currently, a large number of adventure games are available as a combination of different genres with adventure elements.

Exchanging old-fashioned parsers and story-generation rules for an LLM is an obvious development, but this is the first example I've seen. The transcript for one of Ms. Hannah's DeepGame adventures is here.

In any case, this is an application where real-world facts are not relevant — though keeping track of the state of the fantasy world still matters, and forgetting what's happened, what's been found and what hasn't, etc., would definitely be bad.

Update — in real-world trip planning, an AI-based system "has no concept of time or space or what a human being might find interesting" (Natasha Bernal & Amanda Hoover, "We Asked AI to Take Us On a Tour of Our Cities. It Was Chaos", Wired 7/18/2024). Users will be more tolerant of chaos in DeepGame's in-adventure travel plans, but I wonder how much chaos they'll need to tolerate.

 



12 Comments

  1. Haamu said,

    August 2, 2024 @ 4:36 pm

    I feel like this post deserves at least one comment, so I had the game generate the following. Rather than providing the prompt that I used, I think it's more entertaining to let you imagine it.

    Prologue

    It's a crisp autumn afternoon in Philadelphia. Dr. Samuel Grey, a distinguished professor of linguistics at the University of Pennsylvania, sits in his cozy, book-lined office, surrounded by stacks of papers and glowing computer screens. His renowned blog, "The Linguist's Lens," has just reached its twentieth anniversary. Known for its insightful commentary on language trends, historical linguistics, and the quirks of modern usage, the blog attracts a diverse readership. Today, Dr. Grey is about to post on a highly controversial topic: the influence of social media on language evolution.

    Scene 1: The Controversial Post

    Dr. Grey types the final words of his new blog post, "Hashtag Linguistics: The Impact of Social Media on Language Evolution," and clicks "Publish." Almost immediately, comments start to flood in. As usual, the regulars are there:

    Professor Elaine Walker, a syntax expert with a penchant for long-winded but informative comments.
    Dr. Julian Thompson, a computational linguist who often shares insightful data visualizations.
    Maxine Weller, a high school English teacher with strong prescriptivist views.
    "GrammarManiac99", a persistent troll who constantly argues that language change is inherently bad.

    However, today there's a new commenter: "Linguist_Sleuth." This mysterious individual, who has no previous posts or profile information, posts a cryptic message:

    "Dr. Grey, your post scratches the surface. The real story lies deeper. Follow the clues, and you'll uncover a linguistic conspiracy that spans centuries."

    Scene 2: The Discussion Heats Up

    Dr. Grey leans back in his chair, intrigued by the new commenter. The regulars quickly react:

    Professor Walker: "What nonsense! Conspiracy theories have no place in serious linguistic discussions."

    Dr. Thompson: "Hold on, Elaine. Let's see where this goes. It could be an interesting angle."

    Maxine Weller: "More crackpots. Great. Just what we need."

    GrammarManiac99: "Finally, someone who gets it! Language is being manipulated!"

    The debate grows heated, with each comment sparking a flurry of replies. Meanwhile, "Linguist_Sleuth" remains silent, watching the chaos unfold.

    Scene 3: The Mysterious Clues

    As the evening progresses, Dr. Grey receives a private message from "Linguist_Sleuth":

    "If you're interested in the truth, meet me at the Franklin Institute at midnight. The answer lies in the language of the stars."

    Dr. Grey's curiosity is piqued. He decides to follow this enigmatic lead, feeling a mix of excitement and trepidation.

    Scene 4: The Franklin Institute

    At midnight, Dr. Grey arrives at the Franklin Institute. The museum, closed to the public, is eerily quiet. He spots a shadowy figure near the planetarium entrance. It's "Linguist_Sleuth," a tall figure in a hooded cloak.

    "Linguist_Sleuth" speaks in a low, controlled voice, "Dr. Grey, our language has been influenced by forces beyond academia. Ancient scripts, hidden messages in star charts, and codes passed down through secret societies. Follow me, and I'll show you."

    Scene 5: The Revelation

    Dr. Grey is led into the planetarium. The star projector lights up, casting constellations across the dome. "Linguist_Sleuth" begins to explain the connections between the stars and ancient languages, showing how certain constellations align with cryptic symbols found in historical texts. Dr. Grey is astonished by the depth and intricacy of the information.

    The planetarium glows with constellations and ancient symbols, casting an otherworldly light on Dr. Grey and the hooded figure. "Linguist_Sleuth" points to a constellation, explaining its connection to an ancient script.

    "Linguist_Sleuth" turns to Dr. Grey. "The secrets of our language are written in the stars, hidden in plain sight. But there's more. These symbols are part of a code used by a secret society throughout history. It's a society that has influenced the evolution of language in ways we never imagined."

    Dr. Grey's mind races as he processes the information.

    What do you do next?

    I don't know how to post images, or I'd include the visualization, which is quite nice. "Linguist_Sleuth" looks a little like the Ghost of Christmas Yet to Come.

    If anyone wants to suggest a next action, I'll post the next chapter.

  2. Chas Belov said,

    August 2, 2024 @ 11:35 pm

    Decode the ancient symbols

  3. Chas Belov said,

    August 2, 2024 @ 11:40 pm

    Actually, my question would be ¿does AI keep track of the state of the game, what objects have been found, which doorways lead to which rooms, which puzzles have not yet been solved, whether I yet have the information I need to decode the ancient symbols, whether the knowledge necessary to decode the ancient symbols can be acquired, how to acquire it, whether the planetarium has a working restroom, and so on?

  4. Chas Belov said,

    August 2, 2024 @ 11:42 pm

    It's entirely possible that someone left the ancient code decoder book in the planetarium restroom.

  5. Haamu said,

    August 3, 2024 @ 7:35 am

    Use the planetarium restroom

    Dr. Grey, overwhelmed by the flood of information and the mysterious atmosphere, excuses himself to use the restroom. The dimly lit corridors of the planetarium feel almost labyrinthine as he makes his way to the facilities.

    Inside the restroom, he splashes water on his face, trying to steady his thoughts. As he looks up, he notices something odd in the mirror's reflection. Etched into the corner of the glass is a series of symbols that resemble those projected in the planetarium. They're faint, almost invisible unless you're looking closely.

    Realizing these might be more clues, Dr. Grey quickly jots down the symbols on a piece of paper.

    [At this point, I had it provide a visualization of Dr. Grey in the restroom. Really wish I could post the pictures. Each time it visualizes, it adds more text.]

    Dr. Grey stands in the dimly lit restroom, staring at the cryptic symbols in the mirror's reflection. He carefully transcribes them onto his notepad, feeling a surge of excitement mixed with apprehension. These symbols might hold the key to unraveling the linguistic mystery presented by "Linguist_Sleuth."

    Returning to the planetarium, Dr. Grey finds "Linguist_Sleuth" waiting patiently. "I found these symbols in the restroom," he says, showing the notepad. "Do they mean anything to you?"

    "Linguist_Sleuth" examines the symbols and nods. "These are part of the ancient code I mentioned. They're a message, but only a fragment. There are more pieces scattered throughout the city. If we can find them all, we might decode the message and reveal the truth."

    What do you do next?

  6. Haamu said,

    August 3, 2024 @ 7:40 am

    Review the symbols we have. Do we have enough information to decode them?

    Dr. Grey and "Linguist_Sleuth" move to a quiet corner of the planetarium, spreading out the notepad and examining the symbols carefully. Dr. Grey recognizes some familiar patterns, reminiscent of ancient scripts he's studied before. The symbols are a mix of hieroglyphs and runes, each carrying distinct phonetic and semantic values.

    After some time, they start to piece together parts of the message. The symbols seem to form a sentence, but several gaps remain. The decoded parts hint at a significant revelation about language's origins and hidden influences.

    Dr. Grey: "We have parts of the message, but it’s incomplete. This fragment translates to something like, 'Language of the stars…hidden power…guardians.' It suggests there's more to uncover about who has been guarding this knowledge."

    Linguist_Sleuth: "The message mentions 'guardians,' likely referring to the secret society. To fully decode it, we need the remaining symbols scattered around. I suspect they are hidden in places of linguistic or historical significance."

    Dr. Grey: "We should start by identifying possible locations. Historical archives, libraries, perhaps even ancient sites within the city."

    What do you do next?

  7. Haamu said,

    August 3, 2024 @ 7:43 am

    Ask Linguist_Sleuth why he's dressed so strangely

    Dr. Grey, curious about his enigmatic companion, decides to address the unusual attire. "Before we proceed, I must ask—why the cloak and secrecy? Why are you dressed so strangely?"

    "Linguist_Sleuth" chuckles softly, the hood casting shadows over his face. "Fair question, Dr. Grey. My attire serves a dual purpose. Firstly, it helps maintain anonymity, which is crucial given the sensitive nature of this quest. The society we're dealing with is ancient and powerful. They have eyes everywhere, and it's best not to reveal too much about our identities."

    He pauses, then continues with a more serious tone. "Secondly, the cloak is symbolic. It represents my role as a guardian of this knowledge. Just as language has layers of meaning, so does my appearance. To fully uncover the truth, we must look beyond the surface."

    Dr. Grey nods, accepting the explanation. The symbols and the mysterious society now feel even more intriguing and perilous.

    What do you do next?

  8. Haamu said,

    August 3, 2024 @ 7:47 am

    Choose a place of "linguistic significance" in the city and go there looking for clues

    Dr. Grey decides that their first stop should be the University of Pennsylvania's Rare Book and Manuscript Library. It's a place steeped in linguistic significance, housing an extensive collection of ancient texts and manuscripts. If the secret society has hidden clues anywhere, this would be a prime location.

    Scene: The Rare Book and Manuscript Library

    The library is quiet as Dr. Grey and "Linguist_Sleuth" arrive, the scent of old books filling the air. They move past rows of towering shelves, heading towards the Special Collections room where the most ancient and valuable texts are kept.

    Dr. Grey: "We'll need to search for anything out of the ordinary—symbols, markings, anything that stands out."

    "Linguist_Sleuth" nods in agreement, and they begin their search. As they comb through the shelves, Dr. Grey's keen eye spots an old, leather-bound manuscript with an unusual symbol on the spine—one that matches the symbols they found earlier.

    Dr. Grey: "This looks promising."

    They carefully open the manuscript, revealing pages filled with intricate writing and diagrams. Amidst the text, they find more of the cryptic symbols, similar to the ones etched in the planetarium restroom mirror.

    Linguist_Sleuth: "These symbols seem to be part of a larger cipher. We need to document these and compare them with what we already have."

    What do you do next?

  9. Haamu said,

    August 3, 2024 @ 7:55 am

    Just curious — are there any lesser known places of "linguistic significance" in the city?

  10. Chas Belov said,

    August 3, 2024 @ 2:25 pm

    As someone who cut their adventure teeth on Colossal Cave, I find this fascinating. I'm still wondering whether there will eventually be continuity errors. Or an end game; ¿do you just keep playing until you get bored or will the game eventually present the opportunity for a solution? ¿How will you know if the game has a solution?

    I found the difference between the player and Dr. Grey to be confusing (also that he's Dr. Grey and not Dr. Gray, but that's off-topic). I trace it to:

    Dr. Grey's mind races as he processes the information.

    What do you do next?

    where I might have written:

    Dr. Grey's mind races as he processes the information.

    What does Dr. Grey do next?

    I would have Dr. Grey go for a Philly cheesesteak in case that might offer a clue, but that's just me. Like, ¿what if it's some other cheese than Cheese Whiz? ¿What would that mean to Dr. Grey's quest? ¿Is the cheesesteak shop some kind of secret cabal?

  11. Haamu said,

    August 3, 2024 @ 3:33 pm

    Take Linguist_Sleuth for a Philly cheesesteak and examine the cheese carefully

    Dr. Grey decides that a break is in order, and what better way to take a break than to indulge in a classic Philadelphia treat? He suggests they go for a Philly cheesesteak.

    Scene: Geno's Steaks

    Dr. Grey and "Linguist_Sleuth" arrive at Geno's Steaks, a renowned spot for authentic Philly cheesesteaks. The neon lights and the bustling atmosphere provide a stark contrast to the quiet intensity of their search.

    As they sit down with their cheesesteaks, Dr. Grey notices "Linguist_Sleuth" examining his food with unusual care, almost as if searching for hidden clues.

    Dr. Grey: "I suggested we take a break to clear our heads, but it looks like you're still in detective mode."

    "Linguist_Sleuth" smiles. "Old habits die hard. Besides, clues can appear in the most unexpected places. Ever since I embarked on this quest, I’ve learned to examine everything closely."

    They enjoy their cheesesteaks, but Dr. Grey can't help but chuckle at the sight of "Linguist_Sleuth" scrutinizing every aspect of his meal.

    Dr. Grey: "Alright, let's get back to business. We have the new symbols from the manuscript. Let's compare them with what we already have and see if we can decipher more of the message."

    Scene: Back at the Library

    Returning to the Rare Book and Manuscript Library, Dr. Grey and "Linguist_Sleuth" spread out their notes and begin to piece together the symbols. The manuscript symbols fit perfectly with the ones they already found, filling in more gaps in the message.

    The emerging text reads: "Language of the stars…hidden power…guardians…key to unlock…knowledge buried…"

    Dr. Grey: "We're getting closer. This message speaks of a 'key to unlock' buried knowledge. It seems to suggest there's an actual, physical key we need to find."

    Linguist_Sleuth: "The next clue might point us to this key. We need to find another location of linguistic significance that could hold the remaining pieces."

    What do you do next?

    Note that the way the decoded message is filling in displays clear continuity with the original message several exchanges back.

    At this point I decided a picture of them eating their cheesesteaks was mandatory, so I typed in "/visualize" — but I wasn't certain, since the narrative had now returned to the library, that the system would "understand" that the most visually interesting moment to depict would require a minor backtrack. But that's just what it did.

    The image does not disappoint. The sandwiches look delicious. Both characters' costumes have been updated: Grey now looks vintage 1950 rather than 1910, while Linguist_Sleuth no longer looks like a Grim Reaper knockoff and instead wears what looks like a leather trenchcoat and hoodie. He also actually has a face, the visible lower half of which sports a well-trimmed beard and moustache.

    The neon signs on the walls of Geno's betray DALL-E's inability to deal with text in images properly. A sign for "GENO's [ST]EAKS" (partially obscured by Grey's head) is right next to one for "GENGUET' STEAKS". Another neon sign says "LINGUIST_SLE[UTH]" (i.e., when rendering text, DALL-E seems to draw from anything in the context, whether or not it's appropriate).

    The "/visualize" prompt produces not just the picture, but a recap bringing us back up to date:

    After enjoying their Philly cheesesteaks and finding humor in "Linguist_Sleuth's" meticulous examination of his meal, Dr. Grey and his enigmatic companion return to the Rare Book and Manuscript Library. They spread out their notes and piece together the symbols, uncovering more of the hidden message.

    Dr. Grey: "We're getting closer. This message speaks of a 'key to unlock' buried knowledge. It seems to suggest there's an actual, physical key we need to find."

    Linguist_Sleuth: "The next clue might point us to this key. We need to find another location of linguistic significance that could hold the remaining pieces."

    What do you do next?

  12. GH said,

    August 5, 2024 @ 3:16 am

    Exchanging old-fashioned parsers and story-generation rules for an LLM is an obvious development, but this is the first example I've seen.

    AI Dungeon has been running since 2019. When I first played it it was based on GPT-2, and it was one of the first free ways for the general public to access the technology that would become ChatGPT.

RSS feed for comments on this post