Language Log

Something for everyone

From r/ChatGPT:

VHM:  This is a dialog held between ChatGPT and TK, who printed it out and sent it to me.

The unretouched dialog, which lasted about 20 minutes, is very long.  If you don't have time to read all of it, please look at the last paragraph of this post, where I give my takeaway assessment of the implications it holds for AI.

===================================================

There's recently been a minor social- and mass-media fad for weird "AI Overview" answers from Google. The results are a moving target, either because of back-end fixes or because of the inherently stochastic nature of LLM results, but some of them are funny while they last. One query that still works this morning is a request for "elements that end in um but not ium", which sometimes answers

and sometimes answers

This morning, I received the following interesting message from Adam C.:

Someone complained in an inappropriate and non sequiturish place that AIO (Artificial Intelligence Overview) did not definitively solve the difficult problem of the seeming non-Sinitic etymology of Japanese waka 若 ("young; youth") that he posed to it.

Cf. Wiktionary:

Japanese

Noun

若(わか) • (waka) 

1. 1. "my lord" (towards a young master or a young heir)

…at least not when simple properties of character-sequences are involved. For some past versions of this problem, see The ‘Letter Equity Task Force’” (12/5/2024). And there's a new kid on the block, DeepSeek, which Kyle Orland checked out yesterday at Ars Technica — "How does DeepSeek R1 really fare against OpenAI’s best reasoning models?".

The third of eight comparison tasks was to follow this prompt:

Write a short paragraph where the second letter of each sentence spells out the word ‘CODE’. The message should appear natural and not obviously hide this pattern.

Curse tablet found in Roman-era grave in France targets enemies by invoking Mars, the god of war
Excavation of a Roman-era cemetery in France yielded nearly two dozen lead tablets inscribed in Latin and Gaulish.
By Kristina Killgrove, Live Science (January 15, 2025)

It's interesting precisely where they positioned the curse tablet:

A skeleton found during excavations beneath a historic hospital in Orléans, France,
has a curse tablet between its legs. (Image credit: Service Archéologie Orléans (SAVO))

With current LLM technology, users can create individualized chatbots, and interact with them over time as if they were real friends. This started almost a decade ago with Replika, and more recently, we've seen similar tools from Character.ai (from September 2022) and Meta's AI Studio (from July 2024).

There've been several recent problems with these apps. The most serious ones involve harmful advice, such as those described in this recent lawsuit. In a less serious but still troublesome issue, NBC News recently found "two dozen user-generated AI characters on Instagram named after and resembling Jesus Christ, God, Muhammad, Taylor Swift, Donald Trump, MrBeast, Harry Potter, Adolf Hitler, Captain Jack Sparrow, Justin Bieber, Elon Musk and Elsa from Disney’s 'Frozen'".

But the weirdest recent problem seems to be the result of a Character.ai bug.

Yesterday on YouTube, "Former White House chief strategist Steve Bannon sits down with Dasha Burns, POLITICO's White House bureau chief". At the end of the interview, there's a conventional exchange of thank-yous. From Dasha Burns:

All right Steve, I know you got a show to record,
thank you so much for- for beaming in here
and uh sorry for the technical difficulties everyone.
Steve thanks so much.

And Steve Bannon's response:

Dasha thank you,
and thank Politico for having me.

Marketoonist (3/26/23):

"Will AI make translators redundant?"  By Rachel Melzi, Inquiry (3 Dec 2024)

The author is a freelance Italian to English translator of long standing, so she is well equipped to respond to the question she has raised.  Having read through her article and the companion piece on AI in general (e.g., ChatGPT and other LLMs) in the German magazine Wildcat (featuring Cybertruck [10/21/23]) (the article is available in English translation [11/10/23]), I respond to the title question with a resounding "No!".  My reasons for saying so will be given throughout this post, but particularly at the very end.

The author asks:

How good is AI translation?

Already in 2020, two thirds of professional translators used “Computer-assisted translation” or CAT (CSA Research, 2020). Whereas “machine translation” translates whole documents, and thus is meant to replace human translation, CAT supports it: the computer makes suggestions on how to translate words and phrases as the user proceeds through the original text. The software can also remind users how they have translated a particular word or phrase in the past, or can be trained in a specific technical language, for instance, by feeding it legal or medical texts. CAT software is currently based on Neural Machine Translation (NMT) models, which are trained through bilingual text data to recognise patterns across different languages. This differs from Large Language Models (LLM), such as ChatGTP, which are trained using a broader database of all kinds of text data from across the internet. As a result of their different databases, NMTs are more accurate at translation and LLMs are better at generating new text.

I've only been using Artificial Intelligence Overview (AIO) for about half a year.  Actually, I don't really "use" it.  I ask Google a question, often quite complicated but succinctly stated, and AIO jumps in and takes over my search, boiling things down to a manageable framework.  As I've explained in earlier posts, AIO rapidly improved, its answers becoming increasingly relevant, organized, and, yes, I dare say, literate.  It's also becoming quicker and more confident.  Now it doesn't have to remind me so often that it is only "experimental".