Language Log

The most recent Trump indictment reproduces this exchange of text messages (p. 11) :

Trump Employee 2:

We can definitely make it work if we move his
papers into the lake room?

Trump Employee 1:

There is still a little room in the shower where his
other stuff is. Is it only his papers he cares about?
Theres some other stuff in there that are not papers.
Could that go to storage? Or does he want everything
in there on property

Trump Employee 2:

Yes – anything that's not the beautiful mind paper
boxes can definitely go to storage. Want to take a
look at the space and start moving tomorrow AM?

As I am about to deliver a keynote address to an international conference on Chinese language pedagogy, I receive news of this new LLM that knocks my socks off:

InternLM is a multilingual large language model jointly developed by Shanghai AI Lab and SenseTime (with equal contribution), in collaboration with the Chinese University of Hong Kong, Fudan University, and Shanghai Jiaotong University.

Technical report: [PDF]

Note: Please right click the link above to directly download the PDF file.

Abstract

We present InternLM, a multilingual foundational language model with 104B parameters. InternLM is pre-trained on a large corpora with 1.6T tokens with a multi-phase progressive process, and then fine-tuned to align with human preferences. We also developed a training system called Uniscale-LLM for efficient large language model training. The evaluation on a number of benchmarks shows that InternLM achieves state-of-the-art performance in multiple aspects, including knowledge understanding, reading comprehension, mathematics, and coding. With such well-rounded capabilities, InternLM achieves outstanding performances on comprehensive exams, including MMLU, AGIEval, C-Eval and GAOKAO-Bench, without resorting to external tools. On these benchmarks, InternLM not only significantly outperforms open-source models, but also obtains superior performance compared to ChatGPT. Also, InternLM demonstrates excellent capability of understanding Chinese language and Chinese culture, which makes it a suitable foundation model to support Chinese-oriented language applications. This manuscript gives a detailed study of our results, with benchmarks and examples across a diverse set of knowledge domains and tasks.

From Scott D. Seligman via Facebook:

  ChatGPT is really creeping me out. I asked it for a recipe for Pad Thai in the form of an Emily Dickinson poem. I'm no poetry maven, but the damned thing seems to have the ability to turn a phrase, at least some of the time.

Email from Florent Moncomble [links added]:

A few months ago, the distinguished member of the Académie française Alain Finkielkraut was featured in a video where he deplored the loss of “a word which used to exist in the [French] language and disappeared from it”, ie. “compersion”. Apparently, little does he know that “compersion” was actually coined in the 1970s by the Kerista Community of San Francisco, in the context of polyamory, to describe the joy felt in knowing that your better half finds pleasure and happiness with other sexual partners! So that, far from being the old French word that he thinks it is, it is actually an English borrowing from the late 20th century… in other terms, the very nemesis of the Académie — not to mention the moral overtones of the term, quite the antithesis of the conservatism of that institution…

Laelia Veron, a colleague from the Université d’Orléans, Christophe Benzitoun from the Université de Lorraine and I worked together on debunking Finkielkraut’s claim for an academically informed yet humorous biweekly spot that Laelia has on French public radio France Inter.

From Simon Cartoon:

Here's something I just saw at a local bakery in Berkeley, CA.

This post wanders down a series of rabbit holes, from a couple of dead economists, to a dead philosopher, to a dead Supreme Court justice. It all started with Eric Rahim's obituary in the Guardian, which links to the British Academy's obituary for Piero Sraffa, which includes this passage:

He also formed a close friendship with the Austrian-born philosopher Ludwig Wittgenstein, the founder of linguistic philosophy, who was a Fellow of Trinity College and later became Professor of Philosophy at the University. They met regularly on afternoon walks and engaged in endless discussions during the time that Wittgenstein prepared his second book entitled The Nature of Philosophical Investigations, in which he considerably modified his original position put forward in his first book, the Tractatus Logico-Philosophicus. In the introduction to the later work Wittgenstein paid the most generous tribute to Sraffa's unceasing interest in philosophical problems and to his capacity and readiness to engage in endless discussions. He stated in the Introduction to his second book (translated from the German original) that 'it was this stimulus to which I owe the most momentous ideas of this book' (italics in the original).¹

¹It was a question of Sraffa's which convinced him that language and reality do not necessarily have a common logical form.

[This is a guest post by Chau Wu]

The psammo- component of the winning word in this year's Scripps National Spelling Bee, psammophile, is of interest to me because it is a good example of European-Sinitic lexical correspondence. The Ancient Greek word psámmos (ψάμμος) means ‘sand’.  When used together with a definite article (ἡ ψάμμος), it also means ‘the sandy desert’. Examples can be found in Herodotus: ‘the sandy desert’ of Libya (4.173), Ethiopia (3.25), and Egypt (3.26). In Sinitic, ‘sandy desert’ is 沙漠 (MSM shāmò / Tw soa-bô·). From psammos to shāmò, it is easy to see three processes of simplification that may have taken place to transform the Greek loan: simplification of the initial cluster ps- > s-, that of the medial -mm- > -m-, and the loss of the final -s. The simplification of ps- > s- is also seen in Greek derived English words such as psyche, pseudo-, and psalm.

Yuan (?) dynasty (1271-1368) jade seal in the Bristol Museum:

Know what language this is, or even what it says? Yes? Please get back to me. No? Please retweet it until somebody does. (But be aware, it's stumped some quite clever people who've already been asked, so it isn't obvious) Also, advance apologies if it isn't the right way up 1/2 pic.twitter.com/w7ZFggITAs

— Craig Clunas 柯律格💙 (@CraigClunas) June 6, 2023

Listen to Malaysian comedian Nigel Ng (aka "Uncle Roger"), who has had his Weibo and bilibili social media accounts banned due to "violation of relevant regulations":

The ban comes one day after Ng uploaded this clip to various social media platforms. pic.twitter.com/8Wwf2aTrfZ

— Aaron Busch (@tripperhead) May 19, 2023

I've recently seen many articles like this one, "You probably don't need to learn to code anymore" (Medium 6/5/2023), arguing that Large Language Models will make human programming (and human programmers) unnecessary. These arguments puzzle me, because my experience with LLMs suggests that they can't be relied on even for very simple programming tasks. After the fold, I'll give a recent example from (the experimental version of) Bard.

From a story on CNN on "begpackers" in Asia:

Shop sign in Budapest:

…in New Zealand. Phil Pennington, "Analysis: National opposed bilingual road signs, so what does the evidence say?", RNZ 62/2023:

Analysis – Bilingual road signs send a signal – that the country values te reo Māori. But going bilingual was confusing and National would not support it, National's Simeon Brown told voters in blue-ribbon Tauranga recently.

Accusations of racism and a walkback by the party leaders followed. But what evidence is the choice to go bilingual based on?

Helpfully, finding the answer to that is easy. The answer Waka Kotahi is relying on is in a 39-page "research note" into international experiences and outcomes.

However, a quick scan reveals the answer itself is not as straightforward as some of the commentary on the debate has suggested – that it is a straw man.