Language Log

A couple of great posts by Ben Schmidt at Bookworm: "Vector space models for the digital humanities", 10/25/2015; and "Rejecting the gender binary: a vector-space operation", 10/30/2015.

Update — A quick experiment by a Penn grad student, which confirms that somewhat plausible things emerge from fairly small and fairly noisy datasets…

I read Ancillary Justice, the first book in Ann Leckie's Imperial Radch series, at some point in the spring of 2014, and so I was not at all surprised to find Brad DeLong referring to her as "an extremely sharp observer […] author of the devastatingly-good Ancillary Justice", in a blog post "Ann Leckie on David Graeber's "Debt: The First 5000 Mistakes": Handling the Sumerian Evidence Smackdown", 11/24/2014, where he quotes at length from her blog post "Debt", 2/24/2013.

And if you haven't read Ann Leckie's trilogy, you should do yourself a favor and start doing so right away. But this is Language Log, not Science Fiction Book Review Log or Unreliable Economic History Log, so why am I bringing up Ann Leckie now?

Yogi Berra may or may not have said that "You can observe a lot just by watching". He didn't add that you can learn a lot just by counting — but as a baseball person, he surely knew the power of simple statistics.

You can learn a lot about G.K. Chesterton from the Wikipedia article about him, including his observation that "The whole modern world has divided itself into Conservatives and Progressives. The business of Progressives is to go on making mistakes. The business of the Conservatives is to prevent the mistakes from being corrected." But Wikipedia won't tell you that his fiction writing had a striking, perhaps unique, statistical property: he hardly ever uses feminine pronouns.

Brad DeLong linked to a paywalled Financial Times article by Lisa Pollack about problems with spreadsheet usage, and observed that

[C]onsiderations like these make me extremely hesitant when I think of asking my students in Econ 1 next spring to do problems sets in Excel. Shouldn’t I be asking them to do it in R via R Studio or R Commander instead? Audit trails are very valuable. Debuggability is very valuable. Excel ain’t got it…

The first comment, from "Captaindomestic":

I'm biased as a MathWorks employee, but you may want to look into MATLAB. It is really strong in the kinds of data analysis and plotting that econ students need to do. MATLAB has a pretty non-programmer friendly editor and model that helps new users.

Alexander Spangher, "Building the Next New York Times Recommendation Engine", NYT 8/11/2015:

The New York Times publishes over 300 articles, blog posts and interactive stories a day.

Refining the path our readers take through this content — personalizing the placement of articles on our apps and website — can help readers find information relevant to them, such as the right news at the right times, personalized supplements to major events and stories in their preferred multimedia format.

"Important – Please contact us to provide more information."

That's what the letter from Independence Blue Cross said. Dated 7/28/2015, it arrived 8/4/2015, and informed me that I need to "call or respond online within seven business days to ensure that your future claims and those of your family members can be processed in a timely manner." So today is the deadline.

What do I need to contact them about? "We are required to determine if you or your family members have other health insurance coverage to process your claims."

OK, fair enough. And they inform me that "You can choose the most convenient way to provide this information to us". The first option is to "Simply dial 1-866-507-6575 and follow the prompts on our easy-use interactive voice response system"; the second option is "to visit our member website at www.ibxpress.com".

But it turns out that there are a couple of problems. The first problem is that both methods fail at the first step. And the second problem is that there's apparently no other way to contact them to "provide more information … to ensure that your future claims and those of your family members can be processed in a timely manner".

Here's a task that I haven't heard about: recognizing mixed metaphors and idiom blends.

For example, from Bob Ford, "Eagles season can go one of three ways", Philadelphia Inquirer 8/2/2015:

If the Eagles win big this season, they will get bonus points for degree of difficulty. The tightrope over which success is stretched is very narrow.

And at the end of the piece:

Those are the three doors, and, admit it, the Eagles could open any of them this season. As training camp begins, there is no way to tell. There could be opportunity knocking or a doorbell tolling. Finding out which will take a while, though.

Nice fucking try, Twitter: pic.twitter.com/ityPbk4hLy

— Jim Henley (@UOJim) July 18, 2015

Tweeted by Graeme Orr:

Marriage O'Quality. Comhghairdeas Éire! #marriageeqaulity

— Graeme Orr (@Graeme_Orr) May 23, 2015

A couple of days ago, I gave a talk at the Centre Cournot on the topic "Why Human Language Technology (almost) works" ("Pourquoi les technologies de la langue et du discours marchent enfin (ou presque)"), and for the introduction, I tried giving Google Now a few questions and instructions on my Android phone.

In case you're not familiar with this feature, you start it up by saying "OK Google", followed by the question you want it to answer or the instruction you want it to follow.

And since the starting-point of my talk was that HLT now actually works well enough to be useful, I was glad to see that my little experiment worked pretty well.

A recent conversation with Didier Demolin about animal vocalizations motivated me to return to a an issue discussed in "Finch linguistics", 7/15/2011. (See also "Markov's heart of darkness", 7/18/2011, "Non-Markovian yawp", 9/18/2011, and "The long get longer", 12/4/2013.)

The point is this: In modeling the structure of simple repetitive behavior, considerations from (traditional) formal language theory can obscure rather than clarify the issues. These threats to insight include the levels of the Chomsky-Schützenberger hierarchy, the "recursion" controversy, and so on.

What follows is an attempt at a simple illustrated explanation.

Lawrence Altman, "Parsing Ronald Reagan’s Words for Early Signs of Alzheimer’s", NYT 3/30/2015:

Even before Ronald Reagan became the oldest elected president, his mental state was a political issue. His adversaries often suggested his penchant for contradictory statements, forgetting names and seeming absent-mindedness could be linked to dementia.  

In 1980, Mr. Reagan told me that he would resign the presidency if White House doctors found him mentally unfit. Years later, those doctors and key aides told me they had not detected any changes in his mental abilities while in office.  

Now a clever new analysis has found that during his two terms in office, subtle changes in Mr. Reagan’s speaking patterns linked to the onset of dementia were apparent years before doctors diagnosed his Alzheimer’s disease in 1994.

From Christie Versagli:

It's with enthusiasm that we at the World Well-Being Project (University of Pennsylvania) would like to share with you the launch of lexhub.org, a hub for data, tools, papers, and almost any resource in the growing field of language analysis for social science.