Language Log

John Markoff, "Troves of Personal Data, Forbidden to Researchers", NYT 5/21/2012:

When scientists publish their research, they also make the underlying data available so the results can be verified by other scientists.

(I wish this were generally true…)

At least that is how the system is supposed to work. But lately social scientists have come up against an exception that is, true to its name, huge.

It is “big data,” the vast sets of information gathered by researchers at companies like Facebook, Google and Microsoft from patterns of cellphone calls, text messages and Internet clicks by millions of users around the world. Companies often refuse to make such information public, sometimes for competitive reasons and sometimes to protect customers’ privacy. But to many scientists, the practice is an invitation to bad science, secrecy and even potential fraud.

For those who don't care much about science, and oppose data publication on the basis of some combination of beliefs in corporate secrecy, personal privacy, and researchers' "sweat equity", here's a stronger argument: lack of broad access to representative data is also a recipe for bad engineering.  Or rather, it's a recipe for slow to non-existent development of workable solutions to the the technical problems of turning recorded data into useful information.

At the recent DataEDGE workwhop in Berkeley, as well as at the recent LREC 2012 conference in Istanbul, I was unpleasantly surprised by the widespread lack of awareness of this (in my opinion evident) fact.

I'm in Berkeley for the DataEDGE Conference, where I'm due to participate in a "living room chat" advertised as follows:

Size Matters: Big Data, New Vistas in the Humanities and Social Sciences
Mark Liberman, Geoffrey Nunberg, Matthew Salganik
Vast archives of digital text, speech, and video, along with new analysis technology and inexpensive computation, are the modern equivalent of the 17th-century invention of the telescope and microscope. We can now observe social and linguistic patterns in space, time, and cultural context, on a scale many orders of magnitude greater than in the recent past, and in much greater detail than before. This transforms not just the study of speech, language, and communication but fields ranging from sociology and empirical economics to education, history, and medicine — with major implications for both scholarship and technology development.

On Friday, July 20, at the 2012 meeting of the Council of Writing Program Administrators in Albuquerque NM, there will be a session called "Help Wanted: Sharing Data for Research on Reading and Writing".  Here's the proposal that was submitted for this session:

Every year since 2005, speech synthesis researchers have organized a yearly Blizzard Challenge, "[i]n order to better understand and compare research techniques in building corpus-based speech synthesizers". Part of the research effort involves the general public, who are invited to perform a series of evaluations of the results.

Participation takes about one hour in total — but your participation is registered, so that you can leave at any point, and then return and take the evaluation up again at the point where you left off. If you're willing, please follow this link to enroll and participate.

Yesterday evening at dinner, some members of the LSA Publications Committee were idly discussing the changes over time in fashions for given names.  It's obvious that things change — but it's less obvious whether these changes are cyclic. It makes sense that out-of-fashion names might come back after a generation or two — but does this really happen on a regular basis?

For the past couple of years, Google has provided automatic captioning for all YouTube videos, using a speech-recognition system similar to the one that creates transcriptions for Google Voice messages. It's certainly a boon to the deaf and hearing-impaired. But as with Google's other ventures in natural language processing (notably Google Translate), this is imperfect technology that is gradually becoming less imperfect over time. In the meantime, however, the imperfections can be quite entertaining.

The longer it is, the higher the rating:

As Wikipedia explains,

Watson is an artificial intelligence computer system capable of answering questions posed in natural language,[2] developed in IBM's DeepQA project by a research team led by principal investigator David Ferrucci. Watson was named after IBM's first president, Thomas J. Watson.

But as a page at AT&T Labs Research tells us,

AT&T WATSON^SM is AT&T's speech and language engine that integrates a variety of speech technologies, including network-based, speaker-independent automatic speech recognition (ASR), AT&T Labs Natural Voices® text-to-speech conversion, natural language understanding (which includes machine learning), and dialog management tasks.

WATSON has been used within AT&T for IVR customers, including AT&T's VoiceTone® service, for over 20 years during which time the algorithms, tools, and plug-in architecture have been refined to increase accuracy, convenience, and integration. Besides customer care IVR, AT&T WATSON^SM has been used for speech analytics, mobile voice search of multimedia data, video search, voice remote, voice mail to text, web search, and SMS.

A few days ago ("Evaluative words for wines", 4/7/2012), I illustrated how a trivial method can help us uncover the contribution of individual words to the expression of opinion in text. For this morning's Breakfast Experiment™, I'll illustrate an equally trivial approach to learning how words fit together structurally, using the same small collection of 20,888 wine reviews.

There are two basic reasons for the increased interest in "text analytics" and "sentiment analysis": In the first place, there's more and more data available to analyze; and second, the basic techniques are pretty easy.

This is not to deny the benefits of sophisticated statistical and text-processing methods. But algorithmic sophistication adds value to simple-minded baselines that are often pretty good to start with.  In particular, simple "bag of words" techniques can be surprisingly effective. I'll illustrate this point with a simple Breakfast Experiment™.

The folks at Google Labs pulled out all the stops to show off some of the Really Advanced Search capabilities that we can look forward to in coming months…

Farhad Manjoo, "Apple Doesn’t Need To Make the TV of the Future: The revolution is already here—and it’s called the Xbox", Slate 3/27/2012.

If the rumors are true, Apple will release a television set later this year that it will tout as the most amazing boob tube ever invented.

The biggest selling point will be Apple’s promise to make navigating our viewing choices easier. Say you want to watch Tower Heist on a Saturday night. You’d first check Netflix, because if it’s there, it’ll be streamed free for members. If it’s not, and if you subscribe to Amazon’s Prime service, you ought to check there, because you might get a discount. If that fails, you’ll look for the movie on iTunes, Hulu Plus, or Comcast in whatever order is most convenient for you. The whole process is a frustrating mess, one that Apple will likely try to solve by building a cross-platform search engine into its TV. Instead of going to every service separately, you’ll just say, “Hey TV, I’d like to watch Tower Heist!” and the screen will show you where the flick is playing, and for how much. You’ll just have to choose one and press Play.

When CEO Tim Cook shows off Apple’s TV set this fall, I bet he’ll call voice-activated universal search a revolutionary way to interact with your television. What Cook probably won’t mention is that it already exists. Indeed, much of what Apple is likely to build into its TV is available today on a gadget whose interface is just as easy to use as anything Apple will cook up. The device is called the Xbox 360.

Over the last few months, Microsoft has turned its video-game console into your TV’s best friend.

Alexander M. Petersen, Joel Tenenbaum, Shlomo Havlin, and H. Eugene Stanley, "Statistical Laws Governing Fluctuations in Word Use from Word Birth to Word Death" (appearing in Scientific Reports, 3/15/2012):

We analyze the dynamic properties of 10^7 words recorded in English, Spanish and Hebrew over the period 1800–2008 in order to gain insight into the coevolution of language and culture. We report language independent patterns useful as benchmarks for theoretical models of language evolution. A significantly decreasing (increasing) trend in the birth (death) rate of words indicates a recent shift in the selection laws governing word use. For new words, we observe a peak in the growth-rate fluctuations around 40 years after introduction, consistent with the typical entry time into standard dictionaries and the human generational timescale. Pronounced changes in the dynamics of language during periods of war shows that word correlations, occurring across time and between words, are largely influenced by coevolutionary social, technological, and political factors. We quantify cultural memory by analyzing the long-term correlations in the use of individual words using detrended fluctuation analysis.