Some constructive-critical notes on the informal overlap study

« previous post | next post »

The following is a guest post by Mark Dingemanse, commenting on Kieran Snyder, "Men interrupt more than women", 7/14/2014.


Although I understand the interest of the topic, and although Kieran Snyder clearly did a lot of work for a substantial blog posting, I think the results are given too much credit, almost inevitably now that they are featured in news media everywhere (in her defense, she does note some methodological problems herself that should lead to a more cautious interpretation).

First and most importantly, you really cannot do this kind of work without having recordings that are available for repeated inspection. Any human coder looking at some phenomenon is likely to fall prey to all sorts of subtle and less subtle biases influencing judgment and coding decisions. Without recordings, one is likely to miss things, overcount things, mistake schisms for overlaps in multi-party interaction, etc. Without recordings, there is no way to redo the counts, verify or replicate. Related to this, it would be important to have independent evidence of factors like social status, social networks, structure of the organisation, structure of the meetings, etc.

Second, it is well known that there are many different kinds of simultaneous talk (some of the basic references here are Jefferson 1984, 1986, Lerner 1989, and Schegloff 2000). For instance, competitive overlap is very different from cooperative overlap but both fall under the definition of "interruption" that Snyder supplies. This informal study has either lumped all of these together, but more likely has focused on an undefined subset of these using a folk conception of 'interruption' (often including competitive overlaps, sometimes no doubt counting other types, and likely ignoring backchannel overlaps or early starts). The numbers we get out of such an approach are uninformative because they have lumped together so many possibly qualitatively different phenomena.

So. There may well be a pattern here — after all, stories about this are often based on the experiences of participants in actual conversations. But taking notes on things that strike one as interruptions in meetings is really not the way to find out whether it is actually the case, and what the phenomenon looks like qualitatively.

In the spirit of providing a constructive contribution, let me spell out some of the design characteristics that a serious study of a possible role of gender in competitive overlap would have to have. Maybe the attention for this informal account builds enough momentum to design and carry such a study. This study would:

  1. Start with a solid understanding of the full possibility space, i.e. first consider all the different ways in which participants can produce simultaneous speech.
  2. Then carry out a qualitative analysis of the phenomenon of interest (perhaps: competitive overlaps), demonstrating how it works in a small number of actual cases where the relevant factors can be directly observed.
  3. Use the results of the qualitative analysis to define a number of relevant things to code for in a larger amount of cases (e.g., overlap type, timing, speech rate, sequential structure, participation framework, gender, social asymmetries)
  4. For better control and comparability, look at overlaps in one particular sequential environment (e.g. answers to questions).
  5. Throughout, try to control for whatever is suspected to be the main causal factor (if there is enough data, track the phenomenon in different configurations of this factor, e.g. different gender balances, different participation frameworks, different configurations of social statuses).
  6. Throughout, try to control for type of institutional interaction (and as a corrolary, for relative social asymmetry of participants)
  7. Ideally, look at a cross-cultural corpus, or limit the claims to the investigated society and setting as appropriate — don't assume that WEIRD populations (Henrich et al. 2010) are the universal yardstick for how interaction works, or how humans work (Yuan et al 2007 make a start with this).
  8. Ideally, look at a sizable corpus of everyday social interaction as a way to get a baseline or 'default' measure. Work meetings are a very specific type of institutional context, and the structure of interaction and turn-taking is likely to be influenced by this.

Together, these points are simply some best practices for the scientific study of social interaction. Precisely because interaction is right under our nose, because we all have our subjective experiences, sensitivities and insensitivities, we should strive for an understanding of the target phenomenon that is accurate, accountable to the facts, and open to verification.

References cited:

Henrich, Joseph, Steven J. Heine, and Ara Norenzayan. 2010. “The Weirdest People in the World?” Behavioral and Brain Sciences 33 (2-3): 61–83. doi:10.1017/S0140525X0999152X.
Jefferson, Gail. 1973. “A Case of Precision Timing in Ordinary Conversation: Overlapped Tag-Positioned Address Terms in Closing Sequences.” Semiotica 9 (1): 47–96. doi:10.1515/semi.1973.9.1.47.
Jefferson, Gail. 1984. “Notes on Some Orderlinesses of Overlap Onset.” In Discourse Analysis and Natural Rhetoric, edited by Valentina D’Urso and P. Leonardi, 11–38. Padua, Italy: Cleup Editore.
Jefferson, Gail. 1986. “Notes on ‘Latency’ in Overlap Onset.” Human Studies 9 (2-3): 153–83. doi:10.1007/BF00148125.
Lerner, Gene H. 1989. “Notes on Overlap Management in Conversation: The Case of Delayed Completion.” Western Journal of Speech Communication 53 (2): 167–77.
Schegloff, Emanuel A. 2000. “Overlapping Talk and the Organization of Turn-Taking for Conversation.” Language in Society 29 (1): 1–63.
Yuan, Jiahong, Mark Liberman, and Christopher Cieri. 2007. “Towards an Integrated Understanding of Speech Overlaps in Conversation”. presented at ICPhS XVI, Saarbrücken.

 


Above is a guest post by Mark Dingemanse. Readers may also be interested in his recent post "Huh? The growing pains of pragmatic typology", 7/10/2014.

An editorial note: I strongly support Mark's closing assertion that studies of interaction should be "accurate, accountable to the facts, and open to verification"; and to that end, I wish that his organization took a less proprietary attitude towards its datasets.



3 Comments

  1. Mark D. said,

    July 16, 2014 @ 9:11 am

    I'll forward your subtle editorial nudge to The Language Archive ;)

  2. Mark D. said,

    July 16, 2014 @ 9:36 am

    One point that is implicit in #8 is the (unfortunate) fact that gender and social asymmetries are not independent in most workplaces. This is a possible confound, meaning we can't tell what's correlated to what without carefully teasing apart and controlling for both.

    And one further publication worth mentioning is the classic Thatcher study, which showed that particular features of the speech of individuals (whatever their gender) may provide opportunities for interruptions — another potential factor to keep tabs on.

    Beattie, Geoffrey W., Anne Cutler, and Mark Pearson. 1982. “Why is Mrs Thatcher interrupted so often?” Nature 300 (5894): 744–747. doi:10.1038/300744a0.

  3. Saul Albert said,

    July 16, 2014 @ 1:38 pm

    Interesting points Mark. I especially like your list – which reads like a very nice (and sadly missing) quickstart guide for working from qualitative to quantitative analytic methods when analysing human interaction.

    It's funny that it is precisely this old chestnut about interruption and gender differences in talk that first prompted Gail Jefferson to work on further differentiating various orderly forms of overlap onset in natural talk.

    Paul Drew's (2009) account of this period in her research at York in the early 80s cites Zimmerman & West (1975) as exemplary of the kind of "largely discredited" research into language and gender that her findings were kicking against.

    I am not an expert in this area *at all* but even a glance one of the most frequently cited meta-analytic papers in the psychology of gender difference (Hyde 2005) suggests that there's a great depth of prior scholarship from many fields that's sorely missing here.

    References:

    Drew, Paul. (2009). “Quit talking while I’m interrupting”: a comparison between positions of overlap onset in conversation. In M. Haakana, M. Laakso, & J. Lindstrom (Eds.), Talk in Interaction: Comparative Dimensions. Helsinki.

    Hyde, J. S. (2005). The gender similarities hypothesis. American psychologist, 60(6), 581. http://www.careerpioneernetwork.org/wwwroot/userfiles/files/the_gender_similarities_hypothesis.pdf

    Zimmerman, Don and West, Candace. (1975) "Sex roles, interruptions and silences in conversation." In Thorne, Barrie and Henly, Nancy (eds) Language and Sex: Difference and Dominance pp. 105-29. Rowley, Massachusetts: Newbury. http://web.stanford.edu/~eckert/PDF/zimmermanwest1975.pdf

RSS feed for comments on this post