Adding and subtracting by hand: Metaphorical representations of arithmetic in spontaneous co-speech gestures

Abstract

This study investigated the spontaneous co-speech gestures produced by speakers who were talking about the concepts of addition and subtraction in a television news setting. We performed a linguistic and co-speech gesture analysis of expressions related to the concepts of addition (N plus N, addition, add) and subtraction (Nminus N, subtraction, subtract). First, we compared the linguistic frequency of these structures across several corpora. Second, we performed a multimodal gesture analysis, drawing data from a television news repository. We analyzed 423 co-speech gestures (169 for subtraction and 254 for addition) in terms of their axis (e.g., lateral, sagittal) and their direction (e.g., leftwards, away from their body). Third, we examined the semantic properties of the direct object that was added or subtracted. There were two main findings. First, low-frequency linguistic expressions were more likely to be accompanied by co-speech gestures. Second, most gestures about addition and subtraction were produced along the lateral or sagittal axes. When people spoke about addition, they tended to produce lateral, rightwards movements or movements away from the body. When people spoke about subtraction, they tended to produce lateral, leftwards movements or movements towards the body. This co-speech gesture data provides evidence that people activate two different metaphors for arithmetic in spontaneous behavior: ARITHMETIC IS MOTION ALONG A PATH and ARITHMETIC IS COLLECTING OBJECTS.