• Aucun résultat trouvé

Speaking during rhythmic motions of feet vs hands:how do speech and limb movements affect each other?

N/A
N/A
Protected

Academic year: 2021

Partager "Speaking during rhythmic motions of feet vs hands:how do speech and limb movements affect each other?"

Copied!
2
0
0

Texte intégral

(1)

HAL Id: hal-02968217

https://hal.archives-ouvertes.fr/hal-02968217

Submitted on 15 Oct 2020

HAL is a multi-disciplinary open access archive for the deposit and dissemination of sci- entific research documents, whether they are pub- lished or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers.

L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.

Speaking during rhythmic motions of feet vs hands:how do speech and limb movements affect each other?

Hélène Serré, Heather Weston, Amélie Rochet-Capellan, Marion Dohen, Susanne Fuchs

To cite this version:

Hélène Serré, Heather Weston, Amélie Rochet-Capellan, Marion Dohen, Susanne Fuchs. Speaking during rhythmic motions of feet vs hands:how do speech and limb movements affect each other?.

Dance data, cognition and multimodal communication, Sep 2020, Lisboa, Portugal. �hal-02968217�

(2)

Acknowledgments This research is jointly supported by the French National Research Agency (ANR-17-FRAL- 0005-01) and the German Research Foundation (DFG) as part of the SALAMMBO project (Spoken Language in Motions: Learning and Adaptation of Speech Communication in the context of Body Motions)

Speaking during rhythmic motions of feet vs hands:how do speech and limb movements affect each other?

Hélène Serré

1

, Heather Weston

2,3

, Amélie Rochet-Capellan

1

, Marion Dohen

1

, and Susanne Fuchs

2

Background

• Body movements impact cognition [1].

• Hand movements and speech can be coordinated [2].

• Body movements and speech each require a specific adaptation of breathing [3,4,5,6].

SALAMMBO project : interactions speech, breathing, movement

4

• Our aim is to investigate speech-breathing and limb interactions : how do the three systems behave in spontaneous speech tasks ?

• First acoustic results [7] : less pauses and longer speech intervals when moving.

Question

• How does breathing interact with legs vs. arms movements when it is shared with speech ?

• Is the breathing-arms coupling greater while speaking than the breathing-legs one [2] ?

References [1] Oppezzo, M., & Schwartz, D. L. (2014). Give your ideas some legs: The positive effect of walking on creative thinking. Journal of experimental psychology: learning, memory, and cognition, 40(4), 1142. [2] Gentilucci, M., Benuzzi, F., Gangitano, M., & Grimaldi, S. (2001). Grasp with hand and mouth: A kinematic study on healthy subjects. Journal of Neurophysiology, 86, 1685–1699. Gentilucci, M., Benuzzi, F., Gangitano, M., & Grimaldi, S. (2001). Grasp with hand and mouth: A kinematic study on healthy subjects. Journal of Neurophysiology, 86, 1685–1699.[3] Pouw, W., Harrison, S. J., & Dixon, J. A. (2018). Gesture-Speech Physics: The Biomechanical Basis of Gesture-Speech Synchrony. Preprint PsyArxiv doi, 10. [4] Bardy, B. G., Hoffmann, C. P., Moens, B., Leman, M., & Dalla Bella, S. (2015). Sound-induced stabilization of breathing and moving. Annals of the New York Academy of Sciences, 1337(1), 94-100. [5] Fuchs, S., Reichel, U. D., & Rochet-Capellan, A. (2015). Changes in speech and breathing rate while speaking and biking.[6] Fuchs, S., Petrone, C., Rochet-Capellan, A., Reichel, U. D., & Koenig, L. L. (2015). Assessing respiratory contributions to f0 declination in German across varying speech tasks and respiratory demands. Journal of Phonetics, 52, 35-45. [7] Heather Weston & Susanne Fuchs (2019), Rhythmic limb movements affect speech output differently in individuals.

Speech acoustical signal

Feet/hand cycling movements

Thoracic breathing

Procedure

15 German Speakers (8 women, 7 men) between 19 and 40 years old (mean=27, sd=6)

** ***

Movements shorten breathing cycle in case of quiet breathing, this effect is not present when speech occurs.

è When limbs movements are effortless, breathing seems to mainly adapt to speech.

è What about effortful movements ?

We have unexpected results related to theories of hand-mouth coupling [2]: arms and legs cycles have the same behavior. Is there a Specific coupling?

Correlation between duration of arms and legs cycles

Onset of movement cycles relative to the breathing cycles Quiet/Speech

only (Q/S)

Quiet/Speech + leg cycling

(QL/SL)

Quiet/Speech + arm cycling

(QA/SA)

1. Univ. Grenoble Alpes, CNRS, Grenoble INP, GIPSA-lab, 38000 Grenoble, France 2. Leibniz-Centre General Linguistics (ZAS)

3. Humboldt-Universität zu Berlin, Berlin, Germany

Notes

4. Spoken lAnguage in Motions:Learning and Adaptation of speech coMMunication in the context of BOdy motions Imagine you have to go to a lonely island and you could bring only five of these ten

items. Which ones would you choose? Bring them in order, and motivate your choice. Why wouldn’t you take the other five items?

Analysis

Conclusion

Resu lt s

Duration of breathing cycles according to the condition

Pearson coefficient:0.78

Breathing cycle duration / movement cycle duration (ratio)

Breathing and movement coordination

Références

Documents relatifs

It is shown that in Hilbert spaces of dimension d ≥ 4, the ratio between the classical and quantum overlaps in any ψ-epistemic model must be arbitrarily small for certain

Functional Generalized Spectral Additive Model (FGSAM), Functional Generalized Linear Model (FGLM), and Functional Generalized Kernel Additive Model (FGKAM) were used to predict

Clearly, 8-oxodG is the most abundant product formed with the four oxidants (Figure 1), with Ox consistently observed at higher levels than the other two secondary G

In order to address complex large-scale shoreline shapes, the LX-Shore model computes the time evolution of the sediment fraction F (ranging from 0 to 1) inside a plan-view grid

Trials for which participants made no response or made mistakes (word response for a pseudo-word or vice-versa) were considered as errors and were not included in the

This experiment reveals that despite their rhythmic differences, all Arabic dialects still cluster around stress-timed languages exhibiting a different distribution from

Results show that the robot achieves motor coordination with the human partner through a visual signal of a hand performing rhythmic movements.. The robot is able to adapt

Figure 1: Comparing prediction errors of facial shapes using a model built using 52 speech visemes (light gray) with one incorporating 102 additional expressemes (dark gray), for