HAL Id: hal-01614559
https://hal.archives-ouvertes.fr/hal-01614559
Submitted on 11 Oct 2017
HAL is a multi-disciplinary open access archive for the deposit and dissemination of sci- entific research documents, whether they are pub- lished or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers.
L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.
Modeling sensory preference in speech motor planning
Jean-François Patri, Julien Diard, Pascal Perrier
To cite this version:
Jean-François Patri, Julien Diard, Pascal Perrier. Modeling sensory preference in speech motor plan- ning. NCM 2017 - 27th Annual Meeting of the Society for Neural Control of Movement, May 2017, Dublin, Ireland. �hal-01614559�
ɔ a
œ
Sensory
Characterizations
Fusion of pathway
Modeling sensory preferences in speech motor planning
Jean-François Patri1,2, Julien Diard2, Pascal Perrier1
1 GIPSA-Lab, UMR 5216 - CNRS & Université Grenoble Alpes, France
2 LPNC, UMR 5105 - CNRS & Université Grenoble Alpes, France
1. Context & Framework 2. Assessing motor planning
3. Weighting of sensory pathways
5. Results
1
stapproach: Hard constraint
3 Motor Planning Questions
2
ndapproach: Soft constraint
Activation / Deactivation
of 2 sensory constraints
Somatosensory pathway
Auditory pathway
The research leading to these results has received funding from the European Research Council under the European Community's Seventh Framework Programme (FP7/2007- 2013 Grant Agreement no. 339152, “Speech Unit(e)s”, PI: Jean-Luc-Schwartz).
Result of motor adaptation
Biomechanical model
M
Lametti, D. R., Nasir, S. M., & Ostry, D. J. (2012). Sensory preference in speech production revealed by simultaneous alteration of auditory and somatosensory feedback. The Journal of Neurosciences
Both auditory and somatosensory
information are taken into account in
speech production
M
Experimental findings suggest sensory preferences in speech production (Lametti et al., 2012)
Bayesian Model
Activated Sensory Constraints
Outcome of motor planning
Predictions Specifications
M
A
MA
ФS
ФS
MC
SC
AФ
Motor commands
Constraints
Phonological units
Sensory-Motor variables
Sensory-Phonolo- gical variables Coherence
variables
4. Implementation: Adaptation to an auditory perturbation
Weighting of pathways
Equivalence of both approaches
is exact in 1dimension and
approximate in higher dimensions.
Posterior Genioglossus
6 muscles activated via 6 parameters (Feldman,1986)
Vowels characterized in:
• 3-D Formant space
• 6-D Muscle length space
Internal models:
Radial Basis Functions
Outcome of productions in auditory space
x x
Outcome of motor planning
x x
ON OFF
Update of auditory-motor internal model
A
Auditory space
Auditory planning Somato. planning Fusion planning
1st approach
Hard constraint
2nd approach Soft constraint
δF1=+100 Hz
δF1=-100 Hz
Unperturbed condition
Perturbed condition
Somatosensory (PCA) space
[κA κ S] [κ A κ S]
ɔ
a
[ηA ηS] [ηA ηS]
[ηA ηS] [ηA ηS]
a
ɔ
ɔ a
œ
