Semantic processing of iconic signs is not automatic: Neural evidence from hearing non-signers

• Akers, Emily M. ^[2] ; Midgley, Katherine J. ^[1] ; Holcomb, Phillip J. ^[1] ; Emmorey, Karen ^[1]
  1. [1] San Diego State University

     San Diego State University

     Estados Unidos

     
  2. [2] Joint Doctoral Program in Language and Communicative Disorders, San Diego State University & University of California, San Diego
• Localización: Bilingualism: Language and cognition, ISSN 1366-7289, Vol. 28, Nº 5, 2025, págs. 1281-1289
• Idioma: inglés
• DOI: 10.1017/s1366728924001093
• Texto completo no disponible (Saber más ...)
• Resumen

  • Iconicity facilitates learning signs, but it is unknown whether recognition of meaning from the sign form occurs automatically. We recorded ERPs to highly iconic (transparent) and non-iconic ASL signs presented to one group who knew they would be taught signs (learners) and another group with no such expectations (non-learners). Participants watched sign videos and detected an occasional grooming gesture (no semantic processing required). Before sign onset, learners showed a greater frontal negativity compared to non-learners for both sign types, possibly due to greater motivation to attend to signs. During the N400 window, learners showed greater negativity to iconic than non-iconic signs, indicating more semantic processing for iconic signs. The non-learners showed a later and much weaker iconicity effect. The groups did not differ in task performance or in P3 amplitude. We conclude that comprehending the form-meaning mapping of highly iconic signs is not automatic and requires motivation and attention.

• Referencias bibliográficas
  • Akers, E. M., Midgley, K. J., Holcomb, P. J., Meade, G., & Emmorey, K. (2024). Neural effects differ for learning highly iconic versus...
  • Atkinson, C. M., Drysdale, K. A., & Fulham, W. R. (2003). Event-related potentials to Stroop and reverse Stroop stimuli. International...
  • Caselli, N. K., Sehyr, Z. S., Cohen-Goldberg, A. M., & Emmorey, K. (2017). ASL-LEX: A lexical database of American Sign Language. Behavior...
  • Cassell, J., McNeill, D., & McCullough, K. E. (1999). Speech-gesture mismatches: Evidence for one underlying representation of linguistic...
  • Courchesne, E., Hillyard, S. A., & Galambos, R. (1975). Stimulus novelty, task relevance and the visual evoked potential in man. Electroencephalography...
  • Emmorey, K., Midgley, K. J., & Holcomb, P. J. (2022). Tracking the time course of sign recognition using ERP repetition priming. Psychophysiology,...
  • Grainger, J., Kiyonaga, K., & Holcomb, P. J. (2006). The time course of orthographic and phonological code activation. Psychological Science,...
  • Greenhouse, S. W., & Geisser, S. (1959). On methods in the analysis of profile data. Psychometrika, 24(2), 95–112. https://doi.org/10.1007/BF02289823
  • Gurney, D. J., Pine, K. J., & Wiseman, R. (2013). The gestural misinformation effect: Skewing eyewitness testimony through gesture. The...
  • Hansen, J. C., & Hillyard, S. A. (1980). Endogeneous brain potentials associated with selective auditory attention. Electroencephalography...
  • Holcomb, P. J., & Grainger, J. (2006). On the time course of visual word recognition: An event-related potential investigation using masked...
  • Holle, H., & Gunter, T. C. (2007). The role of iconic gestures in speech disambiguation: ERP evidence. Journal of Cognitive Neuroscience,...
  • Johnstone, K. L., Blades, M., & Martin, C. (2023). No gesture too small: An investigation into the ability of gestural information to...
  • Kelly, S. D., Barr, D. J., Church, R. B., & Lynch, K. (1999). Offering a hand to pragmatic understanding: The role of speech and gesture...
  • Mägiste, E. (1984). Stroop tasks and dichotic translation: The development of interference patterns in bilinguals. Journal of Experimental...
  • Makeig, S., Bell, A. J., Jung, T. P., & Sejnowski, T. J. (1996). Independent component analysis of electroencephalographic data. Advances...
  • McNeill, D. (1992). Hand and mind: what gestures reveal about thought. The University of Chicago PressPlaceholder Text.
  • Miller, E. K., & Cohen, J. D. (2001). An integrative theory of prefrontal cortex function. Annual Review of Neuroscience, 24(1), 167–202....
  • Nieuwenhuis, S., Aston-Jones, G., & Cohen, J. D. (2005). Decision making, the P3, and the locus coeruleus--norepinephrine system. Psychological...
  • Ortega, G., Özyürek, A., & Peeters, D. (2020). Iconic gestures serve as manual cognates in hearing second language learners of a sign...
  • Özyürek, A., Willems, R. M., Kita, S., & Hagoort, P. (2007). On-line integration of semantic information from speech and gesture: Insights...
  • Rosselli, M., Ardila, A., Santisi, M. N., Arecco, M. D. R., Salvatierra, J., Conde, A., & Lenis, B. (2002). Stroop effect in Spanish–English...
  • Sabourin, L., Brien, C., & Burkholder, M. (2014). The effect of age of L2 acquisition on the organization of the bilingual lexicon: Evidence...
  • Sehyr, Z. S., Caselli, N., Cohen-Goldberg, A., Emmorey, K. (2021). The ASL-LEX 2.0 Project: A database of lexical and phonological properties...
  • Sehyr, Z. S., & Emmorey, K. (2019). The perceived mapping between form and meaning in American Sign Language depends on linguistic knowledge...
  • Soskey, L., Holcomb, P. J. & Midgley, K. J. (2016) Language effects in second-language learners: A longitudinal electrophysiological study...
  • Squires, K. C., Squires, N. K., & Hillyard, S. A. (1975). Decision-related cortical potentials during an auditory signal detection task...
  • Stroop, J. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18(6), 643. https://psycnet.apa.org/doi/10.1037/h0054651
  • Woldorff, M. G., & Hillyard, S. A. (1991). Modulation of early auditory processing during selective listening to rapidly presented tones....
  • Wu, Y. C., & Coulson, S. (2005). Meaningful gestures: Electrophysiological indices of iconic gesture comprehension. Psychophysiology,...
  • Yum, Y. N., Midgley, K. J., Holcomb, P. J., & Grainger, J. (2014). An ERP study on initial second language vocabulary learning: Initial...