Un modelo pluridisciplinar para el estudio de metáfora e imagen a través de la iconicidad intermodal

• Lars Elleström ^[1]
  1. [1] Linnaeus University

     Linnaeus University

     Suecia

     
• Localización: DeSignis: Publicación de la Federación Latinoamericana de Semiótica ( FELS ), ISSN 1578-4223, Nº. 35 (Julio-diciembre), 2021 (Ejemplar dedicado a: Semioticas cognitivas. Nuevos paradigmas = Cognitive semiotics. New paradigms / coord. por Asunción López-Varela Azcárate ; Luis Martínez Falero Galindo (col.) , Lucia Santaella Braga (col.)), págs. 173-195
• Idioma: español
• DOI: 10.35659/designis.i35p173-195
• Títulos paralelos:
  • Bridging the gap between image and metaphor through cross-modal iconicity: an interdisciplinary model
• Enlaces
  • Texto Completo Ejemplar
• Resumen
  • español

    La mente humana es capaz de percibir similitudes no solo dentro de la misma área sensorial sino también entre áreas sensoriales y dominios cognitivos distintos. La iconicidad es una representación basada en la similitud, y la iconicidad intermodal, que es un fenómeno extremadamente extendido, debe entenderse como la iconicidad que traspasa las fronteras de diferentes tipos de modos materiales, espaciotemporales y sensoriales, además de la frontera entre estructuras sensoriales y configuraciones cognitivas. Por ejemplo, una entidad visual puede parecerse y, por lo tanto, representar icónicamente algo que es auditivo. El objetivo de este estudio semiótico, basado sustancialmente en hallazgos empíricos en la investigación psicológica, cognitiva y neurológica, es sugerir un marco teórico general para conceptualizar la iconicidad intermodal y relacionar los diferentes tipos de iconicidad monomodal e intermodal entre sí. El argumento principal es que la percepción y la concepción de imágenes y metáforas deben entenderse como extremos en un continuo de representación icónica donde la iconicidad intermodal cierra la aparente brecha entre la iconicidad monomodal, basada en los sentidos, y la iconicidad cognitiva. El artículo ofrece un esquema de los modos materiales, espaciotemporales y sensoriales y de sus interrelaciones, junto a una descripción detallada de la iconicidad intermodal y una estructura conceptual, para trazar grados de similitud e iconicidad con la ayuda de modalidades cruzadas. Se añaden también una serie de ejemplos que ilustran la continuidad de la iconicidad desde la imagen hasta la metáfora y una breve discusión sobre la noción de los esquemas-imagen como factor explicativo de la iconicidad intermodal.

  • English

    Our minds are capable of perceiving similarities not only within the same but also across different sensory areas and different cognitive domains. Iconicity is representation based on similarity, and cross-modal iconicity, which is an extremely widespread phenomenon, should be understood as iconicity that crosses the borders of different kinds of material, spatiotemporal, and sensorial modes, and, furthermore, the border between sensory structures and cognitive configurations. For instance, a visual entity may resemble and thus iconically represent something that is auditory or abstractly cognitive. The aim of this semiotic study, substantially based on empirical findings in psychological, cognitive, and neurological research, is to suggest a general theoretical framework for conceptualizing cross-modal iconicity and relating different kinds of mono-modal and cross-modal iconicity to each other. Its chief argument is that perception and conception of images and metaphors should be understood as the two extremes in a continuum of iconic representation where cross-modal iconicity bridges the apparent gap between mono-modal, sensory-based iconicity and cognitive iconicity. It offers an outline of material, spatio-temporal, and sensorial modes and their interrelations; a thorough account of cross-modal iconicity; a conceptual structure for charting degrees of similarity and iconicity with the aid of cross-modality; an array of examples illustrating the continuum of iconicity from image to metaphor; and a brief discussion of the notion of image schema as an explanatory factor for cross-modal iconicity.

• Referencias bibliográficas
  • AHLNER, F. and ZLATEV, J. (2010). Cross-modal iconicity: A cognitive semiotic approach to sound symbolism. Sign Systems Studies 38: 298-348.
  • ANDERSON, E.R. (1998). A Grammar of Iconism. Madison/Teaneck: Farleigh Dickinson University Press.
  • BANKIERIS, K. and SIMNER, J. (2015). What is the link between synaesthesia and sound symbolism? Cognition 136: 186-195.
  • BAUER, M. and ERNST, C. (2010). Diagrammatik: Einführung in ein kultur- und medienwissenschaftliches Forschungsfeld. Bielefeld: Transcript.
  • BENOVSKY, J. (2012). Photographic representation and depiction of temporal extension. Inquiry 55(2): 194-213.
  • BREMNER, A.J., CAPAROS, S., DAVIDOFF, J., FOCKERT, J. DE, LINNELL, K.J. and SPENCE, C. (2013). “Bouba” and “Kiki” in Namibia? A remote culture...
  • BROCHARD, R., TASSIN, M., and ZAGAR, D. (2013). Got rhythm … for better and for worse: Cross-modal effects of auditory rhythm on visual word...
  • CACCIARI, C. (2008). Crossing the senses in metaphorical language. In The Cambridge Handbook of Metaphor and Thought, R.W. GIBBS (ed.), 425-443....
  • CIENKI, A. (2005). Image schemas and gesture. In From Perception to Meaning: Image Schemas in Cognitive Linguistics, B. HAMPE (ed.), 421-441....
  • COLAPIETRO, V. (2011). Image, diagram, and metaphor: Unmined resource and unresolved questions. In Semblance and Signification [Iconicity...
  • COWLES, J.T. (1935). An experimental study of the pairing of certain auditory and visual stimuli. Journal Experimental Psychology 18(4): 461-469.
  • ECO, U. (1976). A Theory of Semiotics. Bloomington: Indiana Univ. Press.
  • ELLESTRÖM, L. (2010a). The modalities of media: A model for understanding intermedial relations. In Media Borders, Multimodality and Intermediality,...
  • ELLESTRÖM, L. (2010b). Iconicity as meaning miming meaning, and meaning miming form. In Signergy [Iconicity in Language and Literature 9],...
  • ELLESTRÖM, L. (2013). Spatiotemporal aspects of iconicity. In Iconic Investigations [Iconicity in Language and Literature 12], L. ELLESTRÖM,...
  • ELLESTRÖM, L. (2014). Material and mental representation: Peirce adapted to the study of media and arts. The American Journal of Semiotics...
  • FORCEVILLE, C. (2009). Non-verbal and multimodal metaphor in a cognitivist framework: Agendas for research. In Multimodal Metaphor, C. FORCEVILLE,...
  • FRYER, L., FREEMAN, J. and PRING, L. (2014). Touching words is not enough: How visual experience influences haptic–auditory associations in...
  • GOSWAMI, U. (2001). Analogical reasoning in children. In The Analogical Mind: Perspectives from Cognitive Science, D. Gentner, K. J. Holyoak,...
  • JOHNSON, M. (1987). The Body in the Mind: The Bodily Basis of Meaning, Imagination, and Reason. Chicago: University of Chicago Press.
  • KARWOSKI, T.F., ODBERT, H.S. and OSGOOD, C. E. (1942). Studies in synesthetic thinking: II. The role of form in visual responses to music....
  • KÖHLER, W. (1929). Gestalt Psychology. New York: Horace Liveright.
  • KRESS, G. and VAN LEEUWEN, T. (2001). Multimodal Discourse: The Modes and Media of Contemporary Communication. London: Hodder Arnold.
  • MARTINO, G. and MARKS, L.E. (2000). Cross-modal interaction between vision and touch: The role of synesthetic correspondence. Perception 29:...
  • MORRIS, C. (1971). Writings on the General Theory of Signs. The Hague and Paris: Mouton.
  • MOSSBRIDGE, J. A., GRABOWECKY, M. and SUZUKI, S. (2011). Changes in auditory frequency guide visual–spatial attention. Cognition 121: 133-39.
  • NÖTH, W. (2001). Semiotic foundations of iconicity in language and literature. In The Motivated Sign [Iconicity in Language and Literature...
  • ODBERT, H.S., KARWOSKI, T.F. and ECKERSON, A.B. (1942). Studies in synesthetic thinking: I. Musical and verbal associations of color and mood....
  • PEIRCE, C.S. (1932). Collected Papers of Charles Sanders Peirce II: Elements of Logic, C. HARTSHORNE AND P. WEISS (eds). Cambridge, MA: Harvard...
  • PERLMAN, M., TANNER, J.E. and KING, B.J. (2012). A mother gorilla’s variable use of touch to guide her infant: Insights into iconicity and...
  • PERNISS, P., THOMPSON, R.L. and VIGLIOCCO, G. (2010). Iconicity as a general property of language: Evidence from spoken and signed languages....
  • PERNISS, P., and VIGLIOCCO, G. (2014). The bridge of iconicity: From a world of experience to the experience of language. Philosophical transactions...
  • PERRY, L.K., PERLMAN, M. and LUPYAN, G. (2015). Iconicity in English and Spanish and its relation to lexical category and age of acquisition....
  • POPOVA, Y. (2005). Image schemas and verbal synaesthesia. In From Perception to Meaning: Image Schemas in Cognitive Linguistics, B. HAMPE...
  • RAMACHANDRAN, V.S. and HUBBARD, E.M. (2005). The emergence of the human mind: Some clues from synesthesia. In Synesthesia: Perspectives From...
  • RÖDER, B., PAGEL, B. and HEED, T. (2013). The implicit use of spatial information develops later for crossmodal than for intramodal temporal...
  • ROHRER, T. (2005). Image schemata in the brain. In From Perception to Meaning: Image Schemas in Cognitive Linguistics, B. HAMPE (ed.), 165-196....
  • SMITH J.D., FLEMMING, T.M., BOOMER, J., BERAN, M.J. and CHURCH B.A. (2013). Fading perceptual resemblance: A path for rhesus macaques (Macaca...
  • SMITH, L.B. AND HEISE, D. (1992). Perceptual similarity and conceptual structure. In Percepts, Concepts and Categories, B. Burns (ed.), 233-272....
  • SPENCE, C. (2011). Crossmodal correspondences: A tutorial review. Attention, Perception, & Psychophysics 73(4): 971-995.
  • STEIN, B.E., SPENCE, C., and CALVERT, G. (2004). The Handbook of Multisensory Processes. Cambridge, MA: MIT Press.
  • SUTHERLAND, C.A.M., THUT, G. and ROMEI, V. (2014). Hearing brighter: Changing in-depth visual perception through looming sounds. Cognition...
  • SWEENY, T.D., GUZMAN-MARTINEZ, E., ORTEGA, L., GRABOWECKY, M. and SUZUKI, S. 2012. Sounds exaggerate visual shape. Cognition 124: 194-200.
  • TABAKOWSKA, E. (2003). Iconicity and literary translation. In From Sign to Signing [Iconicity in Language and Literature 3], W. G. Müller...
  • TABAKOWSKA, E. (2005). Iconicity as a function of point of view. In Outside-In – Inside-Out [Iconicity in Language and Literature 4], C. MAEDER,...
  • USNADZE, D. (1924). Ein experimenteller Beitrag zum Problem der psychologischen Grundlagen der Namengebung. Psychologische Forschung 5(1):...
  • YILDIRIM, I. and JACOBS, R.A. (2013). Transfer of object category knowledge across visual and haptic modalities: Experimental and computational...
  • ZBIKOWSKI, L.M. (2008). Metaphor and music. In The Cambridge Handbook of Metaphor and Thought, R. W. GIBBS (ed.), 502-524. Cambridge: Cambridge...
  • ZIEMBOWICZ, M., NOWAK, A. and WINKIELMAN, P. (2013). When sounds look right and images sound correct: Cross-modal coherence enhances claims...