CALLIOPE: A multi-dimensional model for the prosodic characterization of Information Units

• Sonia Cenceschi ^[1] ; Licia Sbattella ^[1] ; Roberto Tedesco ^[1]
  1. [1] Polytechnic University of Milan

     Polytechnic University of Milan

     Milán, Italia

     
• Localización: Estudios de fonética experimental, ISSN 1575-5533, ISSN-e 2385-3573, Nº. 30, 2021, págs. 227-245
• Idioma: inglés
• Enlaces
  • Texto completo (pdf)
• Resumen

  • CALLIOPE is a conceptual multi-dimensional model that aims at approximating and categorizing the prosodic phenomena taking into account of all possible independent factors affecting the sound of so-called Information Units (IUs). In CALLIOPE, each IU is associated with a tuple composed of 12 labels, each belonging to a different dimension representing a characteristic influencing the prosodic behaviour. Its ultimate aim is creating well-defined corpora suitable for linguistic and engineering research.

• Referencias bibliográficas
  • Akçay, M. B., & Oğuz, K. (2020). Speech emotion recognition: Emotional models, databases, features, preprocessing methods, supporting...
  • Arora, S., Batra, K., & Singh, S. (2013). Dialogue system: A brief review, arXiv:1306.4134.
  • Austin, J. L. (1975). How to do things with words. Oxford University Press.
  • Baker, J. M., Deng, L., Glass, J., Khudanpur, S., Lee, C. H., Morgan, N., & O’Shaughnessy, D. (2009). Developments and directions in speech...
  • Beckman, M. E., Hirschberg, J. B., & ShattuckHufnagel, S. (2004). The original ToBI system and the evolution of the ToBI framework. In...
  • Bennett, R. T. (2012). Foot-conditioned phonotactics and prosodic constituency (Unpublished doctoral dissertation). UC Santa Cruz, United...
  • Berruto, G., & Cerruti, M. S. (2015). Manuale di sociolinguistica. Utet Università.
  • Boersma, P., & Weenink, D. (2017). Praat, a system for doing phonetics by computer (version 6.0. 28). Institute of Phonetic Sciences University...
  • Booij, G. (1999). The role of the prosodic word in phonotactic generalizations, Amsterdam studies in the theory and history of linguistic...
  • Bunt, H. (2009). The DIT++ taxonomy for functional dialogue markup. Proceedings of the AAMAS 2009 Workshop: Towards a Standard Markup...
  • Bunt, H., Petukhova, V., Traum, D., & Alexandersson, J. (2017). Dialogue act annotation with the ISO 24617-2 standard. In Dahl A. D. (Ed.)....
  • Büring, D. (2009). Towards a typology of focus realization. In M. Zimmermann & C. Féry (Eds.). Information Structure (pp. 177-205). Oxford...
  • Calliope, L., & Fant, G. (1989). La parole et son traitement automatique. Masson.
  • Carbone, F., & Petrone, C. (2020). L’impact de la prosodie et du lexique des émotions sur l'activité électrodermale en français, Colloque...
  • Cenceschi, S. (2019). Speech analysis for automatic prosody recognition (Unpublished doctoral dissertation). Politecnico di Milano, Italy.
  • Cenceschi S., Meluzzi C., & Nese, N. (2021). Speaker’s identification across recording modalities: a preliminary phonetic experiment,...
  • Cenceschi, S., Tedesco, R., Sbattella, L., Losio, D., & Luchetti, M. (2019). PESInet: Automatic Recognition of Italian Statements, Questions,...
  • Cenceschi, S., Sbattella, L., & Tedesco, R. (2018a). Influence of semantics on the perception of corrective focus in spoken Italian. In...
  • Cenceschi, S., Sbattella, L., & Tedesco, R. (2018b). Towards automatic recognition of prosody. In Klessa K., Bachan J., Wagner A.,Karpiński...
  • Cenceschi, S., Sbattella, L., & Tedesco, R. (2018c). Verso il riconoscimento automatico della prosodia. In Avesani C. (Ed). Proceedings...
  • Cole, J. (2015). Prosody in context: A review, Language, Cognition and Neuroscience, 30(1- 2), 1-31.
  • Coseriu, E. (1980). “Historische Sprache" und "Dialekt” (pp. 45-61). Franz Steiner Verlag.
  • Cresti, E. (2000). Corpus di italiano parlato (Vol. 1). Accademia della Crusca.
  • Cresti, E. (2014). Syntactic properties of spontaneous speech in the Language into Act Theory. In Raso T. & Mello H. (Eds). Spoken Corpora...
  • Cresti, E. (2020). The pragmatic analysis of speech and its illocutionary classification according to the Language into Act Theory. In S....
  • Cresti, E., Martin, P., & Moneglia, M. (1998). L’intonazione delle illocuzioni naturali rappresentative: analisi e validazione percettiva....
  • Davis, M. H., & Johnsrude, I. S. (2007). Hearing speech sounds: top-down influences on the interface between audition and speech perception....
  • De Iacovo, V. (2019). Intonation analysis on some samples of Italian dialects: An instrumental approach (Vol. 3). Edizioni dell’Orso.
  • D’Imperio, M. (2002). Italian intonation: An overview and some questions. Probus, 14(1), 37-69.
  • Domínguez, L. (2004). Mapping focus: The syntax and prosody of focus in Spanish (Unpublished doctoral dissertation). Boston University, United...
  • Douglas-Cowie E. et al. (2007). The HUMAINE database: Addressing the collection and annotation of naturalistic and induced emotional data....
  • Fassone, G., Valcella, F., Pallini, S., Scarcella, F., Tombolini, L., Ivaldi, A., & Liotti, G. (2012). Assessment of Interpersonal Motivation...
  • Ferrari, G. (2004). State of the art in Computational Linguistics. In Van Sterkenburg P. (Ed). Linguistics today: Facing a greater challenge,...
  • Firenzuoli, V. (2003). Le forme intonative di valore illocutivo dell'italiano parlato. Analisi sperimentale di un corpus di parlato spontaneo...
  • Fujisaki, H. (1997). Prosody, models, and spontaneous speech. In Sagisaka Y., Campbell N., & Higuchi N. (Eds). Computing prosody: Computational...
  • Fux, T., Feng, G., & Zimpfer, V. (2011). Relevant acoustic features of speech signals for natural-to-shouted voice transformation, Proceedings...
  • Ghaffarzadegan, S., Bořil, H., & Hansen, J. H. (2014). Model and feature based compensation for whispered speech recognition. In Li, H....
  • Goldrick, M. (2004). Phonological features and phonotactic constraints in speech production, Journal of Memory and Language, 51(4), 586- 603.
  • Gussenhoven, C. (2008). Types of focus in English. In Topic and focus (pp. 83-100). Springer.
  • Hansen, J. H., Nandwana, M. K., & Shokouhi, N. (2017). Analysis of human scream and its impact on text-independent speaker verification,...
  • Harris, R. A. (1997). A handbook of rhetorical devices. Retrieved from https://hellesdon.org/documents/Advanced%2 0Rhetoric.pdf
  • Hacquard (2011). Modality. In Maienborn C., von Heusinger K., & Portner P. (Eds.), Semantics: An international handbook of natural language...
  • Haugen, E. (1966). Dialect, Language, Nation 1. American anthropologist, 68(4), 922-935.
  • Hymes, D. (2013). Foundations in sociolinguistics: An ethnographic approach. Routledge.
  • Kazanina, N., Phillips, C., & Idsardi, W. (2006). The influence of meaning on the perception of speech sounds. Proceedings of the National...
  • Klasen, M., von Marschall, C., Isman, G., Zvyagintsev, M., Gur, R. C., & Mathiak, K. (2018). Prosody production networks are modulated...
  • Kompe, R., & Kompe, R. (1997). Prosody in speech understanding systems (Vol. 1307). Springer.
  • Kratzer, A. (2012). Modals and conditionals: New and revised perspectives (Vol. 36). Oxford University Press.
  • Jovičić, S. T. (1998). Formant feature differences between whispered and voiced sustained vowels, Acta Acustica united with Acustica, 84(4),...
  • Leoni, F. A. (2001). Il ruolo dell'udito nella comunicazione linguistica. Il caso della prosodia, Italian Journal of Linguistics, 13,...
  • Leoni, F. A. (2017). Lingua e patologia: Le frontiere interdisciplinari del linguaggio. Aracne.
  • Leoni, F. A., & Giordano, F. (2005) (a cura di), Italiano parlato. Analisi di un dialogo. Liguori, Napoli.
  • Likitha, M. S., Gupta, S. R. R., Hasitha, K., & Raju, A. U. (2017, March). Speech based human emotion recognition using MFCC. In 2017...
  • Liotti, G., & Monticelli, F. (2008). I sistemi motivazionali nel dialogo clinico. Raffaello Cortina.
  • Llisterri, J. (1992, July). Speaking styles in speech research, ELSNET/ESCA/SALT Workshop on Integrating Speech and Natural Language, Dublin,...
  • López Zorrilla, A., De Velasco Vázquez, M., Cenceschi, S., & Torres Barañano, M. I. (2018). Corrective focus detection in Italian speech...
  • Nencioni, G. (1983). Di scritto e di parlato: Discorsi linguistici (Vol. 6). Zanichelli.
  • Nicholson, J., Takahashi, K., & Nakatsu, R. (2000). Emotion recognition in speech using neural networks, Neural computing & applications,...
  • Noth, E., Batliner, A., Kießling, A., Kompe, R., & Niemann, H. (2000). Verbmobil: The use of prosody in the linguistic components of a...
  • Origlia, A., Cutugno, F., & Galatà, V. (2014). Continuous emotion recognition with phonetic syllables. Speech Communication, 57, 155-...
  • Plutchik, R. (1991). The emotions. University Press of America.
  • Prieto, P., Borràs-Comes, J., & Roseano, P. (2010). Interactive atlas of Romance intonation. Retreived from http://prosodia. upf. edu/iari.
  • Romano, A., Contini, M., & Lai, J. P. (2014). L’Atlas Multimédia Prosodique de l’Espace Roman: uno strumento per lo studio della variazione...
  • Sbattella, L., Tedesco, R., & Trivilini, A. (2014). Forensic examinations: Computational analysis and information extraction. Proceedings...
  • Schuller, B., Batliner, A., Steidl, S., & Seppi, D. (2011). Recognising realistic emotions and affect in speech: State of the art and...
  • Schröder, M., Pirker, H., & Lamolle, M. (2006, May). First suggestions for an emotion annotation and representation language, Proceedings...
  • Swain, M., Routray, A., & Kabisatpathy, P. (2018). Databases, features and classifiers for speech emotion recognition: a review, International...
  • Tamburini, F., Bertini, C., & Bertinetto, P. M. (2014). Prosodic prominence detection in Italian continuous speech using probabilistic...
  • Tomkins, S. S. (1984). Affect theory. In Scherer K. R. & Ekma P. (Eds.), Approaches to emotion (pp. 163-195). Psychology Press.
  • Vasco, V., Gensini, S., & Leoni, F. A. (2010). Tu chiamale se vuoi emozioni”: Espressione e riconoscimento degli stati d’animo nel parlato...
  • Vogt, T. (2010). Real-time automatic emotion recognition from speech (Unpublished doctoral dissertation). Universität Bielefeld, Germany.
  • Wallace, K. R. (1970). Understanding Discourse: The Speech Act and Rhetorical Action. Louisiana State University Press.
  • Wilks, Y., Catizone, R., Worgan, S., & Turunen, M. (2010). Some background on dialogue management and conversational speech for dialogue...
  • Williams, C. E., & Stevens, K. N. (1972). Emotions and speech: Some acoustical correlates, The Journal of the Acoustical Society of America,...
  • Zhang, C., & Hansen, J. H. (2007). Analysis and classification of speech mode: whispered through shouted, Eighth Annual Conference of...
  • Zentner, M., Grandjean, D., & Scherer, K. R. (2008). Emotions evoked by the sound of music: Characterization, classification, and measurement....