Overview of the IDPT Task on Irony Detection in Portuguese at IberLEF 2021

• Autores: Leonardo Santos, Larissa A. de Freitas, Ulisses B. Corrêa, Leonardo Coelho Corrêa-Rosado
• Localización: Procesamiento del lenguaje natural, ISSN 1135-5948, Nº. 67, 2021, págs. 269-276
• Idioma: inglés
• Títulos paralelos:
  • Resumen de la tarea de detección de ironía en portugués (IDPT) en IberLEF 2021
• Enlaces
  • Texto completo
• Resumen
  • español

    Este artículo presenta la Tarea sobre Detección de Ironías en Portugués (IDPT), realizada en el IberLEF 2021. Les pedimos a los participantes que desarrollaran sistemas capaces de identificar la ironía en los textos. Creamos dos corpora que contienen tweets y artículos de noticias. Doce equipos se inscribieron en la tarea, entre los cuales seis presentaron predicciones e informes técnicos. El sistema con mejor rendimiento logró un valor de precisión equilibrada (Bacc) de 0,52 para los tweets (Equipo PiLN) y 0,92 para las noticias (Equipo BERT4EVER).

  • English

    This paper presents the Task on Irony Detection in Portuguese (IDPT), held within Iberian Languages Evaluation Forum (IberLEF 2021). We asked the participants to develop systems capable of identifying irony in texts. We created two corpora containing tweets and news articles. Twelve teams registered to the task, among which six submitted both predictions and technical reports. The best performing system achieved a Balanced Accuracy (Bacc) value of 0.52 for tweets (Team PiLN) and 0.92 for news (Team BERT4EVER).

• Referencias bibliográficas
  • Attardo, S. 2000. Irony as relevant inappropriateness. Pragmatics, 32(6):793–826.
  • Bosco, C., F. Dell’Orletta, F. Poletto, M. Sanguinetti, and M. Tesconi. 2018. Overview of the EVALITA 2018 hate speech detection task. In...
  • Bueno, R. O., F. M. R. Pardo, D. I. H. Farías, P. Rosso, M. Montes-y-Gómez, and J. Medina-Pagola. 2019. Overview of the task on irony detection...
  • Cignarella, A. T., S. Frenda, V. Basile, C. Bosco, V. Patti, and P. Rosso. 2018. Overview of the EVALITA 2018 task on irony detection in italian...
  • Fleiss, J. L. 1971. Measuring nominal scale agreement among many raters. Psychological Bulletin, 76(5):378–382.
  • Freitas, L., L. dos Santos, and D. Deon. 2020. Padrões linguísticos para deteçcão de ironia em múltiplos idiomas. Revista Eletrônica de Iniciação...
  • Freitas, L. A., A. A. Vanin, D. N. Hogetop, M. N. Bochernitsan, and R. Vieira. 2014. Pathways for irony detection in tweets. In Proceedings...
  • Ghanem, B., J. Karoui, F. Benamara, V. Moriceau, and P. Rosso. 2019. Idat at fire2019: Overview of the track on irony detection in arabic...
  • Gibbs, R. W. and H. L. Colston. 2001. The risks and rewards of ironic communication. IOS Press. Grice, H. P. 1975. Logic and conversation. Academic...
  • Gupta, R. K. and Y. Yang. 2017. CrystalNest at SemEval-2017 task 4: Using sarcasm detection for enhancing sentiment classification and quantification....
  • Hee, C. V., E. Lefever, and V. Hoste. 2018. SemEval-2018 task 3: Irony detection in English tweets. In Proceedings of The 12th International...
  • Kreuz, R. J. and S. Glucksberg. 1989. How to be sarcastic: The choice reminder theory of verbal irony. Experimental Psychology, 118(4):374–386.
  • Marchetti, A., D. Massaro, and A. Valle. 2007. Non dicevo sul serio. Riflessioni su ironia e psicologia. Franco Angeli.
  • Pang, B. and L. Lee. 2008. Opinion mining and sentiment analysis. Foundations and Trends® in Information Retrieval, 2(1–2):1–135.
  • Reyes, A., P. Rosso, and D. Buscaldi. 2012. From humor recognition to irony detection: The figurative language of social media. Data and Knowledge...
  • Reyes, A., P. Rosso, and T. Veale. 2013. A multidimensional approach for detecting irony in twitter. Language Resources and Evaluation, 47(1):239–268.
  • Schubert, G. and L. A. de Freitas. 2020. A construção de um corpus para deteção de ironia e sarcasmo em português. In Anais do XVII Encontro...
  • Searle, J. R. 1969. Speech Acts: An Essay in the Philosophy of Language. Cambridge University Press.
  • Silva, F. R. 2018. Detecção de Ironia e Sarcasmo em Língua Portuguesa. https://github.com/fabioricardo/deteccao-ironia. Acessado em: 25-05-2019.
  • Souza, F., R. Nogueira, and R. Lotufo. 2020. BERTimbau: pretrained BERT models for Brazilian Portuguese. In 9th Brazilian Conference on Intelligent...
  • Sperber, D. and D. Wilson. 1981. Irony and the Use - Mention Distinction. Academic Press.
  • Van Hee, C., E. Lefever, and V. Hoste. 2016. Guidelines for annotating irony in social media text, version 2.0. Technical report, LT3 Technical...
  • Wick-Pedro, G. and O. A. Vale. 2020. Comentcorpus: Description and analysis of irony in a corpus of opinion for brazilian portuguese. Cadernos...