Constituency and Dependency Parsers Evaluation

• Autores: Elisabet Comelles Pujadas , M. Victoria Arranz , Irene Castellón Masalles
• Localización: Procesamiento del lenguaje natural, ISSN 1135-5948, Nº. 45, 2010, págs. 59-66
• Idioma: inglés
• Enlaces
  • Texto completo
• Dialnet Métricas: 1 Cita
• Resumen
  • español

    El presente trabajo muestra la evaluación cuantitativa y cualitativa de un grupo de analizadores de constituyentes y de dependencias con el objetivo de ser usados en el desarrollo de una métrica automática basada en conocimiento para evaluar la salida de sistemas de traducción automática. Primero se describe la metodología seguida en ambos tipos de evaluación y a continuación se muestran los resultados obtenidos y las conclusiones alcanzadas.

  • English

    This work presents the quantitative and qualitative evaluation of a set of both constituency and dependency parsers which are to be used in the development of a knowledge-based automatic MT metric. Firstly, the methodology used in both types of evaluation is described; secondly, we show the results obtained, and finally we draw some conclusions.

• Referencias bibliográficas
  • Attardi, Giuseppe. 2006. Experiments with a Multilanguage Non-Projective Dependency Parser. In Proceedings of the Tenth Conference on Natural...
  • Black, Ezra, S. Abney, D. Flickenger, C. Gdaniec, R. Grishman, P. Harrison, D. Hindle, R. Ingria, F. Jelinek, J. Klavans, M. Liberman, M....
  • Briscoe, Ted, J. Carroll and R. Watson. 2006. The Second Release of the RASP System. In Proceedings of the COLING/ACL 2006 Interactive Presentation...
  • Charniak, Eugene and M. Johnson. 2005. Coarse-to-fine n-best parsing and MaxEnt discriminative reranking. In Proceedings of the 43rd Annual...
  • Collins, Michael. 1999. Head-Driven Statistical Models for Natural Language Parsing. PhD Dissertation, University of Pennsylvania (USA).
  • Comelles, Elisabet, N. J. Laso, I. Verdaguer and E. Giménez. 2010. Clause Pattern DB: a corpus-based tool. Forthcoming in II Congreso Internacional...
  • De Marneffe, Marie-Catherine, B. MacCartney and C. D. Manning. 2006. Generation Typed Dependency Parsers from Phrase Structure Parses. In...
  • Giménez, Jesús, Ll. Márquez, E. Comelles, I. Castellón, V. Arranz. 2010. Document-level Automatic MT Evaluation based on Discourse Representations....
  • Hovy, Edward. 2007. Investigating why BLEU penalizes non-statistical systems. In Proceedings of the eleventh MT Summit. Copenhagen (Denmark).
  • Klein, Dan and Christopher D. Manning. 2003. Accurate unlexicalized parsing. In Proceedings of the 41st Annual Meeting of Association for...
  • Lin, Dekang. 1998. Dependency-based Evaluation of MINIPAR. Proceedings of the Workshop at LREC’98 on The Evaluation of Parsing systems. Granada...
  • Liu, Ding and Daniel Gildea. 2005. Syntactic Features for Evaluation of Machine Translation. In ACL 2005 Workshop on Intrinsic and Extrinsic...
  • Nivre, Joakim. 2006. Inductive Dependency Parsing. Springer Verlag. Dordrecth. The Netherlands.
  • Nivre, Joakim, J. Hall, S. Kübler, R. McDonald, J. Nilsson, S. Riedel and D. Yuret. 2007. The CoNLL 2007 Shared Task on Dependency Parsing....
  • Rimell, Laura, S. Clark, and M. Steedman. 2009. Unbounded Dependency Recovery for Parser Evaluation. In Proceedings of the Conference on Empirical...