Escribiendo a una máquina: la evaluación automática de textos a debate

• RUIZ HERRERO, JUAN ^[1]
  1. [1] INSTITUTO CERVANTES DE BEIRUT
• Localización: MarcoELE: Revista de Didáctica Español Lengua Extranjera, ISSN-e 1885-2211, Nº. 23, 2016
• Idioma: español
• Enlaces
  • Texto completo (pdf)
• Resumen
  • español

    Los sistemas de evaluación automática de textos, programas diseñados para puntuar ejercicios de producción escrita en exámenes en L1 o L2, se han generalizado en las últimas décadas en el panorama académico estadounidense. La presente contribución se propone plantear el estado de la cuestión, describiendo el funcionamiento de dichas aplicaciones y analizando el constructo que miden. Se presentan, así, las ventajas que supone su introducción en el contexto de exámenes de certificación y del trabajo de aula, contrapuestas a los argumentos que hacen valer sus detractores, con el objetivo de acercar la temática al ámbito hispanoparlante y apuntar una reflexión desde la perspectiva del docente de lenguas extranjeras.

  • English

    Automated Essay Scoring (AES) engines, computer systems designs to rate written exercises in both L1 and L2 tests, have known a remarkable spread through the last decades in the academic reality of the United States. The present article reviews the state of the question, describing the functioning of these devices and analyzing the measured construct. The main advantages related to their introduction will then be presented, in contraposition to the main objections voiced by its detractors, with the aim of sustaining a reflection from the perspective of foreign languages teachers.

• Referencias bibliográficas
  • Anson, C.M. (2006). Can't Touch This: Reflections on the Servitude of Computers as Readers. En Ericsson, P.F., & Haswell, R.H. (eds.), Machine...
  • Attali, Y. (2007). Construct validity of e‐rater® in scoring TOEFL® essays. ETS Research Report Series, 1, i-22.
  • Attali, Y., & Powers, D. (2009). Validity of scores for a developmental writing scale based on automated scoring. Educational and psychological...
  • Berthoff, A.E. (1978). Tolstoy, Vygotsky, and the making of meaning. College Composition and Communication, 29(3): 249- 255.
  • Chen, C.F.E., & Cheng, W. Y. E. (2008). Beyond the design of automated writing evaluation: Pedagogical practices and perceived learning...
  • Condon, W. (2013). Large-scale assessment, locally-developed measures, and automated scoring of essays: Fishing for red herrings? Assessing...
  • Crossley, S.A., Kyle, K., Allen, L., Gou, L., & McNamara, D.S. (2014). Linguistic microfeatures to predict L2 writing proficiency: A case study...
  • Crossley, S.A., & McNamara, D.S. (2012). Predicting second language writing proficiency: the roles of cohesion and linguistic sophistication....
  • Deane, P. (2013). On the relation between automated essay scoring and modern views of the writing construct. Assessing Writing, 18(1): 7-24.
  • Dikli, S. (2006). An overview of automated scoring of essays. The Journal of Technology, Learning and Assessment, 5(1): 1-35.
  • Enright, M.K., & Quinlan, T. (2010). Complementing human judgment of essays written by English language learners with erater® scoring....
  • Ericsson, P.F. (2006). The meaning of meaning: Is a paragraph more than an equation. En Ericsson, P.F., & Haswell, R.H. (eds.), Machine scoring...
  • Haswell, R. (2006). Automatons and automated scoring: Drudges, black boxes, and dei ex machina. En Ericsson, P.F., & Haswell, R.H (eds.),...
  • Herrington, A., & Moran, C. (2001). What happens when machines read our students' writing? College English, 63(4): 480-499.
  • Huot, B. (2002). (Re) articulating writing assessment for teaching and learning. Logan: Utah University Press.
  • Messick, S. (1993). Foundations of validity: Meaning and consequences in psychological assessment. ETS Research Report Series, 1993(2): 1-18.
  • Powers, D.E., Burstein, J.C., Chodorow, M., Fowles, M. E., & Kukich, K. (2001). Stumping E‐Rater: Challenging the validity of automated essay...
  • Quinlan, T., Higgins, D., & Wolff, S. (2009). Evaluating the construct‐ coverage of the e‐rater® scoring engine. ETS Research Report Series,...
  • Shermis, M.D. (2014). State-of-the-art automated essay scoring: Competition, results, and future directions from a United States demonstration....
  • Weigle, S.C. (2013). English language learners and automated scoring of essays: Critical considerations. Assessing Writing, 18(1): 85-99.
  • Williamson, M. (2004). Validity of automated scoring: Prologue for a continuing discussion of machine scoring student writing. Journal of Writing...
  • Williamson, D.M., Xi, X., & Breyer, F.J. (2012). A framework for evaluation and use of automated scoring. Educational Measurement: Issues...