Introducing/Testing New SFL-Inspired Communication/Content/Function-Focused Measures for Assessing L2 Narrative Task Performance

• Jie Qin ^[1] ; Dilin Liu ^[2]
  1. [1] South China Agricultural University

     South China Agricultural University

     China

     
  2. [2] The University of Alabama, Tuscaloosa, AL 35487, USA
• Localización: Applied linguistics, ISSN 0142-6001, Vol. 46, Nº 2, 2025, págs. 286-304
• Idioma: inglés
• DOI: 10.1093/applin/amae030
• Texto completo no disponible (Saber más ...)
• Resumen

  • In response to calls for an assessment tool that provides a separate performance dimension from the linguistic quality-oriented measures of complexity, accuracy, and fluency (CAF) and guided by systemic functional linguistic (SFL) theories, this study introduces a set of fine-grained objective measures of communication/content/function (CCF)-related performance in second language (L2) narratives and empirically tests the validity of these measures using vigorous research procedures and statistical tests. The test results show that these CCF measures assessed their intended SFL functional dimensions, in contrast to the key CAF measures that evaluated mainly linguistic dimensions of narrative performance. More specifically, these CCF measures offered an objective evaluation of the communication/content quality of narrative task performance as evaluated by the subjective functional adequacy scales, while the key CAF measures provided an objective assessment of the linguistic quality of task performance as measured by the largely subjective International English Language Testing System (IELTS) scales. The study also discusses the implications of the results for making the assessment of L2 task performance more accurate and comprehensive.

• Referencias bibliográficas
  • Bridgeman, B., et al. 2012. ‘TOEFL iBT speaking test scores as indicators of oral communicative language proficiency,’ Language Testing 29/1:...
  • Byrnes, H. 2014. ‘Linking task and writing for language development: Evidence from a genre-based curricular approach’ in H. Byrnes and R....
  • Daller, H., R. van Hout, and J. Treffers-Daller. 2003. ‘Lexical richness in the spontaneous speech of bilinguals,’ Applied Linguistics 24/2:...
  • De Jong, N., et al. 2007. ‘The effects of task complexity on fluency and functional adequacy of speaking performance’ in S. van Daele, A....
  • Deng, Y., L. Lei, and D. Liu. 2021. ‘Calling for more consistency, refinement, and critical consideration in the use of syntactic complexity...
  • Dreyfus, S. J., et al. 2016. Genre Pedagogy in Higher Education: The SLATE Project. Palgrave Macmillan UK. Google ScholarGoogle PreviewWorldCatCOPAC...
  • Ellis, R. 2009. ‘The differential effects of three types of task planning on the fluency, complexity, and accuracy in L2 oral production,’...
  • Ellis, R., et al. 2020. Task-Based Language Teaching: Theory and Practice. Cambridge University Press. Google ScholarGoogle PreviewWorldCatCOPAC...
  • Figueras, N. 2012. ‘The impact of the CEFR,’ ELT Journal 66/4: 477–85. Google ScholarCrossrefWorldCat
  • Foster, P. and P. Skehan. 1999. ‘The influence of source of planning and focus of planning on task-based performance,’ Language Teaching Research...
  • Foster, P., A. Tonkyn, and G. Wigglesworth. 2000. ‘Measuring spoken language: A unit for all reasons,’ Applied Linguistics 21/3: 354–75. Google...
  • George, D. and P. Mallery. 2010. SPSS for Windows Step by Step: A Simple Study Guide and Reference. Pearson Education. Google ScholarGoogle...
  • Halliday, M. A. K. 1985. An Introduction to Functional Grammar. Edward Arnold. Google ScholarGoogle PreviewWorldCatCOPAC
  • Halliday, M. A. K. and C. Matthiessen. 2014. Halliday’s Introduction to Functional Grammar. Routledge. Google ScholarCrossrefGoogle PreviewWorldCatCOPAC...
  • Heilmann, J. J., et al. 2016. ‘Clinical impact of wordless picture storybooks on bilingual narrative language production: A comparison of...
  • Housen, A. and F. Kuiken. 2009. ‘Complexity, accuracy, and fluency in second language acquisition,’ Applied Linguistics 30/4: 461–73. Google...
  • Housen, A., F. Kuiken, and I. Vedder (eds.). 2012. Dimensions of L2 Performance and Proficiency: Complexity, Accuracy and Fluency in SLA....
  • Hsu, H. 2017. ‘The effect of task planning on L2 performance and L2 development in text-based synchronous computer-mediated communication,’...
  • Hymes, D. 1972. ‘On communicative competence’ in J. B. Pride and J. Holmes (eds.), Sociolinguistics: Selected Readings. Penguin, pp. 269–93. Google...
  • Isbell, D. R. and Y.-A. Son. 2022. ‘Measurement properties of a standardized Elicited Imitation Test: An integrative data analysis,’ Studies...
  • Kuiken, F. and I. Vedder. 2018. ‘Assessing functional adequacy of L2 performance in a task-based approach’ in N. Taguchi and Y. Kim (eds.),...
  • Kuiken, F. and I. Vedder. 2017. ‘Functional adequacy in L2 writing: Towards a new rating scale,’ Language Testing 34/3: 321–36. Google ScholarCrossrefWorldCat...
  • Kuiken, F. and I. Vedder. 2022. ‘Measurement of functional adequacy in different learning contexts: Rationale, key issues, and future perspectives,’...
  • Kuiken, F. and I. Vedder. 2014. ‘Rating written performance: What do raters do and why?,’ Language Testing 31/3: 329–48. Google ScholarCrossrefWorldCat...
  • Kyle, K., S. A. Crossley, and S. Jarvis. 2021. ‘Assessing the validity of lexical diversity indices using direct judgements,’ Language Assessment...
  • Lambert, C. and J. Kormos. 2014. ‘Complexity, accuracy, and fluency in task-based L2 research: Toward more developmentally based measures...
  • Li, S. and H. Zhao. 2021. ‘The methodology of the research on language aptitude: A systematic review,’ Annual Review of Applied Linguistics...
  • Little, D. 2006. ‘The Common European Framework of Reference for Languages: Content, purpose, origin, reception and impact,’ Language Teaching...
  • Martin, J. R., C. Matthiessen, and C. Painter. 2010. Deploying Functional Grammar. Commercial Press. Google ScholarGoogle PreviewWorldCatCOPAC...
  • Maxim, H. 2021. ‘A longitudinal case study of curriculum-based L2 writing development,’ System 96: 102397. Google ScholarCrossrefWorldCat
  • Mayer, M. 1967. A Boy, A Dog and A Frog. Dial Press. Google ScholarGoogle PreviewWorldCatCOPAC
  • Mayer, M. 1969. Frog, Where Are You? Dial Press. Google ScholarGoogle PreviewWorldCatCOPAC
  • McCarthy, P. M. and S. Jarvis. 2010. ‘MTLD, vocd-D, and HD-D: A validation study of sophisticated approaches to lexical diversity assessment,’...
  • Montanari, S. 2004. ‘The development of narrative competence in the L1 and L2 of Spanish-English bilingual children,’ International Journal...
  • Norris, J. and L. Ortega. 2009. ‘Towards an organic approach to investigating CAF in instructed SLA: The case of complexity,’ Applied Linguistics...
  • O’Sullivan, B. 2002. ‘Learner acquaintanceship and oral proficiency test pair-task performance,’ Language Testing 19/3: 277–95. Google ScholarCrossrefWorldCat...
  • Ortega, L. 2015. ‘Syntactic complexity in L2 writing: Progress and expansion,’ Journal of Second Language Writing 29: 82–94. Google ScholarCrossrefWorldCat...
  • Ortega, L., et al. 1999. A Multilanguage Comparison of Measures of Syntactic Complexity. University of Hawai’i: National Foreign Language...
  • Pallotti, G. 2009. ‘CAF: Defining, refining and differentiating constructs,’ Applied Linguistics 30/4: 590–601. Google ScholarCrossrefWorldCat...
  • Pearson, W. S. 2019. ‘Critical perspectives on the IELTS test,’ ELT Journal 73/2: 197–206. Google ScholarCrossrefWorldCat
  • Plonsky, L. and F. L. Oswald. 2014. ‘How big is “big”? Interpreting effect sizes in L2 research,’ Language Learning 64: 878–912. Google ScholarCrossrefWorldCat...
  • Qin, J. 2022. ‘Potential contribution of SFL to task-based research: An examination of planning effects using genre-based theme analysis,’...
  • Révész, A., M. Ekiert, and E. N. Torgersen. 2016. ‘The effects of complexity, accuracy, and fluency on communicative adequacy in oral task...
  • Ryshina-Pankova, M. 2015. ‘A meaning-based approach to the study of complexity in L2 writing: The case of grammatical metaphor,’ Journal of...
  • Ryshina-Pankova, M., W. Barthold, and E. Barthold. 2021. ‘Enhancing the content- and language-integrated multiple literacies framework: Systemic...
  • Sahib, F. H. and M. Stapa. 2022. ‘Global trends of the Common European Framework of Reference: A bibliometric analysis,’ Review of Education...
  • Sato, T. and T. McNamara. 2019. ‘What counts in second language oral communication ability? The perspective of linguistic laypersons,’ Applied...
  • Schmidgall, J. and D. E. Powers. 2021. ‘Predicting communicative effectiveness in the international workplace: Support for TOEIC® Speaking...
  • Skehan, P. 1998. A Cognitive Approach to Language Learning. Oxford University Press. Google ScholarGoogle PreviewWorldCatCOPAC
  • Skehan, P. 1996. ‘A framework for the implementation of task-based instruction,’ Applied Linguistics 17/1: 38–62. Google ScholarCrossrefWorldCat...
  • Skehan, P. 2009. ‘Modelling second language performance: Integrating complexity, accuracy, fluency, and lexis,’ Applied Linguistics 30/4:...
  • Tavakoli, P. and P. Skehan. 2005. ‘Strategic planning, task structure, and performance testing’ in R. Ellis (ed.): Planning and Task Performance...
  • Yasuda, S. 2017. ‘Toward a framework for linking linguistic knowledge and writing expertise: Interplay between SFL-Based genre pedagogy and...