Error Analysis and Frequency in the Writing Section of the STANAG 6001 English Examination Among Military Students: A Corpus-Based Study of Proficiency Level Variations
Roč.14,č.2(2024)
CASALC Review
This study examines error types and their frequencies in the writing section of the STANAG 6001 English examination among military students, with a focus on variations across proficiency levels. The STANAG 6001 is a high-stakes examination used to assess the language proficiency of military personnel, playing a crucial role in their career advancement and operational effectiveness. The analysis employs a corpus-based methodology to identify prevalent error types, examine their distribution, and quantify their frequencies. A total of 240 written responses from military students at proficiency levels 1, 1+, and 2 were analyzed, with errors classified into orthographical, grammatical, and lexical categories. The results indicate notable differences in the frequency and categories of errors across proficiency levels. These variations highlight the specific linguistic challenges encountered by students at various developmental stages. The results correspond with the proficiency descriptors for each level, particularly the necessity for accurate verb usage in narration and description at level 2, while also indicating that certain recurring errors are tolerated within the range of acceptable performance at this level. This research has significant implications for classroom instruction and curriculum design, suggesting the need for targeted teaching strategies to address the specific error patterns that hinder progression between levels.
error analysis and frequency; learner corpus; military higher education; proficiency level variations; STANAG 6001 Writing; TeiTok
Robert Helán
University of Defence
Robert Helán holds a doctoral degree in English Linguistics from the Faculty of Arts at Masaryk University in the Czech Republic. He currently works in the Testing Department at the University of Defense Language Center, where he specializes in English language assessment based on STANAG 6001 levels 1-3. His responsibilities include developing tests for these proficiency levels. His research interests center on learner corpora, corpus tools, and data-driven learning. Additionally, he serves as the principal investigator for the Language Center’s project, "Long-Term Development Plan of the Organization" (DZRO in Czech).
Radomíra Bednářová
University of Defense
Radomíra Bednářová is a faculty member of the Testing Department at the University of Defense Language Centre, where she specializes in English language assessment based on STANAG 6001 levels 1-3. Her responsibilities include developing tests for these proficiency levels. Previously, she taught medical English to various levels of pre- and post-graduate students as well as medical and paramedical professionals. Throughout her professional life, she participated in multiple study and work engagements in the United Kingdom, Germany, and Austria.
Aqil, M., Rubbani, A., & Hamid, A. (2022). Error analysis in learners' essay writing: A corpus-based study. International Journal of Special Education, 37(3), 18331-18341. BILC. (n.d.) STANAG 6001. Retrieved on July 29, 2024 from https://www.natobilc.org/en/products/stanag-60011142_stanag-6001/.
Boroomand, F., & Abusaeedi, R. (2013). A Corpus-Based Error Analysis of EFL Learners' Writing. Journal of Education and Practice, 4(1), 87-94.
Callies, M., & Götz, S. (2015). Learner Corpora in Language Testing and Assessment. John Benjamins Publishing Company.
Corder, S. P. (1967). The significance of learner's errors. International Review of Applied Linguistics in Language Teaching, 5(4), 161–170.
Creswell, J. W., & Creswell, J. D. (2017). Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. SAGE Publications. Diaz-Negrillo, A. (2006). Error Analysis in Learner Corpora: The Case of Error Tagging Systems. Language Teaching Research, 10(1), 55-72.
Divsar, H., & Heydari, R. (2017). A Corpus-based Study of EFL Learners’ Errors in IELTS Essay Writing. International Journal of Applied Linguistics & English Literature, 6(3), 143.
Dobrić, N. (2023). Identifying errors in a learner corpus – the two stages of error location vs. error description and consequences for measuring and reporting inter-annotator agreement. Applied Corpus Linguistics, 3(1), 100039.
Doolan, S. M. (2013). Error Patterns in the Writing of Generation 1.5, L1, and L2 Students. Journal of Second Language Writing, 22(2), 100-117.
Egbert, J., Biber, D., & Gray, B. (2022). Designing and Evaluating Language Corpora: A Practical Framework for Corpus Representativeness. Cambridge University Press. Ellis, R. (1997). Second Language Acquisition. Oxford University Press.
Ferris, D. R. (2011). Treatment of Error in Second Language Student Writing. Ann Arbor: The University of Michigan Press.
Freiermuth, M. (1997). L2 Error Correction: Criteria and Techniques. Second Language Acquisition Journal, 12, 33–45.
Götz, S. (2022). Learner corpora to inform testing and assessment. In The Routledge handbook of corpora and English language teaching and learning (pp. 311-326). Routledge.
Green, R., & Wall, D. (2005). Language testing in the military: Problems, politics and progress. Language Testing, 22(3), 379–398.
Hayati, W. (2019b). An Analysis of Written Errors; A Case of Second Semester Students of English. LET Linguistics Literature and English Teaching Journal, 9(1), 77.
James, C. (2013). Errors in Language Learning and Use: Exploring Error Analysis. Routledge.
Jichun, P. (2015). A Corpus-Based Analysis of Errors in Spanish EFL Writings. International Journal of English Linguistics, 5(3), 122-134.
Johnson, B., & Christensen, L. (2019). Educational Research: Quantitative, Qualitative, and Mixed Approaches. SAGE Publications.
Lee, J. (2011). An Automated Method for Generating Realistic Grammatical Errors. Journal of Computer-Assisted Language Learning, 24(2), 161-175.
Lenko-Szymanska, A., & Boulton, A. (2015). Multiple Affordances of Language Corpora for Data-driven Learning. John Benjamins Publishing Company.
Monaghan, R. (2012). Language and interoperability in NATO: The Bureau for International Language Co-ordination (BILC). Canadian Military Journal, 13(1), 23–32.
Paquot, M., & Gries, S. T. (2020). A Practical Handbook of Corpus Linguistics. Springer.
Poole, R. (2018). A Guide to Using Corpora for English Language Learners. Edinburgh University Press.
Richards, J. C. (2014). Error Analysis: Perspectives on Second Language Acquisition. Routledge.
Richards, J. C., & Schmidt, R. W. (2013). Longman dictionary of language teaching and applied linguistics. Routledge.
Shirban, A., & Lai, M. C. M. (2021). Error analysis in learners' essay writing: A corpus-based study. International Journal of Research in English Education, 6(4), 57-74.
Sugiharto, S. (2013). Errors in EFL Writing by Junior High Students in Indonesia. Asian EFL Journal, 15(1), 92-112.
Zhang, R. (2013). A Corpus-Based Error Analysis of Students' Writing in Graded Teaching Classes. Journal of Convergence Information Technology, 8(10), 549-557.
Copyright © 2025 Robert Helán, Radomíra Bednářová