The effect of two feedback strategies on EFL writing quality from the perspective of syntactic complexity
Roč.11,č.1(2021)
This paper aims to present the results of the study investigating the efficacy of computer-mediated feedback on EFL learners' performance in writing with regard to syntactic complexity as an aspect of writing quality. The research design of the study took the form of a pre-test/post-test quasi-experiment with two comparison groups which received different treatments. The participants of the study were 65 advanced EFL learners of English for Specific Purposes who were divided into two groups. The first group (33 students) was provided with the treatment in the form of teacher-only multiple-draft feedback while the other group (32 students) was given the treatment in the form of combined peer-teacher multiple-draft feedback.
The study investigated if there were any differences in syntactic complexity at a global, a clausal and a phrasal level between pre-test and post-test and what the implications of these differences for writing quality were in individual groups together with comparing the differences between the groups. Syntactic complexity was automatically measured by selected indices of L2 Syntactic Complexity Analyzer (Lu, 2010), a freely available natural language processing tool. The study yielded four major findings. First, the results indicate some statistically significant improvements in writing quality with regard to syntactic complexity and with respect to the proficiency level of the participants in both groups. Second, syntactic complexity developed in both groups between the pre-test and post-test, but with no significant difference in post-test performance between the comparison groups. Third, teacher-only feedback seems to be more effective at the global and phrasal level of syntactic complexity while combined peer-teacher feedback is more effective at the clausal level. Finally, teacher-only feedback contributed to more homogenous post-test writing production.
Computer-mediated feedback; Writing quality; Syntactic complexity; Peer feedback; Foreign language writing
Blanka Pojslova
Masarykova univerzita
Centrum jazykového vzdělávání MU
Oddělení na ESF
Vedoucí pracoviště
Ai, H., & Lu, X. (2013). A corpus-based comparison of syntactic complexity in nns and ns university students writing. In A. Díaz-Negrillo, N. Ballier, & P. Thompson (Eds.), Automatic treatment and analysis of learner corpus data (pp. 249–264). Amsterdam: John Benjamins.
AbuSeileek, A., & Abualsha'r, A. (2014). Using peer computer-mediated corrective feedback to support EFL learners' writing. Language Learning & Technology, 18(1), 76–95. http://dx.doi.org/10125/44355.
Allison, D., & Ng, P. (1992). Developing text revision abilities. In M. Lau, & M.J. Murphy (Eds.), Developing writing: Purposes and practice (pp.106-130). Hong Kong: Institute of Language Education.
Al-Olimat, S. I., & AbuSeileek, A. F. (2015). Using computer-mediated corrective feedback modes in developing students' writing performance. Teaching English with Technology, 15(3), 3–30. https://files.eric.ed.gov/fulltext/EJ1138425.pdf.
Bardovi-Harlig, K. (1992). A second look at T-unit analysis: Reconsidering the sentence. TESOL Quarterly, 26, 390–395.
Berg, E.C. (1999). The effects of trained peer response on ESL students' revision types and writing quality. Journal of Second Language Writing, 8(3), 215-241. doi:10.1016/S1060-3743(99)80115-5
Biber, D., Gray, B., & Poonpon, K. (2011). Should we use characteristics of conversation to measure grammatical complexity in L2 writing development? TESOL Quarterly, 45, 5–35.
Bulté, B., & Housen, A. (2012). Defining and operationalising L2 complexity. In A. Housen, F. Kuiken, & I. Vedder (Eds.), Dimensions of L2 performance and proficiency – Investigating complexity, accuracy and fluency in SLA (pp. 21–46). Amsterdam: John Benjamins.
Bulté, B., & Housen, A. (2014). Conceptualising and measuring short-term changes in L2 writing complexity. Journal of Second Language Writing, 26, 42-65. doi.org/10.1016/j.jslw.2014.09.005
Byrnes, H., Maxim, H. H., & Norris, J. M. (2010). Realising advanced foreign language writing development in collegiate education: Curricular design, pedagogy, assessment [Monograph]. Modern Language Journal, 94(s1).
Casal, J.E., Lee, J.J. (2019). Syntactic complexity and writing quality in assessed first-year L2 writing. Journal of Second Language Writing, 44, 51-62. https://doi.org/10.1016/j.jslw.2019.03.005.
Chaudron, C. (1984). The effects of feedback on students' composition revisions. RELC Journal 15(2), 1-14. doi.org/10.1177/00336882840150020
Cohen, J.W. (1988). Statistical power analysis for the behavioral sciences (2nd edn). Hillsdale, New York: Lawrence Erlbaum Associates.
Crossley, S.A. (2020). Linguistic features in writing quality and development: An overview. Journal of Writing Research, 11(3), 415-443. https://doi.org/10.17239/jowr-2020.11.03.01.
Ferris, D. (2014). Responding to student writing: Teachers' philosophies and practices. Assessing Writing, 19, 6–23.
Cumming, A., Kantor, R., & Powers, D. E. (2002). Decision making while rating ESL/EFL writing
tasks: A descriptive framework. The Modern Language Journal, 86(1), 67–96.
Ellis, R. (2003). Task-based language learning and teaching. Oxford: Oxford University Press.
Ellis. R. (2009). A typology of written corrective feedback types. ELT Journal, 63, 97-107. https://doi.org/10.1093/elt/ccn023
Ferris, R.D., (2003). Response to student writing: implications for second language students. Routledge: Taylor & Francis Group.
Gass, S. (1997). Input, interaction, and the second language learner. Mahwah, NJ: Erlbaum.
Hyland, K., & Hyland, F. (2006). Feedback on second language students' writing. Language Teaching, 39(2), 83-101. doi:10.1017/S0261444806003399
Hyland, K. (2007). Second language writing. Cambridge: Cambridge University Press.
Housen, A., Kuiken, F., & Vedder, I. (2012). Complexity, accuracy and fluency: Definitions, measurement and research. In A. Housen, F. Kuiken, & I. Vedder (Eds.), Dimensions of L2 performance and proficiency: complexity, accuracy, and fluency (pp.1-20). Philadelphia: John Benjamins Pub. Co.
Kyle, K., & Crossley, S. A. (2018). Measuring Syntactic Complexity in L2 Writing Using Fine-
Grained Clausal and Phrasal Indices. Modern Language Journal, 102 (2), 333-349.
https://doi.org/10.1111/modl.12468
Laufer, B., & Nation, P. (1995). Vocabulary size and use: Lexical richness in l2 written production. Applied Linguistics, 16 (3), 307–322. doi:10. 1093/applin/16.3.307
Li, Y. (2006). Negotiating knowledge contribution to multiple discourse communities: A
doctoral student of computer science writing for publication. Journal of Second Language
Writing 15, 159–178.
Li, H. (2015). Relationship between measures of syntactic complexity and judgments of EFL
writing quality. In Proceedings of 2015 Youth Academic Forum on Linguistics, Literature,
Translation and Culture (pp. 216–222). Marietta, GA: American Scholars Press.
Lu, X. (2010). Automatic analysis of syntactic complexity in second language writing. International Journal of Corpus Linguistics, 15, 474–496.
Lu, X. (2011). A corpus-based evaluation of syntactic complexity measures as indices of college level ESL writers' language development. TESOL Quarterly, 45(1), 36–62.
Lu, X., & Ai, H. (2015). Syntactic complexity in college-level English writing: Differences among
writers with diverse L1 backgrounds. Journal of Second Language Writing, 29, 16–27.
Lu, X. (2017). Automated measurement of syntactic complexity in corpus-based L2 writing research and implications for writing assessment. Language Testing, 34(4), 493–511. https://doi.org/10.1177/0265532217710675
Lundstrom, K., & Baker, W. (2009). To give is better than to receive: The benefits of peer review to the reviewer's own writing. Journal of Second Language Writing, 18(1), 30-43. doi:10.1016/j.jslw.2008.06.002
Miao, Y., Badger, R., & Zhen, Y. (2006). A comparative study of peer and teacher feedback in a Chinese EFL writing class. Journal of Second Language Writing, 15(3), 179-200. doi:10.1016/j.jslw.2006.09.004
Mangelsdorf, K. (1992). Peer reviews in the ESL composition classroom: What do the students think? ELT Journal, 46(3), 274-284. doi: 10.1093/elt/46.3.274
Min, HT (2005). Training students to be successful peer reviewers. System, 33(2), 293-308. doi.org/10.1016/j.system.2004.11.003
Motallebzadeh, K., & Amirabadi, S. (2011). Online Interactional Feedback in Second Language Writing: Through Peer or Tutor?. Theory and Practice in Language Studies, 1(5). 534-540. http://dx.doi:10.4304/tpls.1.5.534-540.
Norris, J.M, & Ortega, L. (2009). Towards an Organic Approach to Investigating CAF in Instructed SLA: The Case of Complexity, Applied Linguistics, 30(4), 555–578. z doi.org/10.1093/applin/amp044
Ortega, L. (2003). Syntactic complexity measures and their relationship to L2 proficiency: A
research synthesis of college-level L2 writing. Applied Linguistics, 24, 492–518.
doi:10.1093/applin/24.4.492.
Pham, T.G., Lin, M., Trinh, V.Q., & Bui, L.T.P. (2020). Electronic Peer Feedback. EFL Academic Writing and Reflective Thinking: Evidence From a Confucian Context. SAGE Open, 10 (1), 1-20. https://doi.org/10.1177/2158244020914554.
Pojslova, B. (2017). Comparison of Students´ Responsiveness to Teacher and Peer Feedback. In Janíková, V., & Hanušová, S. (Eds.), Research in Foreign Language Teaching and Learning =: Fremdsprachenlehr- und Fremdsprachenlernforschung, (pp.99-121). Brno: Masaryk University.
Rollinson, P. (2005). Using peer and teacher feedback on student writing. ELT Journal, 59(1), 23-30. doi: 10.1093/elt/cci003
Shang, H. (2017). An exploration of asynchronous and synchronous feedback modes in EFL writing. J Comput High Educ, 29, 496-513. https://doi.or./10.1007/s12528-017-9154-0.
Schachter, J. (1991). Corrective feedback in historical perspective. Interlanguage Studies Bulletin (Utrecht), 7(2), 89–102. https://doi.org/10.1177/026765839100700202.
Taguchi, N., Crawford, W., & Wetzel, D. Z. (2013). What linguistic features are indicative of
writing quality? A case of argumentative essays in a college composition program. TESOL
Quarterly, 47, 420–430. https://doi.org/10.1002/tesq.91.
Ur P. (1996). A Course in Language Teaching, Practice and Theory. Cambridge: Cambridge University Press.
Wolfe-Quintero, K., Inagaki, S., & Kim, H.Y. (1998). Second language development in writing:
Measures of fluency, accuracy, and complexity. Honolulu, HI: University of Hawai'i, Second
Language Teaching and Curriculum Center. https://doi.org/10.1017/s0272263101263050.
Yang, W., Lu, X., & Weigle, S. A. (2015). Different topics, different discourse: Relationships among writing topic, measures of syntactic complexity, and judgments of writing quality. Journal of Second Language Writing, 28, 53–67.
Copyright © 2021 Blanka Pojslova