Using and Improving Automated Evaluation of Writing from Students’ Perspective
1. School of Foreign Studies, China University of Mining and Technology, Xuzhou 221116, China
2. College of International Studies , Southwest University, Chongqing 400715, China
| Abstract: | As a newly-rising online tool, Automated Evaluation of Writing (AWE) combines multiple functions of improving the writing, playing an increasingly important role in the teaching of English writing in China. It has attracted more and more scholars to conduct the relevant research. However, rare studies noticed the students’ perspective. In view of this, this study follows the guidance of metacognition, constructivism, activity theory, dynamic assessment theory and output hypothesis in order to figure out what students can utilize with AWE, which gives a boost to the actualization of the practical value of AWE and most importantly, the development of students’ English writing. To obtain real feedback from students on AWE (take Correcting Network for example), this study applied the method of questionnaire and interview to collect data. In this way, we concluded the comments on AWE from the perspective of students, and found out the ideal practice to benefit students in their English writing. According to the analytical results, this study developed a student-centered model that mobilized the resources available to students in their learning. Because of the limitations of AWE for improving students’ writing, help from teachers, other students or peers, and even students themselves should play an active role in the use and improvement of AWE. |
| Keywords: | AWE; Feedback; Development of Students’ Writing; Evaluation of Writing; Students’ Perspective |
| DOI: | 10.57237/j.ssrf.2023.03.004 |
View:
Downloads:
Received: 1 April 2023
Accepted: 6 July 2023
Published Online: 24 July 2023
Funding
| 1. | Basic Scientific Research Project - China University of Mining and Technology-Social Science Fund (2022SK22) |
| 2. | Jiangsu Higher Education Association-Foreign Language Project (2022WYYB058) |
| 3. | Teaching Project-China University of Mining and Technology (2021YB53) |
References
| [1] | Attali, Y & J. Burstein. Automated essay scoring with e-rater V.2.0. Journal of Technology, Learning, and Assessment 4 (3): 1-21. 2006. |
| [2] | Burstein J. Automated Essay Scoring: A Cross-disciplinary Perspective. Mahwah: Lawrence Erlbaum Associates Inc, 2003. |
| [3] | Burstein J C. The E-rater scoring engine: Automated essay scoring with natural language processing. Shermis M D. |
| [4] | Wang, B., & Jin, C., & Zhao, W. Fifty Years of Research and Practice on Automatic Writing Evaluation-From Single, Collaborative to Interactive. Foreign Languages Research, 2015, 32 (05): 50-56. [in Chinese] |
| [5] | Huang, A. Promoting learning with feedback: Constructing a multi-feedback model based on writing task. Foreign Language Education, 2020, 41 (06): 67-71. [in Chinese] |
| [6] | Huang, X., & Li, Z. A strategy for Effective Instruction: Feedback Theory. Research in Education Development, 2011 (04): 43-47. [in Chinese] |
| [7] | Zhou, Y. A Comparative Study of Feedback Methods in College English Writing. Foreign Language World, (2013) 03: 87-96. [in Chinese] |
| [8] | Luderstrom, K. & W. Baker. To give is better than to receive: The benefits of peer revoew to the reviewer’s own writing. Joural of Sencond Language Writing, 2009 (1). |
| [9] | Cho, Y. H. & K. Cho. Peer reviewers learn from giving comments. Instructional Science, 2011 (5). |
| [10] | Wu, Y. & C. D. Schunn. The effects of providing and receiving peer feedback on writing performance and learning of secondary school students. American Educational Research Journal, 2020 (3). |
| [11] | Ranalli, J. Automated written corrective feedback: How well can students make use of it? Computer Assisted Language Learning, 31 (7), 653-674. 2018. |
| [12] | Koltovskaia, S. Studeng engagement with automated written corrective feedback (AWCF) provided by Grammarly: A multiple case study. Assessing Writing, 44, 100450. 2020. |
| [13] | Chen, C. E. & W. Cheng. Beyond the design of automated writing evaluation: Pedagogical practices and perceived learning effectiveness in EFL writing classes. Language Learning and Technology 12 (2): 94-112. 2008. |
| [14] | Bai, L., & Hu, G. In the face of fallible AWE feedback: How do students respond? Educational Psychology, 2017. |
| [15] | Zhang, Z., & Hyland, K. Student engagement with teacher and automated feedback on L2 writing. Assessing Writing, 36, 90-102. 2018. |
| [16] | Tang, Y. On the Role of the Metacognitive Experience in Reading Activity. [J]. Journal of Changsha University, 2006, 20 (1): 156-158. |
| [17] | Wang, Y. The Application of Constructivism Learning Theory in College English Teaching And Writing. Labor Security World, 2016 (21): 78+81. [in Chinese] |
| [18] | Yang, L., & Fu, X. 2014. Changing Beliefs and Practices in Grammar Teaching: An Activity Theory Perspective. Foreign Languages and Their Teaching, (1): 60-66. [in Chinese] |
| [19] | Flavell, J. H. Metacognition and cognitive monitoring. American Psychcologist, 1979 (34). |
| [20] | Xiao, W. Metacognition and Foreign Language Teaching Research. Shanghai: Shanghai Jiao Tong University Press, 2011. [in Chinese] |
| [21] | Zhou, H., & Liu, S. Metacognition and Second Language Acquisition. Chinese Journal of Applied Linguistics, Shanghai: Shanghai Foreign Language Education Press, 2001: 116-130. [in Chinese] |
| [22] | Grossman, P. L., Smagorinsky, P., & Valencia, S. Appropriating tools for teaching English: A theoretical framework for research on learning to teach. American, 1999. |
| [23] | VYGOTSKY L S. Mind in society: the development of higher psychological processes. L. S. Vygotsky. Psychological Processes, 1978, 7 740 (1): 27. |
| [24] | Lei, X. Exploring a sociocultural approach to writing strategy research: Mediated actions in writing activities. Journal of Second Language Writing, 17 (4), 2008. |
| [25] | LANTOLF J P, THORNE S L. Sociocultural theory and the genesis of second language development. New York: Oxford University Press, 2006. |
| [26] | MATOS, DE F G. Psychology and the language learning process. Sys-tem, 1983, 11 (2): 194-196. |
| [27] | ENGESTROM Y. Learning by expanding: an activity theoretical approach to developmental research. Helsinki: Orienta-Konsultit, 1987. |
| [28] | Han, B. The theory and model of dynamic assessment and its application in foreign language education. Foreign Language Teaching and Research (bimonthly), 2009 (6): 452-458. [in Chinese] |
| [29] | Poehner, M. E., J. Zhang & X. Lu. Computerized dynamic assessment (C-DA): Diagnosing L2 development according to learner responsiveness to mediation. Language Testing, 2015 (3): 337-357. |
| [30] | Lidz, C. S. & B. Gindis. Dynamic assessment of the evolving cognitive functions in children. In A. Kozulin, B. Gindis, V. S. Ageyev & S. M. Miller (eds). Vygotsky’s Educational Theory in Cultural Context. Cambridge: Cambridge University Press, 2003: 99-116. |
| [31] | Huang, A., & Zhang, W. The Effect of Automated Writing Evaluation Feedback on Students’ Vocabulary Revision—Taking Pigai. org for Example. Modern Education Press, 2018, 28 (07): 71-78. [in Chinese] |
| [32] | Xu, Q. On Teaching of Business English Writing Based on Metacognition Theory. Journal of Xi’an International Studies University, 2012, 20 (04): 93-98. [in Chinese] |
| [33] | Ni, H. Language Output Theory and English Writing Teaching. Journal of Zhejiang Gongshang University, 2008 (04): 93-96. [in Chinese] |
| [34] | Zhao, X. A Study on the Teaching Model of English Academic Paper Writing for English Majors from the Perspective of Activity theory. Western China Quality Education, 2019, 5 (15): 3-5. [in Chinese] |
Join the Editorial Board
We invite active, qualified and high profile scientists and researchers to join as Editorial Board Members.
Join UsBecome a Reviewer
Scholars with a strong interest in reviewing are invited to join the reviewer panel to ensure the quality of the research to be published.
Join Us