Review of the Empirical Research on Digital Multimodal Composing in L2 Learning Contexts
1. School of Foreign Languages and Culture, Geely University of China, Chengdu 641423, China
2. Applied Science and Technology College, Shangqiu University, Kaifeng 476006, China
| Abstract: | Driven by advances in multimedia technologies, digital multimodal composing (DMC) has gained growing scholarly interests. DMC affords language learners a new experience in language learning and use. While completing DMC projects, L2 learners construct meanings by assembling both linguistic and non-linguistic resources (e.g., visuals, audio, videos, etc.). This is largely in line with their out-of-class text composing experiences. To understand the state-of-the-art developments in DMC research, this article reviewed the empirical studies published between January 2011 and October 2022. It provides a general overview of these studies regarding the overall trends, theoretical underpinnings, research contexts, research methods, and major research strands. The research findings indicate: (1) DMC has been increasingly attended to by L2 researchers with the number of research articles showing an ascending trend; (2) These empirical studies were grounded in a variety of theories, including the social semiotic theory of multimodality, multiliteracies, task-based language teaching, social/cultural construction, meta-functions of systemic-functional linguistics, translanguaging, and others; (3) The bulk of research has been investigated in tertiary schools, although the research contexts were diversified; (4) Most studies were conducted qualitatively; (5) Scholarly attention has been paid to four major strands: composing process, teachers’ and learners’ perceptions of DMC, DMC’s impact on L2 development, and assessment of DMC artifacts. The major research strands and sample studies were discussed in detail. This article ends with recommendations for future studies. |
| Keywords: | Digital Multimodal Composing; Process; Perceptions; Assessment; L2 Development |
| DOI: | 10.57237/j.ha.2023.01.005 |
View:
Downloads:
Received: 20 February 2023
Accepted: 15 March 2023
Published Online: 28 March 2023
Funding
| 1. | Sichuan Provincial Association of Non-government Funded Education, project “The Construction of Multidimensional, Multimodal, and Dynamic System for Assessing English Writing” (Grant Number: MBXH22YB121) |
References
| [1] | Rideout, V. J. et al. Generation M2: Media in the Lives of 8-18 Year-olds [M]. Washington, DC: Kaiser Family Foundation Study. 2010. |
| [2] | Kafai, Y. B. & K. A. Peppler. Youth, technology, and DIY: Developing participatory competencies in creative media production [J]. Review of Research in Education. 2011 (1): 89-119. |
| [3] | Smith, B. E. Beyond Words: The Landscape of Research on Adolescents and Multimodal Composition [M]. In Ferdig, R. E. & K. E. Pytash (eds.). Exploring Multimodal Composition and Digital Writing (pp. 1-19). Hershey, PA: IGI Global. 2013. |
| [4] | Kist, W. & K. E. Pytash. “I love to flip the pages”: Preservice teachers and new literacies within a field experience [J]. English Education. 2015 (2): 131-167. |
| [5] | Smith, B. E. Composing across modes: A comparative analysis of adolescents’ multimodal composing processes [J]. Learning, Media and Technology. 2017 (3): 259-278. |
| [6] | Shin, D. S. & T. Cimasko. Multimodal composition in a college ESL class: New tools, traditional norms [J]. Computers and Composition. 2008 (4): 376-395. |
| [7] | Hafner, C. A. & L. Miller. Fostering learner autonomy in English for science: A collaborative digital video project in a technological learning environment [J]. Language Learning & Technology. 2011 (3): 68-86. |
| [8] | Hafner, C. A. Embedding digital literacies in English language teaching: Students’ digital video projects as multimodal ensembles [J]. TESOL Quarterly. 2014 (4): 655-685. |
| [9] | Nelson, M. E. Mode, meaning, and synaesthesia in multimedia L2 writing [J]. Language Learning & Technology. 2006 (2): 56-76. |
| [10] | Harman, R. & D. S. Shin. Multimodal and community-based literacies: Agentive bilingual learners in elementary school [M]. In G. Onchwari & S. Keengwe (eds.), Handbook of Research on Pedagogies and Cultural Considerations for Young English Language Learners (pp. 217-238). Hershey, PA: IGI Global. 2018. |
| [11] | Belcher, D. D. On becoming facilitators of multimodal composing and digital design [J]. Journal of Second Language Writing. 2017: 80-85. |
| [12] | Cummins, J. et al. Identity texts and academic achievement: Connecting the dots in multilingual school contexts [J]. TESOL Quarterly. 2015 (3): 555-581. |
| [13] | Cimasko, T. & D. Shin. Resemiotization and authorial agency in L2 multimodal writing [J]. Written Communication, 2017 (4): 387-413. |
| [14] | Hafner, C. A. Remix culture and English language teaching: The expression of learner voice in digital multimodal compositions [J]. TESOL Quarterly. 2015 (3): 486-509. |
| [15] | Norton, B. Identity and Language Learning: Extending the Conversation [M]. Bristol: Multilingual Matters. 2013. |
| [16] | Hafner, C. A. Digital Multimodal Composing: How to Address Multimodal Communication Forms in ELT [J]. English Teaching. 2020 (3): 133-146. |
| [17] | Jocius, R. Becoming entangled: an analysis of 5th grade students collaborative multimodal composing practices [J]. Computers and Composition. 2018 (47): 14-30. |
| [18] | Lim, F. V., & T. T. H. Nguyen. If you have the freedom, you don’t need to even think hard-considerations in designing for student agency through digital multimodal composing in the language classroom [J]. Language and Education. 2022: 1-19. |
| [19] | Dahlström, H. Students as digital multimodal text designers: A study of resources, affordances, and experiences [J]. British Journal of Educational Technology. 2022 (2): 391-407. |
| [20] | Maghsoudi, N. et al. Integrating digital multimodal composition into EFL writing instruction [J]. Journal of Language and Education. 2022 (1): 86-101. |
| [21] | Mills, K. A. et al. Multimodal language of attitude in digital composition [J]. Written Communication. 2020 (2): 135-166. |
| [22] | Shin, D. S. et al. Development of metalanguage for multimodal composing: A case study of an L2 writer’s design of multimedia texts [J]. Journal of Second Language Writing. 2020: Article 100714. |
| [23] | Unsworth, L. & K. A. Mills. English language teaching of attitude and emotion in digital multimodal composition [J]. Journal of Second Language Writing. 2020: Article 100712. |
| [24] | Kim, Y. & S. Kang. Writing to make meaning through collaborative multimodal composing among Korean EFL learners: Writing processes, writing quality and student perception [J]. Computers and Composition. 2020: 1-19. |
| [25] | Silseth, K. & Ø. Gilje. Multimodal composition and assessment: A sociocultural perspective [J]. Assessment in Education: Principles, Policy & Practice. 2019 (1): 26-42. |
| [26] | Yang, Y. F. D. Multimodal composing in digital storytelling [J]. Computers and Composition. 2012 (3): 221-238. |
| [27] | Jiang, L. & J. Luk. Multimodal composing as a learning activity in English classrooms: Inquiring into the sources of its motivational capacity [J]. System. 2016: 1-11. |
| [28] | Jiang, L. et al. Chinese ethnic minority students’ investment in English learning empowered by digital multimodal composing [J]. TESOL Quarterly. 2020a (4): 954-979. |
| [29] | Jiang, L. et al. An EFL teacher’s investment in digital multimodal composing [J]. ELT Journal. 2020b (3): 297-306. |
| [30] | Kim, Y. et al. Peer interaction, writing proficiency, and the quality of collaborative digital multimodal composing task: Comparing guided and unguided planning [J]. System. 2022: Article 102722. |
| [31] | Conteh, J. Translanguaging [J]. ELT journal. 2018 (4): 445-447. |
| [32] | Ho, W. Y. J. The construction of translanguaging space through digital multimodal composing: A case study of students’ creation of instructional videos [J]. Journal of English for Academic Purposes. 2022: Article 101134. |
| [33] | Kim, Y. & D. Belcher. Multimodal composing and traditional essays: Linguistic performance and learner perceptions [J]. RELC Journal. 2020 (1): 86-100. |
| [34] | Lee, H. C. Using an arts-integrated multimodal approach to promote English learning: A case study of two Taiwanese junior college students [J]. English Teaching: Practice and Critique. 2014 (2): 55-75. |
| [35] | Jiang, L. The affordances of digital multimodal composing for EFL learning [J]. ELT Journal. 2017 (4): 413-422. |
| [36] | Lei, Q. & D. L. Zhang. A study on English learner identities in multimodal composing [J]. Technology Enhanced Foreign Language Education. 2018 (6): 52-57, 64. |
| [37] | Liu, L. & C. J. Dai. An empirical study on application of computer screen video expert software to multimodal English composition [J]. Journal of Xi’an International Studies University. 2012 (1): 86-90. |
| [38] | Vandommele, G. et al. In-school and out-of-school multimodal writing as an L2 writing resource for beginner learners of Dutch [J]. Journal of Second Language Writing. 2017: 23-36. |
| [39] | Wang, H. International English learners’ perspectives on multimodal composing and identity representation via multimodal texts [J]. SAGE Open. 2022 (2): 1-15. |
| [40] | Jiang, L. Digital multimodal composing and investment change in learners’ writing in English as a foreign language [J]. Journal of Second Language Writing. 2018: 60-72. |
| [41] | Jiang, L. et al. Teacher engagement with digital multimodal composing in a Chinese tertiary EFL curriculum [J]. Language Teaching Research. 2021 (4): 613-632. |
| [42] | Darvin, R. & B. Norton. Identity and a model of investment in applied linguistics [J]. Annual Review of Applied Linguistics. 2015: 36-56. |
| [43] | DePalma, M. J. & K. P. Alexander. A bag full of snakes: Negotiating the challenges of multimodal composition [J]. Computers and Composition. 2015: 182-200. |
| [44] | Tan, X. & P. K. Matsuda. Teacher beliefs and pedagogical practices of integrating multimodality into first-year composition [J]. Computers and Composition. 2020: Article 102614. |
| [45] | New London Group. A pedagogy of multiliteracies: Designing social futures [J]. Harvard Educational Review. 1996 (1): 60-92. |
| [46] | Hung, H. T. et al. Multimodal assessment of and for learning: A theory-driven design rubric [J]. British Journal of Educational Technology. 2013 (3): 400-409. |
| [47] | Kyriakides, L. et al. What matters for student learning outcomes: A meta-analysis of studies exploring factors of effective teaching [J]. Teaching and Teacher Education. 2013: 143-152. |
| [48] | Shepherd, R. P. Digital writing, multimodality, and learning transfer: Crafting connections between composition and online composing [J]. Computers and Composition, 2018: 103-114. |
| [49] | Chen, C. W. Y. Developing EFL students’ digital empathy through video production [J]. System. 2018: 50-57. |
| [50] | Friesem, Y. Empathy for the digital age: Using video production to enhance social, emotional, and cognitive skills [M]. In S. Y. Tettegah & D. L. Espelage (eds.), Emotions, technology, and behaviors (pp. 21-45). London: Academic Press. 2016. |
| [51] | Jiang, L. & J. Gao. Fostering EFL learners’ digital empathy through multimodal composing [J]. RELC Journal. 2020 (1): 70-85. |
| [52] | Martin, J. R & P. R. R. White. The Language of Evaluation: Appraisal in English [M]. New York: Palgrave Macmillan. 2005. |
| [53] | Li, C. A control-value theory approach to boredom in English classes among university students in China [J]. The Modern Language Journal. 2021 (1): 317-33. |
Join the Editorial Board
We invite active, qualified and high profile scientists and researchers to join as Editorial Board Members.
Join UsBecome a Reviewer
Scholars with a strong interest in reviewing are invited to join the reviewer panel to ensure the quality of the research to be published.
Join Us