The Effect of Artificial Intelligence Generated Translation versus Human Translation on Reading Comprehension of the Speakers of Less Commonly Taught Languages

Document Type : Research Paper

Author

Department of English, Faculty of Literature, Alzahra University, Tehran, Iran

Abstract

English as a Foreign Language (EFL) University students usually write in their native tongue and translate it into English using Artificial Intelligence programs. The study evaluated the quality of translations generated by AI in one hand and investigated the impact of Artificial Intelligence Generated Translation (AIGT) on EFL students in another. A human translator and an AI tool were used to translate two sample texts from English into Persian. The texts were given to 30 EFL teachers to examine the quality of AI translations. In addition, 152 students randomly divided into control or experimental groups were exposed to translated texts. Results from an independent t-test showed that there was a negligible difference between the two groups. The qualitative analysis of the interview data that involved 30 participants revealed that language teachers perceived omission, addition, syntax and punctuation errors in AIGT as adequately acceptable, despite their prevalence. However, a majority of the teachers were dissatisfied with AIGT’s accuracy in rendering idiomatic expressions. Based on the results, EFL educators should acknowledge the prevalence and usefulness of AI among students, and aim to incorporate it effectively in their teaching instead of prohibiting its use.

Keywords

References

Aiken, M., Balan, S. (2011). An analysis of Google Translate accuracy. Translation Journal. 16(2), 25-35.
Ali, K., & Alireza, F. (2014). The effect of computer-assisted translation on l2 learners’ mastery of writing. International Journal of Research Studies in Language Learning, 3(5), 29-44.
             http://doi.org/10.5861/ijrsll.2013.396 
Amaral, L., & Meurers, D. (2011). On using intelligent computer-assisted language learning in real-life foreign language teaching and learning. RECALL, 23(6), 4-24.
             http://doi.org/10.1017/S0958344010000261
Amores, M. (1997). A new perspective on peer-editing. Foreign Language Annals, 30(4), 513-522. http://doi.org/10.1111/j.1944-9720.1997.tb00858.x
Bahri, H., & Mahadi, T. (2016). Google Translate as a supplementary tool for learning Malay: A case study at Universiti Sains Malaysia. Advances in Language and Literary Studies, 7(3), 161–167. http://doi.org/10.5755/j01.sal.0.21.1469
Barr, D. (2013). Embedding technology in translation teaching: Evaluative considerations for courseware integration. Computer Assisted Language Learning, 26(4), 295–310.
              http://doi.org/10.1080/09588221.2012.658406
Bernardini, S. (2016). Discovery learning in the language for translation classroom. Cadernos de Traducao, 36(3), 14–35. http://doi.org/10.5007/21757968.2016v36nesp1p14
Boshrabadi, A. M. (2014). Pedagogical utility of translation in teaching reading comprehension to Iranian EFL learners. International Journal of Language Learning and Applied Linguistics World, 5(2), 381–395.
Case, M. (2015). Machine translation and the disruption of foreign language learning activities. E-Learning Papers, 45(8), 4–16. http://doi.org/10.1017/S0958344009000172
Chang, C., & Yamada, M. (2020). Translation tasks for learning collocations: Effects of machine translation plus post-editing and sight translation. English Teaching and Learning, 3(5), 87–101. http://doi.org/10.1007/s42321-020-00059-x
Chen, M., Huang, S., Chang, J., Liou, H. (2015) Developing a corpus-based paraphrase tool to improve EFL   learners’ writing skills. Computer Assisted Language Learning, 28(1), 22-40.
Chung, S. (2020). The Effect of l2 proficiency on post-editing machine translated texts. The Journal of Asia TEFL, 17(1), 182–193. http://doi.org/10.18823/asiatefl.2020.17.1.11.182
Clifford, J., Merschel, L., Munne, J. (2013) Surveying the landscape: What is the role of machine translation in language learning?. The Acquisition of Second Languages and Innovative Pedagogies, 10, 108–121.
Correa, M. (2014). Leaving the “peer” out of peer-editing: Online translators as a pedagogical tool in the Spanish as a second language classroom. Latin American Journal of Content and Language Integrated Learning, 7(1), 1–20. http://doi.org/10.5294/laclil.2014.7.1.1
Doherty, S., Kenny, D. (2014). The design and evaluation of a statistical machine translation syllabus for translation students. The Interpreter and Translator Trainer, 8(2), 295–315.
Enkin E, Mejias-Bikandi E. (2016). Using online translators in the second language classroom: Ideas for advanced-level Spanish. Latin American Journal of Content & Language Integrated Learning, 9(1), 138–158.
Frodesen, J. (2007). Linguistic challenges of summary and paraphrase. Paper presented at the 2007 Symposium on Academicdis Language Development. San Francisco, CA.
Garcia, I., & Pena, M. (2011). Machine translation-assisted language learning: Writing for beginners. Computer Assisted Language Learning, 24(5), 471–487. http://doi.org/10.1080/09588221.2011.582687
Godwin-Jones, R. (2015). Contributing, creating, and curating: Digital literacies for language learners. Language Learning & Technology, 19(3), 8–20. http://doi.org/10125/44427
Groves, M., & Mundt, K. (2015). Friend or foe? Google Translate in language for academic purposes. English for Specific Purposes, 37(8), 112–121. http://doi.org/10.1016/j.esp.2014.09.001
Hsu, H.-C. (2019). Wiki-mediated collaboration and its association with l2 writing development: An exploratory study. Computer Assisted Language Learning, 4(2), 23–41.
              http://doi.org/10.1080/09588221.2018.1542407
Iravi, Y., & Malmir, A. (2023). The effect of lexical tools and applications on L2 vocabulary learning: A case of English academic core words. Innovation in Language Learning and Teaching, 17(3), 636-649. https://doi.org/10.1080/17501229.2022.2102638
Jin, L. (2013). Foreign language learners’ use and perception of online dictionaries: A survey study. MERLOT Journal of Online Learning and Teaching, 9(4), 513–533. http://doi.org/10.1076/call.14.5.367.5775
Josefsson, E. (2011). Contemporary approaches to translation in the classroom: A study of    students’ attitudes and strategies. http://du.diva-portal.org/smash/get/diva2:519125/FULLTEXT01.pdf.                                
Kliffer, M. (2005). An experiment in MT post-editing by a class of intermediate/advanced French majors. In Proceedings EAMT 10th Annual Conference (pp. 160–165). Pázmány Péter Catholic University & MorphoLogic, Budapest, Hungary.
Kliffer, M. (2008). Post-editing machine translation as an FSL exercise. Porta Linguarum, 9(5), 53–67.
Kumar, A. (2012) Machine translation in Arabic-speaking ELT classrooms: Applications and implications. International Journal of Social Science and Humanity, 2(6), 442–445.
Lee, S. (2019). The impact of using machine translation on EFL students’ writing. Computer Assisted Language Learning, 8(6), 102–124. http://doi.org/10.1080/09588221.2018.1553186
Liao, P. (2006). EFL learners’ beliefs about and strategy use of translation in English learning. RELC Journal, 37(2), 191–215.
Mirzaeian, V. (2020). Machine Translation Output Assessment and its Impact on Reading Comprehension. Technology of Education Journal, 14(2), 697–710. https://doi.org/10.22061/jte.2019.5473.2227
Murphy, D. (2020). Supporting pre-service English teachers’ academic reading and writing with online machine translation. SYSTEM, 21(2), 25–32. http://doi.org/10.16875/stem.2020.21.2.123
Nation, I.S.P. (2001). Learning vocabulary in another language. Cambridge University Press. 
Nino, A. (2004). Recycling MT: A course on foreign language writing via MT post-editing. In Proceedings of 7th Annual CLUK Research Colloquium.
Nino, A. (2009). Machine translation in foreign language learning: Language learners’ and tutors’ perceptions of its advantages and disadvantages. Recall, 21(2), 241–258.
             http://doi.org/10.1017/S0958344009000172
Popovic, M. (2018). Error classification and analysis for machine translation. Quality Assessment, 8(6), 52–63. http://doi.org/10.1007/978-3-319-91241-7_7.
Shakouri, A., Malmir, A., & Esfandiari, R. (2022). Cultivating L2 pragmatic comprehension through computerized vs. non-computerized instruction, multiuser virtual environments (MUVEs) and mobile augmented reality games (MARGs). Issues in Language Teaching, 11(1), 313­-358.
              https://dx.doi.org/10.22054/ilt.2022.67508.693
Shei, C. (2002a). Combining translation into the second language and second language learning: An integrated computational approach. [Unpublished doctoral dissertation]. University of Edinburgh, Edinburgh.
Shei, C. (2002b). Teaching MT through pre-editing: Three case studies. In Proceedings of 6th EAMT Workshop Teaching Machine Translation (pp. 89–98). Philadelphia, PA: Association for Computational Linguistics.
Williams, L. (2006). Web-based machine translation as a tool for promoting electronic literacy and language awareness. Foreign Language Annals. 39(4), 565–578.
Wong, T., & Lee, J. (2016). Corpus-based learning of Cantonese for Mandarin speakers. ReCALL, 28(2), 187–206.
Iranian Journal of Applied Language Studies
Volume 16, Issue 1
March 2024
Pages 63-74

Files

Share

How to cite

Statistics