The Effect of Choice of Prompts on Syntactic Complexity, Grammatical Accuracy, and Lexical Diversity in L2 Argumentative Writing Essays

Document Type : Research Paper

Authors

1 Department of English Language, Faculty of Humanities, Imam Khomeini International University, Qazvin, Iran

2 Department of English Language, Faculty of Humanities, Imam Khomeini International University, Qazvin, Iran,

Abstract

Previous research has shown the differential effects of task-related prompts on syntactic complexity, grammatical accuracy, and lexical diversity when L2 learners use writing prompts to produce a piece of writing. However, the extent to which the freedom in the selection of prompts affects these linguistic facets in L2 argumentative essays is still unknown. The present study, therefore, was designed to investigate differences between syntactic complexity, grammatical accuracy, and lexical diversity in argumentative essays. Seventy-one upper-intermediate male and female Iranian English-as-a-foreign language (EFL) learners from Imam Khomeini International University in Qazvin and Safir Plus institute in Tehran participated in this study. Five-paragraph essays were used to collect data, and SPSS (version 25) was used to analyze the data. Results of multivariate analysis of variance (MANOVA) showed statistically significant differences between syntactic complexity, grammatical accuracy, and lexical diversity. Results from post-hoc analyses revealed statistically significant differences between lexical diversity and grammatical accuracy as well as lexical diversity and syntactic complexity, but no statistically significant differences were found between grammatical accuracy and syntactic complexity in argumentative essays.

Keywords


Abdollahzadeh, E., Amini Farsani, M., & Beikmohammadi, M. (2017). Argumentative writing behavior of graduate EFL learners. Argumentation 31, 641–661.
Abrams, Z. I. (2019). The effects of integrated writing on linguistic complexity in L2 writing and task-complexity. System81(1), 110-121.
Ädel, A., & Erman, B. (2012). Recurrent word combinations in academic writing by native and non-native speakers of English: A lexical bundles approach. English for Specific Purposes31(2), 81-92.
Ahmadian, M. J., & Long, M. H. (Eds) (2022). The Cambridge handbook of task-based language teaching. Cambridge University Press.
Ahmadian, M., & Mansouri A. (2020). Collaborative L1 planning and L2 written task performance in an Iranian EFL context. In L. Craig., & O Rhonda (Eds.) Using tasks in diverse contexts (pp. 237-255). Multilingual Matters.
Allan, D. (2004). Oxford placement test. Oxford University Press.
Allaw, E., & McDonough, K. (2019). The effect of task sequencing on second language written lexical complexity, accuracy, and fluency. System, 85. https://doi.org/10.1016/j.system.2019.06.008
Bannert, M. (2002). Managing cognitive load—recent trends in cognitive load theory. Learning and Instruction12(1), 139-146.
Bax, S. (2018). Text inspector [Computer Software]. Developed by Bax, S., http://www.textinspector.com
Bayazidi, A., Ansarin, A. A., Mohammadnia, Z. (2019). The Relationship between syntactic and lexical complexity in speech monologues of EFL learners. Applied Research on English Language, 8(4), 473-488.
Bean, J. C. (2011). Engaging ideas: The professor's guide to integrating writing, critical thinking, and active learning in the classroom. John Wiley & Sons.
Beauvais, C., Olive, T., & Passerault, J. M. (2011). Why are some texts good and others not? Relationship between text quality and management of the writing processes. Journal of Educational Psychology103(2), 415.
Beers, S. F., & Nagy, W. E. (2011). Writing development in four genres from grades three to seven: Syntactic complexity and genre differentiation. Reading and Writing, 24(2), 183-202.
Berman, R. A., & Nir-Sagiv, B. (2004). Linguistic indicators of inter-genre differentiation in later language development. Journal of Child Language31(2), 339-380.
Biber, D. (2006). University language: A corpus-based study of spoken and written registers (Vol. 23). John Benjamins.
Biber, D., & Gray, B. (2016). Grammatical complexity in academic English: Linguistic change in writing. Cambridge University Press.
Brand-Gruwel, S., Wopereis, I., & Vermetten, Y. (2005). Information problem solving by experts and novices: Analysis of a complex cognitive skill. Computers in Human Behavior21(3), 487-508.
Bulté, B., & Housen, A. (2012). Defining and operationalising L2 complexity. In A. Housen, F. Kuiken, & I, Vedder (Eds.). Dimensions of L2 performance and proficiency: Complexity, accuracy and fluency in SLA, (pp. 23-46). John Benjamin.
Chipere, N., Durán, P., Malvern, D., & Richards, B. J. (2004). Lexical diversity and language development. Palgrave Macmillan.
Cho, M. (2019). The effects of prompts on L2 writing performance and engagement. Foreign Language Annals, 52, 576–594.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Routledge Academic.
Defazio, J., Jones, J., Tennant, F., & Hook, S. A. (2010). Academic literacy: The importance and impact of writing across the curriculum- A case study. Journal of the Scholarship of Teaching and Learning10(2), 34-47.
Elder, C., & Iwashita, N. (2005). Planning for test performance: Does it make a difference? In R. Ellis (Ed.), Planning and task performance in a second language (pp. 219-238). Amsterdam: John Benjamins.
Ellis, R., & Barkhuizen, G. P. (2005). Analysing learner language. Oxford University Press.
Foster, P. & Skehan, P. (1999). The influence of planning on performance in task-based learning. Paper presented at the British Association of Applied Linguistics, Leeds.
Foster, P., Tonkyn, A., & Wigglesworth, G. (2000). Measuring spoken language: A unit for all reasons. Applied Linguistics21(3), 354-375.
Frear, M. W., & Bitchener, J. (2015). The effects of cognitive task complexity on writing complexity. Journal of Second Language Writing30(4), 45-57.
Gebril, A., & Plakans, L. (2016). Source-based tasks in academic writing assessment: Lexical diversity, textual borrowing and proficiency. Journal of English for Academic Purposes24(1), 78-88.
Geranpayeh, A. (2006). A quick review of the English quick placement test. Retrieved from University of Cambridge ESOL Examinations: http://www.uniss.it/documenti/lingue.
Gilabert, R. (2007). The simultaneous manipulation of task complexity along planning time and [+/-Here-and-Now]: Effects on L2 oral production. Investigating Tasks in Formal Language Learning20(1), 44-68.
Grabe, W. (2002). Genre in the classroom: Multiple perspectives. Northern Arizona University
Gray, C. D., & Kinnear, P. R. (2012). IBM SPSS statistics 19 made simple. Psychology Press.
Guara-Tavares, M. G. (2008). Pre-task planning. Working memory capacity and L2 speech performance (Unpublished doctoral thesis). Univeridade Federal de Santa Catarina, Brazil.
Hall, K. M., Sabey, B. L., & McClellan, M. (2005). Expository text comprehension: Helping primary-grade teachers use expository texts to full advantage. Reading Psychology26(3), 211-234.
Hamp-Lyions, L. (2011). Writing assessment: Shifting issues, new tools, enduring questions. Assessing Writing, 16(1), 3-5.
Hamp-Lyons, L., & Mathias, S. P. (1994). Examining expert judgments of task difficulty on essay tests. Journal of Second Language Writing3(1), 49-68.
Housen, A., & Kuiken, F. (2009). Complexity, accuracy, and fluency in second language acquisition. Applied Linguistics, 30(4), 461-473.
Housen, A., Kuiken, F., & Vedder, I. (Eds.). (2012). Dimensions of L2 performance and proficiency: Complexity, accuracy and fluency in SLA. Amsterdam: John Benjamins Publishing.
Hunt, K. W. (1965). Grammatical structures written at three grade levels. National Council of Teachers of English.
Hunt, K. W. (1966). Recent measures in syntactic development. Elementary English, 43(7), 732-739.
Ishikawa, T. (2007). The effect of manipulating task complexity along the [+/- Here-and- Now] dimension on L2 written narrative discourse. In M. D. P. G. Mayo (Ed.), Investigating tasks in formal language learning (pp. 136-156). Multilingual Matters.
Jabbari. A. A. (2014). Collocational differences in Persian and English and their effect on learners’ production. International Journal of Educational Investigations, 1(2), 172-190.
Jalilifar, A., Keyvan, M., & Don, A. (2017). The effect of writing prompts on developing argumentative essays of Iranian university students of English. Journal of Modern languages, 27, 48-76.
Jeong, H. (2017). Narrative and expository genre effects on students, raters, and performance criteria. Assessing Writing31(1), 113-125.
Jiang, W. (2013). Measurements of development in L2 written production: The case of L2 Chinese. Applied Linguistics34(1), 1-24.
Johansson, V. (2009). Lexical diversity and lexical density in speech and writing: A developmental perspective. Working Papers in Linguistics53, 61-79.
Johnson, M. D. (2017). Cognitive task complexity and L2 written syntactic complexity, accuracy, lexical complexity, and fluency: A research synthesis and meta-analysis. Journal of Second Language Writing37(1), 13-38.
Kamberelis, G., & Bovino, T. D. (1999). Cultural artifacts as scaffolds for genre development. Reading Research Quarterly34(2), 138-170.
Kessler, M., Ma, W., & Solheim, I. (2021). The effects of topic familiarity on text quality, complexity, accuracy, and fluency: A conceptual replication. TESOL Quarterly. doi.org/10.1002/tesq.3096
Kim, J. Y. (2014). Predicting L2 writing proficiency using linguistic complexity measures: A corpus-Based study. English Teaching69(4), 27-51.
Kirkland, M. R., & Saunders, M. A. P. (1991). Maximizing student performance in summary writing: Managing cognitive load. TESOL Quarterly25(1), 105-121.
Koutsoftas, A. D., & Gray, S. (2012). Comparison of narrative and expository writing in students with and without language-learning disabilities. Language, Speech, and Hearing Services in Schools, 19(2), 26-48.
Kuiken, F., & Vedder, I. (2011). Task complexity and linguistic performance in L2 writing and speaking. Second language task complexity: Researching the cognition hypothesis of language learning and performance (pp. 91-104). John Benjamins.
Kuiken, F., & Vedder, I. (2012). Syntactic complexity, lexical variation, and accuracy as a function of task complexity and proficiency level in L2 writing and speaking. In A.Housen, F. Kuiken, & I. Vedder (Eds.), Dimensions of L2 performance and proficiency: Complexity, accuracy, and fluency in SLA. (pp. 143-170). John Benjamins.
Lahuerta, A. C. (2018). Study of accuracy and grammatical complexity in EFL writing. International Journal of English Studies18(1), 71-89.
Larsen-Freeman, D. (2006). The emergence of complexity, fluency, and accuracy in the oral and written production of five Chinese learners of English. Applied linguistics27(4), 590-619.
Liao, J. (2020). Do L2 lexical and syntactic accuracy develop in parallel? Accuracy development in L2 Chinese writing. System, 94, https://doi.org/10.1016/j.system.2020.102325
Malvern, D., & Richards, B. (2002). Investigating accommodation in language proficiency interviews using a new measure of lexical diversity. Language Testing19(1), 85-104.
Martin-Beltrán, M., García, A.A., & Montoya-Άvila, A. (2020). I know there's something like that in Spanish: Heritage language learners' multifaceted interactions with linguistically diverse peers. International Journal of Applied Linguistics, 30, 530-552.
Mazgutova, D., & Kormos, J. (2015). Syntactic and lexical development in an intensive English for Academic Purposes Programme. Journal of Second Language Writing29(1), 3-15.
McCarthy, M. (1998). Spoken language and applied linguistics. Ernst Klett Sprachen.
McCarthy, P. M. & Jarvis, S. (2007). A theoretical and empirical evaluation of vocd, Language Testing 24(4), 459-88.
McCarthy, P. M. (2005). An assessment of the range and usefulness of lexical diversity measures and the potential of the measure of textual, lexical diversity (MTLD). Dissertation Abstracts International, 66(12).
McCarthy, P. M., & Jarvis, S. (2010). MTLD, vocd-D, and HD-D: A validation study of sophisticated approaches to lexical diversity assessment. Behavior Research Methods42(2), 381-392.
McNamara, D. S., Crossley, S. A., & McCarthy, P. M. (2010). Linguistic features of writing quality. Written Communication27(1), 57-86.
McNamara, D. S., Crossley, S. A., & Roscoe, R. (2013). Natural language processing in an intelligent writing strategy tutoring system. Behavior Research Methods45(2), 499-515.
Meihami, H., & Saadat, M. (2019). An investigation into the effects of prompt selection on writing complexity, accuracy, and fluency: The case of Iranian learners at different proficiency levels. Journal of Language and Cultural Education, 7(3), 79-96.
Nasseri, M., & Thompson, P. (2021). Lexical density and diversity in dissertation abstracts: Revisiting English L1 vs. L2 text differences. Assessing Writing, 47. https://doi.org/10.1016/j.asw.2020.100511.
Newell, G. E., Beach, R., Smith, J., & VanDerHeide, J. (2011). Teaching and learning argumentative reading and writing: A review of research. Reading Research Quarterly46(3), 273-304.
Nippold, M. A. (2004). Research on later language development: International perspectives. Language development across childhood and adolescence3(1), 1-8.
Pallotti, G. (2009). CAF: Defining, refining and differentiating constructs. Applied Linguistics30(4), 590-601.
Polio, C. G. (2001). Research methodology in second language writing research: The case of text-based studies. On second language writing (pp. 91-115). Lawrence Erlbaum Associates.
Rahimi, M. (2018). Effects of increasing the degree of reasoning and the number of elements on L2 argumentative writing. Language Teaching Research, 22(2), 1-22.
Raimes, A. (2001). What unskilled ESL students do as they write: A classroom study of composing. In T. Silva & P. K. Matsuda (Eds.), Landmark essays: On ESL writing (pp. 37-62). Hermagoras Press.
Ravid, D., & Berman, R. A. (2010). Developing noun phrase complexity at school age: A text-embedded cross-linguistic analysis. First Language30(1), 3-26.
Rebarber, T., Rybinski, P., Hauck, M., Scarcella, R., Buteux, A., & Wang, J. (2007). Designing the comprehensive English language learner assessment (CELLA) for the benefit of users. In J. Abedi (Ed.), English language proficiency assessment in the nation: Current status and future practice (pp. 63-79). University of California.
Reilly, J., Zamora, A., & McGivern, R. F. (2005). Acquiring perspective in English: the development of stance. Journal of Pragmatics37(2), 185-208.
Robinson, P. (2011). Second language task complexity, the cognition hypothesis, language learning, and performance. In P. Robinson (Ed.), Second language task complexity: Researching the cognition hypothesis on language learning and performance (pp. 3-37). John Benjamins.
Robinson, P. (2015). The Cognition hypothesis, second language task demands, and the SSARC model of pedagogic task sequencing. In M. Bygate (Ed), Domains and directions in the development of TBLT: A decade of plenaries from the international conference (pp.87-122). John Benjamins.
Ruiz-Funes, M. (2015). Exploring the potential of second/foreign language writing for language learning: The effects of task factors and learner variables. Journal of Second Language Writing28(2), 1-19.
Rutherford, K. (2001). An investigation of the effects of planning on oral production in a second language [Unpublished MA thesis]. University of Auckland.
Sadeghi, K., & Dilmaghani, S. K. (2013). The Relationship between lexical diversity and genre in Iranian EFL         learners’ writings. Journal of Language Teaching and Research4(2), 328-334.
Scott, C. M. (1988). Spoken and written syntax. In M. Nippold (Ed.): Later language development: Ages nine through nineteen (pp. 49-55). Pro-Ed.
Scott, C. M., & Windsor, J. (2000). General language performance measures in spoken and written narrative and expository discourse of school-age children with language learning disabilities. Journal of Speech, Language, and Hearing Research43(2), 324-339.
Scott, M. S., & Tucker, G. R. (1974). Error analysis and English‐language strategies of Arab students. Language Learning24(1), 69-97.
Selinker, L. (1972). Interlanguage. IRAL-International Review of Applied Linguistics in Language Teaching10(1), 209-232.
Shi, B., Huang, L., & Lu, X. (2020). Effect of prompt type on test-takers’ writing performance and writing strategy use in the continuation task. Language Testing, 37(3), 361-388.
Skehan, P. (1998). A cognitive approach to language learning. Oxford University Press.
Skehan, P. (2009). Modelling second language performance: Integrating complexity, accuracy, fluency, and lexis. Applied Linguistics30(4), 510-532.
Skehan, P., & Foster, P. (2001). Cognition and tasks. In P. Robinson (Ed.), Cognition and second language instruction (pp. 183-205). Cambridge University Press.
Spada, N., & Tomita, Y. (2010). Interactions between type of instruction and type of language feature: A meta‐analysis. Language Learning60(2), 263-308.
StataCorp, L. P. (2016). Stata MP for Windows 64-bit. College Station, TX: StataCorp.
Sweller, J. (2011). Cognitive load theory. Psychology of learning and motivation. Academic Press.
Tabachnick, B. G., & Fidell, L. S. (2014). Using multivariate statistics. Pearson Education Limited.
Tavakoli, M., & Rezazadeh, M. (2014). Individual and collaborative planning conditions: Effects on fluency, complexity and accuracy in L2 argumentative writing. Journal of Teaching Language Skills32(4), 85-110.
Templin, M. (1957). Certain language skills in children: Their development and interrelationships. University of Minnesota, The Institute of Child Welfare.
Towell, R. (2012). Complexity, accuracy and fluency from the perspective of psycholinguistic second language acquisition research. In A. Housen, F. Kuiken, & I, Vedder (Eds.), Dimensions of L2 performance and proficiency: Complexity, accuracy and fluency in SLA (pp. 32-47). John Benjamins.
Treffers-Daller, J., Parslow, P., & Williams, S. (2016). Back to basics: How measures of lexical diversity can help discriminate between CEFR levels. Applied Linguistics39(3), 302-327.
UCLES (University of Cambridge Local Examinations Syndicate) (2001). Quick Placement Test. Oxford University Press.
Way, D. P., Joiner, E., & Seaman, M. (2000). Writing in the secondary foreign language classroom: The effects of prompts and tasks on novice learners of French. The Modern Language Journal, 84(2), 171-184.
Weigle, S. C. (2002). Assessing writing. Ernst Klett Sprachen.
Weigle, S. C. (2018). Scoring writing. In J. I. Liontas (Eds), The TESOL encyclopedia of English language teaching (pp.1-7). John Wiley. https://doi.org/10.1002/9781118784235.eelt0546.
Wigglesworth, G., & Storch, N. (2009). Pair versus individual writing: Effects on fluency, complexity and accuracy. Language Testing26(3), 445-466.
Williams, S. (2018). Text inspector. English Australia Journal33(2), 80-83.
Wolfe-Quintero, K., S. Ingaki, & H.-Y. Kim. (1998). Second Language Development in Writing: Measures of fluency, accuracy, and complexity. University of Hawai’i, Second Language Teaching and Curriculum Center.
Zhang, X., & Lu, X. (2021). Revisiting the predictive power of traditional vs. fine-grained syntactic complexity indices for L2 writing quality: The case of two genres. Assessing Writing, 51. https://doi.org/10.1016/j.asw.2021.100597.