The Effect of Self-Assessment and Conference on EFL Students’ Production of Speech Acts and Politeness Markers: Alternatives on the Horizon?

Document Type : Research Paper

Authors

1 Islamic Azad University, Science and Research Branch, Tehran

2 Allameh Tabataba’i University

Abstract

Alternative assessment approaches received considerable attention soon after a discontent with traditional, one-shot testing. These approaches, however, have been used only to improve learners’ linguistic ability despite communicative models of language which pointed that knowledge of language also involves pragmatic ability (Bachman, 1990; Bachman & Palmer, 1996). The present study tries to explore the effect of two alternative assessment approaches (self-assessment and conference) on students’ production of four speech acts (apology, complaint, request, and refusal) plus politeness markers. A sample of 64 EFL students participated in this study. Metapragmatic explanations were given to three groups of university students studying English as a foreign language. The two treatment groups received instruction through self-assessment and conference and a comparison group was exposed to the conventional one-shot testing. The results of the One-Way ANOVA conducted after the treatment revealed an outperformance of alternative assessment approaches to the conventional one in the production of the four speech acts and politeness markers in WDCTs. A qualitative analysis of students’ self-ratings in the self-assessment group revealed that they focused more on linguistic criteria during the initial sessions and on pragmatic ones by the end of the treatment. It can be concluded that alternative assessment approaches are beneficial to students’ production of speech acts and politeness markers. In the end, the applicability and the positive effect of alternative approaches in pragmatic assessment are emphasized. 

Keywords

References

Alderson, J. C., & Banerjee, J. (2001). Language testing and assessment (Part 1). Language Teaching, 34(4), 213-236.
Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford: Oxford University Press.
Bachman, L. (2004). Statistical analyses for language assessment. Cambridge, UK: Cambridge University Press.
Bachman, L. F., & Palmer, A. S. (1989). The construct validation of self-ratings of communicative language ability. Language Testing, 6(1), 14-29.
Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice. Oxford: Oxford University Press.
Bitchener, J., & Knoch, U. (2009). The relative effectiveness of different types of direct written corrective feedback. System, 37, 322-329.
Blanche, P., & Merino, B. J. (1989). Self-assessment of foreign-language skills: Implications for teachers and researchers. Language Learning, 39(3), 313–340.
Brown, J. D., & Hudson, Th. (1998). The alternatives in language assessment. TESOL Quarterly, 32(4), 653-674.
Butler, Y. G., & Lee, J. (2010). The effects of self-assessment among young learners of English. Language Testing, 27(1), 5-31.
Dufon, M. A. (2008). Language socialization theory and the acquisition of pragmatics in the foreign language classroom. In E. Alcon-Soler & A. Martinez-Flor (Eds.), Investigating pragmatics in foreign language learning, teaching and testing (pp. 25-44). Multilingual Matters: USA.
Genesee, F., & Upshur, J. A. (1996). Classroom-based evaluation in second language education. Cambridge: Cambridge University Press.
Grabowski, K. C. (2007). Reconsidering the measurement of pragmatic knowledge using a reciprocal written task format. Teachers College, Columbia University Working Papers in TESOL & Applied Linguistics, 7, 1-48.
Janssen van-Dietten, A. M. (1989). The development of a test of Dutch as a second language: The validity of self-assessment by inexperienced subjects. Language Testing, 6(1), 30-46.
Jung, J. Y. (2002). Issues in acquisitional pragmatics. Working Papers in TESOL & Applied Linguistics, 2, 1-13.
Kasper, G., & Roever, C. (2005) Pragmatics in second language learning. In E. Hinkel (Ed.), Handbook of research in second language teaching and learning (pp. 317-334). Mahwah, NJ: Lawrence Erlbaum.
Kasper, G., & Rose, K. (2001). Pragmatics in language teaching. In G. Kasper & K. Rose (Eds.), Pragmatics in language teaching (pp. 1-9). Cambridge, UK: Cambridge University Press.
Lachat, M. A., & Spruce, M. (1998). Assessment reform, equity, and English language learners: An annotated bibliography. New York: The Education Alliance.
Little, D. (2005). The common European framework and the European language portfolio: Involving learners and their judgments in the assessment process. Language Testing, 22(3), 321-336.
Liu, J. (2006). Assessing EFL learners’ interlanguage pragmatic knowledge: Implications for testers and teachers. Reflections on English language teaching, 5, 1-22.
Lombardi, M. M. (2008). Making the grade: The role of assessment in authentic learning. Colorado, US: EDUCAUSE.
Matsuno, S. (2009). Self-, peer-, and teacher-assessments in Japanese university EFL writing classrooms. Language Testing, 26(1), 75-100.
McNamara, T. (2001). Language assessment as social practice: Challenges for research. Language Testing, 18(3), 333-349.
Oscarson, M. (1989). Self-assessment of language proficiency: Rationale and applications. Language Testing, 6(1), 1-13.
Oscarson, M., & Apelgren, B. M. (2011). Mapping language teachers’ conceptions of student assessment procedures in relation to grading: A two-stage empirical inquiry. System, 39, 2-16.
Palm, T. (2008). Performance assessment and authentic assessment: A conceptual analysis of the literature. Practical Assessment, Research and Evaluation, 13(4), 1-11.
Roever, C. (2006). Validation of a web-based test of ESL pragmalinguistics. Language Testing, 23(2), 229-256.
Ross, S. (1998). Self-assessment in second language testing: A meta-analysis and analysis of experiential factors. Language Testing, 15(1), 1-20.  
Tada, M. (2005). Assessment of EFL pragmatic production and perception using video prompts (Unpublished doctoral dissertation). Temple University, Philadelphia, PA.
Tsagari, D. (2004). Is the life beyond language testing? An introduction to alternative language assessment. CRILE working papers, 58, 2-23. 
Walters, F. S. (2004). An application of conversation analysis to the development of a test of second-language pragmatic competence (Unpublished doctoral dissertation). Illinois University, Urbana, Illinois.
Watts, R. J. (2003). Key topics in sociolinguistics: Politeness. Cambridge: Cambridge University Press.
Yamashita, S. (2008). Investigating interlanguage pragmatic ability: What are we testing? In E. A. Soler & A. Martinez-Flor (Eds.), Investigating pragmatics in foreign language learning teaching and testing (pp. 201-223). Bristol: Multilingual Matters.
Iranian Journal of Applied Language Studies
Volume 5, Issue 1 - Serial Number 1
September 2013
Pages 1-30

Files

Share

How to cite

Statistics