Iranian TEFL Graduates’ Conceptions of Measurement Error in Research: A Genealogical Narrative Inquiry

Document Type : Research Paper

Authors

Ferdowsi University of Mashhad, Iran

Abstract

The aim of this study is to investigate Iranian TEFL graduates’ conception of measurement error in research. Adopting a sequential explanatory multi-method strategy (Borg, 2009), the researchers analyzed causal and temporal relations in the research narratives elicited from 30 TEFL graduates. Gee’s (1986) framework for identifying narrative discourse units (lines, stanzas, and episodes) was adopted to investigate participants’ conceptions of logical orders in measure development algorithms and their knowledge of error sources. In addition, taking a narrative positivistic approach, the narratives were rated based on Optimal Matching Analysis (OMA). Finally in ‘continuous event history modeling’ phase of the study, Cox Proportional Regression Analysis showed how temporal markers in research narratives can be used to predict one’s knowledge of measure development in research design. The results suggest that researchers’ error-awareness and algorithmic knowledge correlate significantly with each other and constitute knowledge of measure development in general. The contribution of dimensionality and validity testing to this knowledge was also found to be statistically significant.

Keywords

References

Abbott, A. (1992). “From causes to events: Notes on narrative positivism”, Sociological Methods and Research, 20, pp. 428-455.
Abbott, A., and Tsay, A. (2000). “Sequence analysis and optimal matching techniques in sociology”, Sociological Methods and Research, 29, pp. 3-33.
Allison, D., and Carrey, J. (2007). “What do university language teachers say about language teaching research?”, TESL Canada Journal, 24, pp. 61-81.
Atay, D. (2008). “Teacher research for professional development”, ELT Journal, 62, pp. 139-147.
Bagozzi, R. P., and Yi, Y. (1991). “Multitrait-multimethod matrices in consumer research”, Journal of Consumer Research, 17, pp. 426- 439.
Bardo, J. W., Yeager, S. J., and Klingsporn, M. J. (1982). “Preliminary assessment of format-specific central tendency and leniency error in summated rating scales”, Perceptual and Motor Skills, 54, pp. 227-234.
Bearger, D., and McAdams, D. P. (1999). “Life story and its relation to psychological well-being”, Narrative Inquiry, 9, pp. 69-96.
Borg, S. (2006). “Conditions for teacher research”, English Teaching Forum, 44,       pp. 22-27.
Borg, S. (2007). “Research engagement in English language teaching”, Teaching and Teacher Education, 23, pp. 731-747.
Borg, S. (2008). “English language teachers’ beliefs about research: Perspectives from the Netherlands”, Journal of the Dutch Association of Modern Language Teachers, 9, pp. 3-13.
Borg, S. (2009). “English language teachers’ conceptions of research”, Applied Linguistics, 30, pp. 358-388.
Brown, J. D., Knowles, M., Murray, D., Neu, J., and Violand-Sanchez, E. (1992). The Place of Research Within the TESOL Organization, Cambridge: TESOL.
Connelly, F. M., and Clandinin, D. J. (2006). “Narrative inquiry”, in Green, J. L. n., Gamilili, G., and Elmore, P. B. (eds.), Complementary methods for research in education, NJ: Erlbaum, pp. 375-385.
Craig, C. J. (2007). “Story constellations: A narrative approach to contextualizing teachers’ knowledge of school reform”, Teaching and Teacher Education, 23(2), pp. 173-188.
Crites, S. (1971). “The narrative quality of experience”, Journal of American Academy of Religion, 399, pp. 291-311.
Czarniawska, B. (2004). Narratives in Social Science Research, London: Sage.
Elliot, J. (2005). Using Narrative in Social Research: Qualitative and Quantitative Approaches, London: Sage Publication.
Franzosi, R. (1998). “Narrative as data: Linguistic and statistical tools for the quantitative study of historical events”, International Review of Social History, 43, pp. 81-104.
Gee, J. P. (1986). “Units in the production of narrative discourse”, Discourse Processes, 9, pp. 391- 422.
Ghiselli, E. E., Campbell, J. P., and Zedeck, S. (1981). Measurement Theory in the Behavioral Sciences, Sac Francisco: Freeman.
Lang, R. R. (2001). “Story grammars: Return of a theory”, in Mateas, M. and Sengers, P. (eds.), Narrative intelligence: Advances in consciousness research, Philadelphia: John Benjamins, pp. 199-212.
McDonough, J., and McDonough, S. (1990). “What’s the use of research?”, ELT Journal, 44 (2), pp. 102-109.
Nunan, D. (1997). “Developing standards for teacher-research TESOL”, TESOL Quarterly, 31, pp. 365-367.
Ochberg, R. L. (1996). “Interpreting life stories”, in Josselson, R. (ed.), Ethics and process in the narrative study of lives, CA: Sage, pp. 35-49.
Viswanathan, M. (2005). Measurement Error and Research Design, London: Sage.
Xu, Y., and Liu, Y. (2009). “Teacher assessment knowledge and practice: A narrative inquiry of a Chinese college EFL teacher’s experience”, TESOL Quarterly, 43, pp. 493-513.

Files

Share

How to cite

Statistics