Evaluating the Quality of a Teacher’s Made Test against Five Principles of Language Assessment

Dedi Sumarsono, Moh. Arsyad Arrafii, Imansyah Imansyah

Abstract


Classroom assessment serves both summative and formative functions to gauge evidence, evaluate and improve student learning. Assessment evidence is only meaningful when it reflects the true picture of student learning. In this sense, the role of effective assessment instrument, such as test, as crucial to obtain a valid and reliable evidence of student learning. However, we remain in caution about the ability of teachers in designing and developing assessment instruments which are underpinned by a sound theoretical understanding of language assessment principles.This research is set out to evaluate classroom-based assessment instrument (e.g., language test) against five principles of language assessment. To achieve the intended purposes, the research adopts an evaluative research approach by which assessment instrument developed by a teacher was evaluated and rated against the principles. Documentation was used as a method to collect data by which language tests developed by teachers were collected in person. The teachers’ made testscollected in this study were analysed deductively based on five principles of language assessment. The study indicates that the teacher-made test was in general meet all aspects ofthe principles. However, some aspects within principles are not adequately addressed. Some principal suggestions are provided.

Keywords


Classroom Assessment; Test; Principles of Language Assessment; Assessment Literacy

Full Text:

FULL PDF

References


Aprianoto, & Haerazi. (2019). Development and Assessment of an Interculture-based Instrument Model in the Teaching of Speaking Skills. Universal Journal of Educational Research, 7(12), 2796–2805. https://doi.org/10.13189/ujer.2019.071230

Arrafii, M. A. (2021). “We must assess all, even a student farting [is also assessed] for the behavioural aspect of learning”: Teachers' conceptions of assessment in the context of assessment reform in Indonesia. The Curriculum Journal, 00, 1–23. https://doi.org/10.1002/curj.130

Arrafii, M. A. (2021) Assessment reform in Indonesia: contextual barriers and opportunities for implementation, Asia Pacific Journal of Education, DOI: 10.1080/02188791.2021.1898931

Baars, M., Vink, S., van Gog, T., de Bruin, A. &Paas, F. (2014) Effects of training self- assessment and using assessment standards on retrospective and prospective monitoring of problem solving, Learning and Instruction, 33, 92-107

Bachman, L. F. (1990) Fundamental considerations in language testing. Oxford: Oxford University Press.

Baiutti, M. (2018). Fostering assessment of student mobility in secondary schools: Indicators of intercultural competence. Intercultural Education, 29(5–6), 549–570. https://doi.org/10.1080/14675986.2018.1495318

Black, P. & Wiliam, D. (2018) Classroom assessment and pedagogy, Assessment in Education: Principles, Policy & Practice, 25:6, 551-575

Brown, H. D. & Abeywickrama, P. (2018) Language assessment: Principles and classroom practices (3rded.). New York: Pearson Education Inc

Brown, H. D. (2004) Language assessment: Principles and classroom practices. New York: Pearson Education Inc.

Chapelle, C. A., Cotos, E., & Lee, J. (2015). Validity arguments for diagnostic assessment using automated writing evaluation. Language Testing, 32(3), 385–405. https://doi.org/10.1177/0265532214565386

Davies, A., Brown, A., Elder, C., Hill, K., Lumley, T., & McNamara, T. (2002) Dictionary of language testing. Beijing: Foreign Language Teaching and Research Press.

Denscombe, M. (2007) The good research guide: For small-scale social research projects (3rd edition) Buckingham, UK: Open University Press.

Dolba, S., Gula, L., & Nunez, J. (2022). Reading Teachers: Reading Strategies Employed in Teaching Reading in Grade School. Journal of Language and Literature Studies, 2(2), 62–74. https://doi.org/10.36312/jolls.v2i2.874

Firman, E., Haerazi, H., & Dehghani, S. (2021). Students’ Abilities and Difficulties in Comprehending English Reading Texts at Secondary Schools; An Effect of Phonemic Awareness. Journal of Language and Literature Studies, 1(2), 57–65. https://doi.org/10.36312/jolls.v1i2.613

Follmer, D. J., & Sperling, R. A. (2019). Examining the Role of Self-Regulated Learning Microanalysis in the Assessment of Learners’ Regulation. The Journal of Experimental Education, 87(2), 269–287. https://doi.org/10.1080/00220973.2017.1409184

Fulcher, G. (2012) Assessment Literacy for the Language Classroom, Language Assessment Quarterly, 9, 2, 113-132,

Giraldo, F. (2018) Language assessment literacy: Implications for language teachers. Profile: Issues in Teachers’ Professional Development, 20, 1, 179-195

Graves, K. (2000) Designing language courses: A guide for teachers. Boston: Heinle and Heinle.

Haerazi, H., & Kazemian, M. (2021). Self-Regulated Writing Strategy as a Moderator of Metacognitive Control in Improving Prospective Teachers’ Writing Skills. Journal of Language and Literature Studies, 1(1), 1–14. https://doi.org/10.36312/jolls.v1i1.498

Harding, L., Alderson, J. C., & Brunfaut, T. (2015). Diagnostic assessment of reading and listening in a second or foreign language: Elaborating on diagnostic principles. Language Testing, 32(3), 317–336. https://doi.org/10.1177/0265532214564505

Heaton, J. B. (2000) Writing English language tests (new ed.). Beijing: Foreign Language Teaching and Research Press.

Hughes, A. (2003) Testing for language teachers (2nd ed.). Cambridge: Cambridge University Press.

Kostons, D., van Gog, T. &Paas, F. (2012) Training self-assessment and task-selection skills: A cognitive approach to improving self-regulated learning, Learning and Instruction 22, 121-132

Mahsun. (2017). Metode penelitianbahasa.Depok: PT Rajawali Pers.

McNamara, T. (2000) Language testing. Oxford: Oxford University Press.

Nunan, D. (1999) Second language teaching and learning. Boston: Heinle and Heinle.

Popham, W. J. (2011) Assessment literacy overlooked: A teacher educator’s confession, The Teacher Educator, 46, 4, 265-273.

Stiggins, R. J. (1995) Assessment Literacy for the 21st Century, The Phi Delta Kappan, 77, 3, 238-245

Su, H. (2020). Educational Assessment of the Post‐Pandemic Age: Chinese Experiences and Trends Based on Large‐Scale Online Learning. Educational Measurement: Issues and Practice, 39(3), 37–40. https://doi.org/10.1111/emip.12369

Williams, T., Wiener, J., Lennox, C., & Kokai, M. (2022). Lessons Learned: Achieving Consensus About Learning Disability Assessment and Diagnosis. Canadian Journal of School Psychology, 37(3), 215–236. https://doi.org/10.1177/08295735221089457

Yin, R. K. (2009) Case Study Research: Design and Methods (4 ed.). London: SAGE Publications, Inc.




DOI: https://doi.org/10.33394/jollt.v11i2.7481

Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Dedi Sumarsono, Moh. Arsyad Arrafii, Imansyah Imansyah

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

JOLLT Journal of Languages and Language Teaching (p-issn: 2338-0810 | e-issn: 2621-1378) has been Indexed/Listed by

 Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.