TESTING TEST VALIDITY AND RETENTION THROUGH THE WASHBACK EFFECT: A CASE STUDY
Keywords:
testing, validity, washback effect, assessment, retentionAbstract
The teaching process consists of many different components, from planning and design to teaching, assessment and feedback. The whole process goes hand in hand with the methodology and the sequence of activities that are presented and a huge part of the process lies in the effectiveness of the teaching i.e. students results at the end. This paper elaborates the issues of teaching, assessment and the ongoing process of learning. The crucial components of the process lie in the effectiveness of our teaching methodology, theory and of course, the average grade points that students achieve. The overall success achieved by students is the reflection of how well all was managed and of course, how much was in fact learned. In order to test the validity of the teaching methodology and assessment compared to the knowledge acquired, the washback effect was used. Namely, the process included 23 third year BA students of English language teaching at IBU. The case study tested test validity, student knowledge and the washback effect after an approximate 6 weeks of lectures, in the form of a Quiz. The Quiz contained 10 essay-form questions related to the topics which were previously discussed. The total time needed for the case study was 9 weeks, including 6 weeks of instructional teaching, the Quiz week, Retention week and the Washback effect week. Research questions include: “Do teachers teach to the test, and if so, are the obtained results better?” “Does score consistency prove retention of knowledge?”“Can test validity be tested through the washback effect? The procedure in fact, proved that there was a discrepancy in the results, namely, some students did better, some gained less points and only a few remained the same in their average score i.e. half of the students received the same group of the Quiz during washback week, while half of the students received a different version of the Quiz (compared to the prior). The main aim was to identify the issue of retention and mechanical learning i.e. the extent to which information was remembered or the extent to which learners reflected on both Quiz versions after the actual procedure (they had one week of retention to do so).The overall results, discussion, limitations and future recommendations will be provided further in the paper.
References
Abolfathi, A., Tahir, N., & Ahmed, K. (2022). Different types of assessments and their effect on students’ learning and workload in remote learning September 2022 Conference: The 8th International Symposium of Engineering Education.(https://www.researchgate.net/publication/366876462_Different_types_of_assessments_and_their_effect_on_students'_learning_and_workload_in_remote_learning)
Douglas Brown, H. (2018) Language assessment: Principles and classroom practice. Pearson Longman.
Lutfiana, L., Tono, S., & Mahmuda, A. (2020). Overseas students’ language and culture barriers towards acquiring academic progress: A study of Thai undergraduate students. Int. J. Curr. Sci. Multidiscip. Res. 3, 107–114.
Martel, J. (2019). Washback of ACTFL’s integrated performance assessment in an intensive summer language program at the tertiary level. Lang. Educ. Assess. 2, 57–69.
Messick, S. (1996). Validity and washback in language testing. Lang. Test. 13, 241–256. doi: 10.1177/026553229601300302
McKinley & Thompson (2018). "Washback Effect in Teaching English as an International Language" (PDF). TESOL Encyclopedia of English Language Teaching. 1: 1–12. doi:10.1002/9781118784235.eelt0656. ISBN 9781118784228.)
Mousavi, Seyyed Abbas. (2002). An encyclopedic dictionary of language testing. Third Edition. Taiwan: Tung Hua Book Company
Penny, Ur, (2024) A course in Language Teaching, Third Edition. Cambridge University Press
Pitoyo, M.D., Sumardi, S., & Asib, A. (2020). Gamification- based assessment: The washback effect of quizzes on students learning in higher education. Int. J. Lang. Educ. 4, 1-10. Doi:10.26858/ijole.v4i2.8188
Rahman, K., Seraj, P. M. I., Hasan, M., Namaziandost, E., & Tilwani, S. A. (2021). Washback of assessment on English teaching-learning practice at secondary schools. Lang. Test. Asia 11, 1–23. doi: 10.1186/s40468-021-00129-2