Fairness dalam Pengujian Kemahiran Reseptif Tes Evaluasi Belajar Bahasa Indonesia bagi Penutur Asing Tingkat I: Tinjauan berbasis Etik
DOI:
https://doi.org/10.31004/jptam.v6i2.4364Keywords:
Review Tes, BIPA, Evaluasi, Pendekatan Berbasis EtikaAbstract
Tes Evaluasi Pembelajaran Bahasa Indonesia Penutur Asing Tingkat I (TEB BIPA I) merupakan ujian untuk menilai prestasi belajar peserta didik dalam mempelajari bahasa Indonesia sebagai bahasa asing. Sebagai prototipe, TEB BIPA I membutuhkan evaluasi yang komprehensif. Tinjauan ini berusaha untuk menguji kegunaan dan kewajaran TEB BIPA I secara keseluruhan menggunakan model terbaru Kunnan (2018) untuk menilai kewajaran tes di bawah pendekatan berbasis etika. Tinjauan tersebut menggunakan tes keterampilan reseptif sebagai unit analisis. Data yang dikumpulkan meliputi studi dokumen naskah tes, spesifikasi tes, referensi kurikulum, hasil tes percontohan, halaman web BIPA Online dan petunjuk teknis pengembangan tes. Data dianalisis dengan menggunakan kerangka keadilan pendekatan berbasis etika Kunnan yang menganalisis klaim (1) kesempatan belajar, (2) kebermaknaan tes, (3) tidak adanya bias, dan (4) aksesibilitas.
References
Andrich, D., & Marais, I. (2019). A course in rasch measurement theory: Measuring in the educational, social and health sciences. Singapore: Springer Singapore. https://doi.org/10.1007/978-981-13-7496-8
Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice: Designing and developing useful language tests. Oxford?; New York: Oxford University Press.
Bachman, L. F., & Palmer, A. S. (2010). Language assessment in practice: Developing language assessments and justifying their use in the real world. Oxford?; New York: Oxford University Press.
Badan Pengembangan dan Pembinaan Bahasa. (2020). Petunjuk teknis pengembangan tes evaluasi belajar bahasa Indonesia bagi penutur asing (TEB BIPA). Jakarta.
Brown, H. D., & Abeywickrama, P. (2019). Language assessment: Principles and classroom practices (Third edition). Hoboken, NJ: Pearson Education.
Brown, H. D., & Lee, H. (2015). Teaching by principles: An interactive approach to language pedagogy (Fourth edition). White Plains, NY: Pearson Education.
Carr, N. T. (2011). Designing and analyzing language tests. Oxford?; New York: Oxford University Press.
Chapelle, C. A. (2021). Argument-based validation in testing and assessment. Thousand Oaks: SAGE Publications, Inc.
Cheng, L., & Fox, J. (2017). Assessment in the language classroom: Teachers supporting student learning. London: Macmillan Education, Palgrave.
Creswell, J. W., & Creswell, J. D. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (Fifth edition). Los Angeles: SAGE.
Dahler-Larsen, P. (2018). Qualitative evaluation: Methods, ethics, and politics with stakeholders. Dalam N. K. Denzin & Y. Lincoln (Ed.), The SAGE handbook of qualitative research (5th ed., hlm. 867–886). London; Los Angeles.: SAGE Publications.
Davies, A. (1997). Introduction: The limits of ethics in language testing. Language Testing, 14(3), 235–241. https://doi.org/10.1177/026553229701400301
Deygers, B., Van den Branden, K., & Van Gorp, K. (2018). University entrance language tests: A matter of justice. Language Testing, 35(4), 449–476. https://doi.org/10.1177/0265532217706196
Elder, C. (2018). Test review: Certifying French competency: The DELF tout public (B2). Language Testing, 35(4), 615–623. https://doi.org/10.1177/0265532218781627
Flick, U. (Ed.). (2014). The SAGE handbook of qualitative data analysis. Los Angeles: SAGE.
Fulcher, G. (2010). Practical language testing. London: Hodder Education.
Hoang, G. T. L., & Kunnan, A. J. (2016). Automated essay evaluation for English language learners:A case study of MY Access. Language Assessment Quarterly, 13(4), 359–376. https://doi.org/10.1080/15434303.2016.1230121
Holden, O. L., Norris, M. E., & Kuhlmeier, V. A. (2021). Academic integrity in online assessment: A research review. Frontiers in Education, 6, 639814. https://doi.org/10.3389/feduc.2021.639814
Hughes, A. (2003). Testing for language teachers (2nd ed). Cambridge?; New York: Cambridge University Press.
Kane, M. T. (2004). Certification testing as an illustration of argument-based validation. Measurement: Interdisciplinary Research & Perspective, 2(3), 135–170. https://doi.org/10.1207/s15366359mea0203_1
Kunnan, A. J. (1997). Connecting fairness and validation. Dalam A. Huhta, V. Kohonen, L. Kurki-Suonio, & S. Luoma (Ed.), Current developments and alternatives in language assessment: Proceedings of LTRC 1996 (hlm. 85–109). Jyväskylä: University of Jyväskylä.
Kunnan, A. J. (2004). Test fairness. Dalam M. Milanovic & C. Weir (Ed.), European language testing in a global context (hlm. 27–48). Cambridge, UK: Cambridge University Press.
Kunnan, A. J. (2018). Evaluating language assessments (First edition). New York, NY: Routledge.
Kunnan, A. J. (2020). A case for an ethics-based approach to evaluate language assessments. Dalam G. J. Ockey & B. A. Green (Ed.), Another generation of fundamental considerations in language assessment (hlm. 77–93). Singapore: Springer Singapore. https://doi.org/10.1007/978-981-15-8952-2_6
Liu, S., & Kunnan, A. J. (2015). Investigating the application of automated writing evaluation to Chinese undergraduate English majors: A case study of WriteToLearn. CALICO Journal, 33(1), 71–91. https://doi.org/10.1558/cj.v33i1.26380
Llosa, L. (2020). Revisiting the role of content in language assessment constructs. Dalam G. J. Ockey & B. A. Green (Ed.), Another Generation of Fundamental Considerations in Language Assessment (hlm. 29–42). Singapore: Springer Singapore. https://doi.org/10.1007/978-981-15-8952-2_3
Miles, M. B., Huberman, A. M., & Saldaña, J. (2014). Qualitative data analysis: A methods sourcebook (Third edition). Thousand Oaks, Califorinia: SAGE Publications, Inc.
Moghadam, M., & Nasirzadeh, F. (2020). The application of Kunnan’s test fairness framework (TFF) on a reading comprehension test. Language Testing in Asia, 10(1), 7. https://doi.org/10.1186/s40468-020-00105-2
Norris, J., & Drackert, A. (2018). Test review: TestDaF. Language Testing, 35(1), 149–157. https://doi.org/10.1177/0265532217715848
Peng, Y., Yan, W., & Cheng, L. (2021). Hanyu Shuiping Kaoshi (HSK): A multi-level, multi-purpose proficiency test. Language Testing, 38(2), 326–337. https://doi.org/10.1177/0265532220957298
Rinjaya, D. (2020). Representasi gender dalam buku BIPA 7 seri pelajar “Sahabatku Indonesia.” Jurnal Bahasa Indonesia bagi Penutur Asing (JBIPA), 2(2), 100. https://doi.org/10.26499/jbipa.v2i2.2958
Sabbah, Y. W. (2017). Security of online examinations. Dalam I. Palomares Carrascosa, H. K. Kalutarage, & Y. Huang (Ed.), Data Analytics and Decision Support for Cybersecurity (hlm. 157–200). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-59439-2_6
Toulmin, S. (2003). The uses of argument (Updated ed). Cambridge, U.K.?; New York: Cambridge University Press.
Wagner, E. (2020). Duolingo Englishtest, revised version July 2019. Language Assessment Quarterly, 17(3), 300–315. https://doi.org/10.1080/15434303.2020.1771343
Zhao, C. G., & Liu, C. J. (2019). An evidence-based review of Celpe-Bras: The exam for certification of proficiency in Portuguese as a foreign language. Language Testing, 36(4), 617–627. https://doi.org/10.1177/0265532219849000.
Downloads
Published
How to Cite
Issue
Section
Citation Check
License
Copyright (c) 2022 Daud YusufAuthors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work’s authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal’s published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
