Developing E-Learning Evaluation Instruments: A Study in Vocational School
DOI:
https://doi.org/10.26740/joaep.v3n3.p163-174Keywords:
Instrument, Developing, Evaluation, E-LearningAbstract
This study aims to develop instrument for evaluating e-learning through Learning Management System (LMS) in the Office Administration program at vocational schools with CSE-UCLA evaluation model. Using cluster random sampling, data were collected from 85 respondents in the small-scale and 235 in the wide-scale trial stage. Validation procedures included Aiken's index for content validity, while construct validation utilized Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA), with reliability assessed using Cronbach's Alpha coefficient. The results showed that there were five instrument constructs for implementing e-learning. The Aiken index to measure content validity showed a valid item. The validity of the instrument construct was evaluated using EFA with a KMO value of 0.751, and each item had an anti-image coefficient more than 0.5, meaning that the factor analysis requirements for the future were met. The fit model based on the CFA result showed the value of Chi-square (X^2) = 239.61, df = 179, P-value = 0.416, RMSEA = 0.000. The loading factor value was 0.41-0.89 (>0.30), meaning the item was valid. The instrument's reliability showed a value of 0.791 that all instruments developed were reliable.
Downloads
References
Aiken. (1985). Three Coefficients for Analyzing the Reliability and Validity of Ratings. Educational and Psychological Measurement, 45(1), 131–142. https://doi.org/https://doi.org/10.1177/001316448545101
Allen, M. J., & Yen, W. M. (1979). Introduction to measurement theory, Monterey, CA: Brooks/Cole, 1979. Google Scholar.
Alturki, U., & Aldraiweesh, A. (2021). Application of learning management system (Lms) during the covid-19 pandemic: A sustainable acceptance model of the expansion technology approach. Sustainability (Switzerland), 13(19). https://doi.org/10.3390/su131910991
Andrian, D., Kartowagiran, B., & Hadi, S. (2018). The instrument development to evaluate local curriculum in Indonesia. International Journal of Instruction, 11(4). https://doi.org/10.12973/iji.2018.11458a
Anshori, S. (2018). Pemanfaatan Teknologi Informasi Dan Komunikasi Sebagai Media Pembelajaran. Civic-Culture: Jurnal Ilmu Pendidikan PKn Dan Sosial Budaya, 9924.
Ariesta, W., Aina, M., Uslan, Kumbarasari, S., Aminatun, D., & Mishbahuddin. (2021). Evaluation Of Online Learning In Higher Education During The COVID-19 Pandemic : A Review and Recommendations. Novateur Publication, India, June.
Azwar, S. (2016). Reliabilitas Dan Validitas Aitem. Buletin Psikologi, 3(1).
Chahal, K., & Patel, M. (2021). Features of Learning Management Systems (LMS) for Improving Teaching and Learning. Journal of Interdisiplinary Cycle Research , 13(11).
Cramer, D. (2003). Advance Quantitative Data Analysis. McGraw-Hill Education.
Dalkey, N., & Helmer, O. (1963). An Experimental Application of the DELPHI Method to the Use of Experts. Management Science, 9(3). https://doi.org/10.1287/mnsc.9.3.458
Divayana, D. G. H. (2017). Evaluasi Pemanfaatan E-Learning Menggunakan Model CSE-UCLA. Cakrawala Pendidikan, 36(2).
Feldt, L. S., & Brennan, R. L. (1989). Reliability. In R. L. Linn (Ed.). Educational Measurement, 105–146.
Ferdinand, A. (2002). Structural Equation Modelling dalam Peneltian Manajemen. Badan Penerbit Universitas Diponegoro.
Furqon, M., Sinaga, P., Liliasari, L., & Riza, L. S. (2023). The Impact of Learning Management System (LMS) Usage on Students. TEM Journal, 12(2). https://doi.org/10.18421/TEM122-54
Gao, M., Cui, Y., Chen, H., Zeng, H., Zhu, Z., & Zu, X. (2022). The efficacy and acceptance of online learning vs. offline learning in medical student education: a systematic review and meta-analysis. Journal of Xiangya Medicine, 7. https://doi.org/10.21037/jxym-22-3
Giatman, M., Siswati, S., & Basri, I. Y. (2020). Online Learning Quality Control in the Pandemic Covid-19 Era in Indonesia. Journal of Nonformal Education, 6(2).
Gronlund, N. E., & Robert, L. L. (1991). Educational Assessment and Reporting. Harcout Brace Javanovich Publisher.
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate Data Analysis. In Vectors. https://doi.org/10.1016/j.ijpharm.2011.02.019
Handarini, O. I., & Wulandari, S. S. (2020). Pembelajaran Daring Sebagai Upaya Study From Home (SFH) Selama Pandemi Covid 19. Jurnal Pendidikan Administrasi Perkantoran (JPAP), 8(3). https://doi.org/10.26740/jpap.v8n3.p496-503
Hartanto, W. (2016). Penggunaan E-Learning sebagai Media Pembelajaran. Jurnal Pendidikan Ekonomi, 10(1).
Iacobucci, D., Neelamegham, R., & Hopkins, N. (1999). Measurement quality issues in dyadic models of relationships. Social Networks, 21(3). https://doi.org/10.1016/S0378-8733(99)00010-6
Istiyono, E., Mardapi, D., & Suparno, S. (2014). Pengembangan Tes Kemampuan Berpikir Tingkat Tinggi Fisika (PysTHOTS) Peserta Didik SMA. Jurnal Penelitian Dan Evaluasi Pendidikan, 18(1). https://doi.org/10.21831/pep.v18i1.2120
Jöreskog, K. G., & Sörbom, D. (1993). LISREL 8: Structural Equation Modeling with the SIMPLIS Command Language. Scientific Software International. In Scientific Software.
Kasim, N. N. M., & Khalid, F. (2016). Choosing the right learning management system (LMS) for the higher education institution context: A systematic review. International Journal of Emerging Technologies in Learning, 11(6). https://doi.org/10.3991/ijet.v11i06.5644
Krome, L. (2021). A review of Zoom utilization in higher education during the COVID-19 pandemic. Education Thinking, 1(8).
Mar’ah, N. K., Rusilowati, A., & Sumarni, W. (2020). Perubahan Proses Pembelajaran Daring Pada Siswa Sekolah Dasar di Tengah Pandemi Covid-19. Prosiding Seminar Nasional Pascasarjana UNNES.
Mardapi, D. (2008). Teknik Penyusunan Instrumen Tes dan Nontes. Mitra Cendekia Offset.
Mardapi, D. (2017). Pengukuran, penilaian dan evaluasi pendidikan “Measurement, assessment and evaluation of education. Penerbitan Parama.
Nunnally, J. C., & B. I. H. (1994). Psychometric theory (3rd ed.). . McGraw Hill.
Nurrahman, A., Sukirno, S., Pratiwi, D. S., Iskandar, J., Rahim, A., & Rahmaini, I. S. (2022). Developing Student Social Attitude Self-Assessment Instruments: A Study in Vocational High School. Research and Evaluation in Education, 8(1). https://doi.org/10.21831/reid.v8i1.45100
Pedhazur, E. J. (1997). Multiple Regression in Behavioral Research; Explanation and Prediction. In Journal of the American Statistical Association (Vol. 70, Issue 352).
Purwanto, A., Asbari, M., Prameswari, M., & Ramdan, M. (2020). Gaya Kepemimpinan Di Madrasah Aliyah: Authentic, Tansformational, Authoritarian Atau Transactional? Nidhomul Haq : Jurnal Manajemen Pendidikan Islam, 5(1). https://doi.org/10.31538/ndh.v5i1.544
Retnawati, H. (2016). Analisis Kuantitatif Instrumen Penelitian (Panduan Peneliti, Mahasiswa dan Psikometri). www.nuhamedika.gu.ma
Rohana, S. (2020). Model Pembelajaran Daring Pasca Pandemi COVID-19. At-Ta’dib: Jurnal Ilmiah Prodi Pendidikan Agama Islam. https://doi.org/10.47498/tadib.v12i02.441
Salkind, N. J. (2007). Encyclopedia of Measurement and Statistics. SAGE.
Setiawati, F. A., Mardapi, D., & Azwar, S. (2013). Penskalaan Teori Klasik Instrumen Multiple Intelligences Tipe Thurstone Dan Likert. Jurnal Penelitian Dan Evaluasi Pendidikan, 17(2). https://doi.org/10.21831/pep.v17i2.1699
Sintawana, N. (Nisya), Lazirkha, D. P. (Diana), & Sari, S. N. (Siti). (2020). Pengaruh Media Pembelajaran Online Berbasis E-learning pada Aplikasi Zenius terhadap Hasil Belajar Siswa SMA. JI-Tech.
Stufflebeam & Shinfield. (1985). Systematic Evaluation. Kluwer.
Sustiawati, M., & Zakiyah, Z. (2022). Pengaruh Pembelajaran Online Terhadap Hasil Belajar Siswa pada Pembelajaran Pendidikan Agama Islam. Proceedings Series on Social Sciences & Humanities, 4. https://doi.org/10.30595/pssh.v4i.291
Tanuwijaya, N. S., & Tambunan, W. (2021). Alternatif Solusi Model Pembelajaran untuk Mengatasi Resiko Penurunan Capaian Belajar dalam Pembelajaram Tatap Muka Terbatas di Masa Pandemic Covid 19 (Studi Kasus Analisis Kebijakan Pendidikan). Jurnal Manajemen Pendidikan, 10(02).
Tena, M. J. F., del Carmen Ortega Navas, M., & Fuster, M. C. S. (2021). New technologies as innovative teaching-learning strategies in the Digital Era. Revista Electronica Interuniversitaria de Formacion Del Profesorado, 24(1). https://doi.org/10.6018/REIFOP.406051
Yanto, B., & Retnawati, H. (2018). Dapatkah Model Blended Learning Mempengaruhi Kemandirian Belajar Matematika Siswa? AKSIOMA: Jurnal Program Studi Pendidikan Matematika, 7(3). https://doi.org/10.24127/ajpm.v7i3.1559
Yuliana, D. P. (2022). Efektivitas Penggunaan Google Meet Sebagai Media Pembelajaran Daring Selama Pandemi COVID-19. Jurnal Pendidikan Teknologi Informasi (JUKANTI), 5(1). https://doi.org/10.37792/jukanti.v5i1.378
Downloads
Published
How to Cite
Issue
Section
Abstract views: 227
,
PDF Downloads: 166
