Evaluasi Learning Management System Timedoor Academy Pro dengan Metode Usability Testing
Abstract
The internet development has advanced the education sector in Indonesia, encouraging the use of Learning Management Systems (LMS) for distance learning. Timedoor Academy Pro is one of the EduTech companies that uses LMS, but the LMS has never been tested on users and often confuses users. Therefore, a usability evaluation was conducted using Performance Measurement, Retrospective Think Aloud, and System Usability Scale (SUS) techniques to identify usability problems and evaluate system quality. Respondents were categorized into mentor users and students into advanced and beginner respondents. The evaluation results showed that the Timedoor Academy Pro LMS was not effective as seen from errors when respondents worked on task scenarios, and was not efficient as seen from differences in task completion time from the Mann-Whitney statistical test, and users were dissatisfied with the SUS score of 52 for mentors and 46 for students. Recommendations for improvement include changing the page layout, navigation menu, minimizing task steps, and adding features according to HCI guidelines and respondent suggestions.
Kata kunci: Usability Testing; Learning Management System; Performance Measurement; Retrospective Think Aloud; System Usability Scale
Abstrak
Perkembangan internet memajukan sektor pendidikan di Indonesia, mendorong penggunaan Learning Management System (LMS) untuk pembelajaran jarak jauh. Timedoor Academy Pro menjadi salah satu perusahaan EduTech yang menggunakan LMS, namun LMS tersebut belum pernah diuji kepada pengguna dan sering membuat bingung pengguna. Sehingga, dilakukan evaluasi usability menggunakan teknik Performance Measurement, Retrospective Think Aloud, dan System Usability Scale (SUS) untuk mengidentifikasi masalah usability dan mengevaluasi kualitas sistem. Responden dikategorikan menjadi pengguna mentor dan siswa yang dikelompokkan menjadi responden mahir dan pemula. Hasil evaluasi menunjukkan bahwa LMS Timedoor Academy Pro belum efektif dilihat dari terdapat kesalahan saat responden mengerjakan task scenario, dan belum efisien dilihat dari terdapat perbedaan waktu pengerjaan task scenario dari pengujian statistik mann-whitney, serta pengguna merasa kurang puas dengan skor SUS 52 untuk mentor dan 46 untuk siswa. Rekomendasi perbaikan meliputi perubahan tata letak halaman, menu navigasi, meminimalisir langkah tugas, dan penambahan fitur sesuai panduan HCI dan saran responden.
Keywords
References
H. Listiyono, S. Sunardi, A. P. Utomo, and N. Mariana, “Pengaruh Kemudahan Penggunaan dan Kemanfaatan Learning Management System (LMS) Terhadap Niat Penggunaan E-Learning,” J. Sisfokom (Sistem Inf. dan Komputer), vol. 11, no. 2, pp. 208–213, 2022, doi: 10.32736/sisfokom.v11i2.1419.
A. Yauma, I. Fitri, and S. Ningsih, “Learning Management System (LMS) pada E-Learning Menggunakan Metode Agile dan Waterfall berbasis Website,” J. JTIK (Jurnal Teknol. Inf. dan Komunikasi), vol. 5, no. 3, p. 323, 2020, doi: 10.35870/jtik.v5i3.190.
Kemendikbud, “Optimalisasi Penggunaan Learning Management System (LMS) dalam Meningkatkan Mutu Pembelajaran,” Direktorat Sekol. Menengah Atas, pp. 1925–1927, 2021.
Prihati, K. Nurdianto, and M. A. Heses, “Analisis e-Learning Fresto dengan Prinsip Usability,” J. Cakrawala Inf., vol. 1, no. 2, pp. 1–14, 2021, doi: 10.54066/jci.v1i2.146.
N. W. Utami, I. K. R. Arthana, and I. G. M. Darmawiguna, “Evaluasi Usability pada E-Learning Universitas Pendidikan Ganesha Dengan Metode Usability Testing,” J. Nas. Pendidik. Tek. Inform., vol. 9, no. 1, p. 112, 2020.
A. Rahman Deluma, R. Maku, and S. Syahrial, “Analisis Usability Model Iso 9241-11 Pada Sistem Informasi Kuliah Kerja Dakwah,” vol. 3, no. 2, pp. 25–33, 2023, doi: 2774924004.
N. Shifa, “Evaluasi User Interface (UI) Dan User Experience (UX) Menggunakan User Centered Design (UCD) (Studi Kasus: Aplikasi Kanggo),” Sink. J. dan Penelit. Tek. Inform., no. 8.5.2017, p. 12, 2023, doi: https://doi.org/10.33395/sinkron.v9i1.13129.
N. Luh Putri Ari Wedayanti, N. Kadek Ayu Wirdiani, and I. Ketut Adi Purnawan, “Evaluasi Aspek Usability pada Aplikasi Simalu Menggunakan Metode Usability Testing,” J. Ilm. Merpati (Menara Penelit. Akad. Teknol. Informasi), vol. 7, no. 2, p. 113, 2019, doi: 10.24843/jim.2019.v07.i02.p03.
A. Quraisy and S. Madya, “Analisis nonparametrik mann whitney terhadap perbedaan kemampuan pemecahan masalah menggunakan model pembelajaran problem based learning [Mann Whitney nonparametric analysis of differences in problem solving abilities using problem based learning models],” VARIANSI J. Stat. Its Appl. Teach. Res., vol. 3, no. 1, pp. 51–57, 2021, doi: 10.35580/variansiunm23810.
M. Ariansidi, I. M. Candiasa, and I. M. G. Sunarya, “Analisis Usability Pada Sistem Informasi LAPORBUP Menggunakan Performance Measurement , Retrospective Think Aloud dan User Experience Questionnaire,” KLIK Kaji. Ilm. Inform. dan Komput., vol. 3, no. 6, pp. 754–764, 2023, doi: 10.30865/klik.v3i6.807.
A. A. I. I. Paramitha, I. M. Artana, I. G. Irvan, P. Andika, and G. Deva, “Evaluasi Start-Up Teampal.id Berbasis Website dengan Metode Retrospective Think Aloud (RTA) dan Post Study System Usability Questionnaire (PSSUQ),” J. Teknol. Inf. dan Komput., vol. 6, pp. 336–346, 2020, [Online]. Available: https://jurnal.undhirabali.ac.id/index.php/ jutik/article/view/1163
I. M. A. O. Gunawan, G. Indrawan, and Sariyasa, “User experience evaluation of academic progress information systems using retrospective think aloud and user experience questionnaire,” J. Phys. Conf. Ser., vol. 1810, no. 1, 2021, doi: 10.1088/1742-6596/1810/1/012015.
I. G. B. B. Sadewa, D. G. H. Divayana, and I. M. A. Pradnyana, “Pengujian Usability Pada Aplikasi E-Sakip Kabupaten Buleleng Menggunakan Metode Usability Testing,” Inser. Inf. Syst. Emerg. Technol. J., vol. 1, no. 2, p. 76, 2021, doi: 10.23887/insert.v1i2.25975.
B. Shneiderman and C. Plaisant, Designing The User Interface, 4th ed., vol. 1, no. 2. Pearson Education, Inc, 2005. doi: 10.1017/S1481803500003730.
M. O. Leavitt and B. Shneiderman, Research-based web design & usability guidelines, vol. 2009, no. July 12. Washington DC, 2006. [Online]. Available: http://www.usability.gov/ pdfs/guidelines.html
How To Cite This :
Refbacks
- There are currently no refbacks.
