Analisis Kualitas UX Sistem Informasi Akademik dengan Pendekatan Multi-Dimensi
Abstract
Several user complaints, such as a monotonous interface, errors during attendance logging, and unintegrated features in the academic information system at XYZ institution, indicate a need to comprehensively assess user experience quality. This study aimed to evaluate the quality of user experience using a multi-dimensional approach based on the Modular Evaluation of Key Components of User Experience version 2.0 (meCUE 2.0). A survey was conducted with 201 students from various academic cohorts who had used the system for at least one semester. The instrument covered five dimensions: instrumental quality, non-instrumental quality, emotional response, usage consequences, and overall evaluation. The results showed high scores for usefulness and ease of use, while emotional attachment and user loyalty remained moderate. User feedback highlighted the need for interface improvements and additional features. The applied instrument proved effective in providing a comprehensive picture of user experience. These findings emphasize the importance of developing a system that prioritizes visual, emotional, and evaluative aspects.
Keywords: User experience; Emotional; Commitment; Usability; Modular evaluation
Abstrak
Sejumlah keluhan pengguna seperti tampilan yang monoton, error saat presensi dan fitur yang belum terpadu pada Sistem informasi akademik di institusi XYZ menunjukkan adanya kebutuhan untuk mengukur kualitas pengalaman pengguna secara komprehensif. Penelitian ini bertujuan untuk mengevaluasi kualitas pengalaman pengguna sistem tersebut menggunakan pendekatan multi-dimensi berbasis instrumen meCUE 2.0. Survei dilakukan terhadap 201 mahasiswa dari berbagai angkatan yang telah menggunakan sistem minimal satu semester. Instrumen mencakup lima dimensi: kualitas instrumental, non-instrumental, reaksi emosional, konsekuensi penggunaan, dan evaluasi keseluruhan. Hasil menunjukkan bahwa aspek kebermanfaatan dan kemudahan penggunaan memperoleh skor tinggi, sementara keterikatan emosional dan loyalitas pengguna masih tergolong sedang. Komentar pengguna menunjukkan kebutuhan akan perbaikan antarmuka dan fitur tambahan. Instrumen yang digunakan terbukti efektif dalam menggambarkan pengalaman pengguna secara menyeluruh. Temuan ini menegaskan perlunya pengembangan sistem yang lebih berorientasi pada aspek visual, emosional dan evaluatif.
Keywords
References
R. T, U. K V, V. Vasudendra and V. D. Reddy, “Academic Anatomy of Higher Education,” International Journal for Research in Applied Science & Engineering Technology (IJRASET), vol. 13, no. 1, pp. 1654-1660, 2025.
O. D. C. Campoverde, H. A. P. Lucio, E. J. P. Ortiz and P. L. R. Neptalí, “Digital Academic Knowledge Management: Keys to Optimize Teaching and Learning,” International Journal of Religion, vol. 5, no. 10, pp. 1348 -1360, 2024.
H. Usman, S. Sahraini and M. Yusuf, “Towards Industry 4.0: Innovation of Digital-Based Academic Administration System in Islamic Religious Universities,” AL-ISHLAH: Jurnal Pendidikan, vol. 16, no. 1, pp. 179-193, 2024.
T. Mijač, M. Jadrić and M. Ćukušić, “Measuring the success of information systems in higher education - a systematic review,” ducation and Information Technologies, vol. 29, p. 18323–18360, 2024.
M. Alenezi, S. Wardat and M. Akour, “The Need of Integrating Digital Education in Higher Education: Challenges and Opportunities,” Sustainability, no. 15, p. 4782, 2023.
H. W. Alomari, V. Ramasamy, J. D. Kiper and G. Potvin, “A User Interface (UI) and User eXperience (UX) evaluation framework for cyberlearning environments in computer science and software engineering education,” Heliyon, vol. 6, no. 5, p. e03917, 2020.
A. M. Saleh, H. Y. Abuaddous, I. S. Alansari and O. Enaizan, “The Evaluation of User Experience on Learning Management Systems Using UEQ,” International Journal of Emerging Technologies in Learning (iJET), vol. 17, no. 7, pp. 145-162, 2022.
D. Al-Fraihat, M. Joy, R. Masa'deh and J. Sinclair, “Evaluating E-learning systems success: An empirical study,” Computers in Human Behavior, vol. 102, pp. 67-86, 2020.
B. Melo, R. Andrade and T. Darin, “Longitudinal user experience penelitianes in the IoT domain: a brief panorama and challenges to overcome,” in Proceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems, Diamantina, Brazil, 2022.
J. Lindblom, B. Alenljung and E. Billing, “Evaluating the User Experience of Human–Robot Interaction,” in Springer Series on Bio- and Neurosystems, Cham, Switzerland, Springer, 2020, pp. 231-256.
S. P. N. Aini and S. N. Khasanah, “Analysis Of Usability Using Heuristic Evaluation Method And Measurement Of Sus On Pricilia Application,” Jurnal Techno Nusa Mandiri, vol. 20, no. 2, pp. 71-79, 2023.
I. Darmawan, M. S. Anwar, A. Rahmatulloh and H. Sulastri, “Design Thinking Approach for User Interface Design and User Experience on Campus Academic Information Systems,” JOIV : International Journal on Informatics Visualization, vol. 6, no. 2, pp. 327-334, 2022.
G. A. P. A. Dewi, G. R. Dantes and D. G. H. Divayana, “Usability Testing On Inventory Application Using Performance Measurement, Retrospective Think Aloud, And System Usability Scale Technique,” Journal of Computer Networks, Architecture and High Performance Computing, vol. 5, no. 1, pp. 336-346, 2023.
A. Trendowicz, E. C. Groen, J. Henningsen, J. Siebert, N. Bartels, S. Storck and T. Kuhn, “User experience key performance indicators for industrial IoT systems: A multivocal literature review,” Digital Business, vol. 3, no. 1, p. 100057, 2023.
E. S. Shourmasti, R. C. Palacios, H. Holone and S. Demi, “User Experience in Social Robots,” Sensors, vol. 21, no. 15, p. 5052, 2021.
S. Park, H. K. Kim, J. Park and Y. Lee, “Designing and Evaluating User Experience of an AI-Based Defense System,” IEEE Access, vol. 11, pp. 122045-122056, 2023.
Y. Yudiana, E. Gita, D. Darmansyah and F. S. A. B.K, “Evaluasi Rancangan UI/UX SIAKAD STMIK Rosma dengan Metode User Experience Questionnaire (UEQ),” interkom, vol. 19, no. 4, pp. 9-15, 2025.
W. E. Ariawan, I. M. A. O. Gunawan and I. M. A. W. Putra, “Evaluasi Sistem Informasi Akademik (SIAK) Menggunakan Evaluasi Heuristik Dan Kuesioner Pengalaman Pengguna,” JIS SIWIRABUDA, vol. 2, no. 2, pp. 91-98, 2024.
R. F. Alifta, W. Suharso and I. Saifudin, “Evaluasi UI/UX Terhadap Sistem Informasi Akademik SMA Negeri 1 Bondowoso Dengan Metode User Centered Design (UCD) Dan User Experience Questionnaire (UEQ),” vol. 5, no. 5, pp. 600-609, 2024.
T. Adhitya, E. N. F. Dewi and M. A. Nugraha, “User Experience Analysis On Siliwangi University SIMAK Using Heart Metrics Framework Based On User Background,” International Journal of Applied Information Systems and Informatics (JAISI), vol. 2, no. 1, pp. 34-41, 2024.
I. P. A. Purnawan, I. K. G. D. Putra and N. K. D. Rusjayanthi, “Evaluasi Usability dan User Experience LMS OASE Universitas Udayana Menggunakan Metode Tuxel 2.0,” Jurnal Nasional Pendidikan Teknik Informatika: JANAPATI, vol. 10, no. 3, pp. 177-190, 2021.
N. R. Kusumawati, A. Efendi and C. W. Budiyanto, “Comparative Analysis Between Using Google Meet and Gather Town Video Conferencing Platforms Viewed from User Experience Using meCUE Questionnaire on Students,” vol. 8, no. 1, pp. 10-14, 2024.
W. Ariannor and S. Abidah, “Evaluasi User Experience Sistem E-Learning Menerapkan User Experience Questionaire,” Jutisi: Jurnal Ilmiah Teknik Informatika dan Sistem Informasi, vol. 11, no. 2, pp. 383-392, 2022.
L. I. D. Faruk, M. D. Babakerkhell, P. Mongkolnam, V. Chongsuphajaisiddhi, S. Funilkul and D. Pal, “A Review of Subjective Scales Measuring the User Experience of Voice Assistants,” IEEE Access, vol. 12, pp. 14893-14917, 2024.
W. T. Nakamura, I. Ahmed, D. Redmiles, E. Oliveira, D. Fernandes, E. H. T. d. Oliveira and T. Conte, “Are UX Evaluation Methods Providing the Same Big Picture?,” Sensors, vol. 21, no. 10, p. 3480, 2021.
L. Marques, P. G. Matsubara, W. T. Nakamura, B. M. Ferreira, I. S. Wiese, B. F. Gadelha, L. M. Zaina, D. Redmiles and T. U. Conte, “Understanding UX Better: A New Technique to Go beyond Emotion Assessment,” Sensors, vol. 21, no. 21, p. 7183, 2021.
E. Mortazavi, P. Doyon-Poulin, D. Imbeau, M. Taraghi and J.-M. Robert, “Exploring the Landscape of UX Subjective Evaluation Tools and UX Dimensions: A Systematic Literature Review (2010–2021),” Interacting with Computers, vol. 36, no. 4, pp. 255-278, 2024.
A. K. Darmawan, M. B. Setyawan, A. F. Cobantoro, F. Masykur, A. Komarudin and M. W. a. Wajieh, “Adaptation of the meCUE 2.0 Version for User Experience(UX) Measurement Approach into Indonesian Context,” in 2021 Sixth International Conference on Informatics and Computing (ICIC), Jakarta, Indonesia, 2021.
A. K. Darmawan, M. B. Setyawan, B. Bakir, M. Walid, M. A. Hamzah and A. Asir, “Assessing and Enhancing an Existing User Experience (UX) of Smart Regency Mobile-Apps Service with meCUE 2.0 Framework,” in 2021 9th International Conference on Cyber and IT Service Management (CITSM), Bengkulu, Indonesia, 2021.
A. K. Darmawan, I. Arifin and A. Anwari, “Exploring User Experience and User Interface of Indonesian e-Health PeduliLindungi Mobile-Apps with MeCUE 2.0 Framework,” Jurnal Sisfokom (Sistem Informasi dan Komputer), vol. 12, no. 2, pp. 244-253, 2023.
M. Schrepp, “Measuring User Experience with Modular Questionnaires,” in 2021 International Conference on Advanced Computer Science and Information Systems (ICACSIS), Depok, Indonesia, 2021.
M. Balloufaud, A. Boujut, R. Marie, A. Guinaldo, L. Fourcade, J. Hamonet-Torny and A. Perrochon, “Augmented Reality Exergames for Upcoming Cognitive-Motor Rehabilitation: User-Centered Design Approach and User Experience of Healthy Children,” JMIR Rehabilitation and Assistive Technologies, vol. 12, pp. 1-42, 2024.
L. Samson, L. Carcreff, F. Noublanche, S. Noublanche, H. Vermersch-Leiber and C. Annweiler, “User Experience of a Semi-Immersive Musical Serious Game to Stimulate Cognitive Functions in Hospitalized Older Patients: Questionnaire Study,” JMIR Serious Games, vol. 13, pp. 1-26, 2024.
A. Meiriza, R. Rahmadhani, P. E. Sevtiyuni, N. R. Oktadini and P. Pacu Putra, “Evaluasi User Experience Pada Aplikasi Disney+ Hotstar Menggunakan Metode MeCUE Questionnaire (2.0),” The Indonesian Journal of Computer Science (IJCS), vol. 12, no. 4, pp. 4320-4330, 2023.
M. S. G. Canché, “Machine driven classification of open-ended responses (MDCOR): An analytic framework and no-code, free software application to classify longitudinal and cross-sectional text responses in survey and social media research,” Expert Systems with Applications, vol. 215, p. 119265, 2023.
V. Baburajan, J. d. A. e Silva and F. C. Pereira, “Open-Ended Versus Closed-Ended Responses: A Comparison Study Using Topic Modeling and Factor Analysis,” IEEE Transactions on Intelligent Transportation Systems, vol. 22, no. 4, pp. 2123-2132, 2021.
M. A. Memon, R. Thurasamy, H. Ting and J. Cheah, “Purposive Sampling: A Review And Guidelines For Quantitative Research,” Journal of Applied Structural Equation Modeling, vol. 9, no. 1, pp. 1-23, 2025.
C. Andrade, “The Inconvenient Truth About Convenience and Purposive Samples,” Indian Journal of Psychological Medicine, vol. 43, no. 1, pp. 86-88, 2020.
D. Kurniasih, R. Pedrason, I. G. K. B. Harryarsana, S. Hamid and A. S. Saputra, “The effect of e-Servqual and public service on community satisfaction: An empirical study in government organization,” International Journal of Data and Network Science, vol. 7, no. 3, pp. 1413-1420, 2023.
M. Minge, “Home: meCUE 2.0,” Michael Minge, 30 12 2021. [Online]. Available: https://mecue.de/english/home.html. [Accessed 12 6 2025].
A. Batch, Y. Ji, M. Fan, J. Zhao and N. Elmqvist, “uxSense: Supporting User Experience Analysis with Visualization and Computer Vision,” IEEE Transactions on Visualization and Computer Graphics, vol. 30, no. 7, pp. 3841-3856, 2024.
S. Liu, H. Zhang, Z. Yang, J. Kong, L. Zhang and C. Gao, “UXBIV: An Evaluation Framework for Business Intelligence Visualization,” IEEE Access, vol. 11, pp. 92391-92415, 2023.
R. Sihwail, K. Omar, K. A. Z. Ariffin and M. Tubishat, "Improved Harris Hawks Optimization Using Elite Opposition-Based Learning and Novel Search Mechanism for Feature Selection," {IEEE Access, vol. 8, pp. 121127-121145, 2020.
A. Rizk and A. Elragal, "Data science: developing theoretical contributions in information systems via text analytics," Journal of Big Data, vol. 7, no. 7, pp. 1-26, 2020.
V. Grover and K. Lyytinen, "The Pursuit of Innovative Theory in the Digital Age. Journal of Information Technology," vol. 38, no. 1, pp. 45-59, 2022.
C. Watson, N. Cooper, D. N. Palacio, K. Moran and D. Poshyvanyk, "A Systematic Literature Review on the Use of Deep Learning in Software Engineering Research," A Systematic Literature Review on the Use of Deep Learning in Software Engineering Research, vol. 31, no. 2, pp. 1-58, 2022.
F. Al-Hawari, “Software design patterns for data management features in web-based information systems,” Journal of King Saud University - Computer and Information Sciences, vol. 34, no. 10, pp. 10028-10043, 2022.
N. Peddisetty, "Enhancing digital products: A deep dive into UI/UX Design," International Journal of Multidisciplinary Research and Growth Evaluation, vol. 6, no. 1, pp. 2067-2070, 2025.
I. F. Ramadhan and A. S. Aji, "Enhancing Repository Application UI/UX through Design Thinking Methodology," Journal of Scientific Research, Education, and Technology (JSRET), vol. 3, no. 4, p. 1540–1550, 2024.
K. R. Chaganti, U. S. Ramula, C. Sathyanarayana, R. Changala, N. Kirankumar and K. Gupta, "UI/UX Design for Online Learning Approach by Predictive Student Experience," in 2023 7th International Conference on Electronics, Communication and Aerospace Technology (ICECA), Coimbatore, India, 2023.
S. Kurnia and N. Nawaningtyas, "Analisis Interaksi Pengguna dalam Desain User Interface dan User Experience yang Lebih Baik Menggunakan Metode Heuristik," Jurnal Teknik Mesin, Industri, Elektro Dan Informatika, vol. 3, no. 4, p. 113–119, 2024.
J. S. Kim, M. Kim and T. H. Baek, "Enhancing User Experience With a Generative AI Chatbot," International Journal of Human–Computer Interaction, vol. 41, no. 1, pp. 651-663, 2025.
A. Mishra, A. Shukla, N. P. Rana, W. L. Currie and Y. K. Dwivedi, "Re-examining post-acceptance model of information systems continuance: A revised theoretical model using MASEM approach," International Journal of Information Management, vol. 68, p. 102571, 2023.
Y.-J. Lee, "A Study on User Experience Elements of Micro-Interactions," Next-generation Convergence Information Services Society (NCISS), vol. 13, no. 6, pp. 723-732, 2024.
S. Gonzales, M. B. Carson, G. Viger, L. O’Keefe, N. B. Allen, J. P. Ferrie and K. Holmes, "User Testing with Microinteractions," Information Technology and Libraries, vol. 40, no. 1, pp. 1-16, 2021.
A. G. Persada, “Impact of Gamification on User Experience: An Empirical Review,” dalam 2023 7th International Conference on Electrical, Telecommunication and Computer Engineering (ELTICOM), Medan, Indonesia, 2023.
A. N. Saleem, N. M. Noori and F. Ozdamli, "Gamification Applications in E-learning: A Literature Review," Technology, Knowledge and Learning, vol. 27, p. 139–159, 2022.
J.-c. Cong, P. Zheng, Y. Bian, C.-H. Chen, J. Li and X. Li, "A machine learning-based iterative design approach to automate user satisfaction degree prediction in smart product-service system," Computers & Industrial Engineering, vol. 165, p. 107939, 2022.
C. Siro, M. Aliannejadi and M. D. Rijke, "Understanding and Predicting User Satisfaction with Conversational Recommender Systems," ACM Transactions on Information Systems, vol. 42, no. 2, pp. 1-37, 2023.
H. Jo and D.-H. Park, "Mechanisms for successful management of enterprise resource planning from user information processing and system quality perspective," Scientific Reports, vol. 13, p. 12678, 2023.
How To Cite This :
Refbacks
- There are currently no refbacks.
