Measuring Usability on Mobile Education Game: the UMUX
DOI:
https://doi.org/10.52731/liir.v005.215Keywords:
usability, UMUX, mobile game educationAbstract
Layout inconsistencies within the system, redundant functionality, or the absence of a help button. All of these are instances of elements that make mobile gaming education quite frustrating. The purpose of this study is to assess the level of usefulness and value that may be found in mobile game education. The use of UMUX as a measuring instrument is a new addition to the usual collection of usability questionnaires, to test the perceived usability of a product or service by employing a smaller number of items that are more closely aligned with the definition of usability. In our study, we used method UMUX for online questionnaire. Respondents on this study is 50 people. The usability testing is done on a total of eight different instructional mobile game layouts. Result showed that layout with the highest value and grade is number 8 (85/A+), which displays the page for the “Tes Hafalan”. The layout with the lowest value and grade is number 5 (77/B+), which presents a page view of the Tajweed Law. Based on the CGS Table, mobile game education that was researched obtained an average score of 80.5, which corresponds to a grade of A-. These findings indicate a positive user experience, which is relevant to usability. On the other hand, UMUX is capable of interpreting a system in a way that is usable, albeit subject to a number of restrictions.
References
H. Pan, C. Guo, J. Yu, and Y. Chen, “Research on Design and Development of Mobile Serious Game under Mobile Learning Environment,” presented at the 3rd Workshop on Advanced Research and Technology in Industry (WARTIA 2017), Atlantis Press, Nov. 2017, pp. 66–70. doi: 10.2991/wartia-17.2017.13.
R. Fauzan, D. Siahaan, S. Rochimah, and E. Triandini, “Use Case Diagram Similarity Measurement: A New Approach,” in 2019 12th International Conference on Information & Communication Technology and System (ICTS), Jul. 2019, pp. 3–7. doi: 10.1109/ICTS.2019.8850978.
J. Dalle, A. Yusuf, A. Rizani, A. Yusuf, and C. Phandurand, “A Prototype For Parents To Monitor The Children’s Use Of Gadgets Applying Systems Development Life Cycle-Prototype: A Case Of Indonesia,” International Journal of eBusiness and eGovernment Studies, vol. 14, no. 4, Art. no. 4, Dec. 2022.
D. Geszten, B. P. Hámornik, and K. Hercegfi, “Exploring awareness related usability problems of collaborative software with a team usability testing approach,” in 2018 9th IEEE International Conference on Cognitive Infocommunications (CogInfoCom), Aug. 2018, pp. 000045–000050. doi: 10.1109/CogInfoCom.2018.8639865.
J. Sauro and J. R. Lewis, “Chapter 8 - Standardized usability questionnaires,” in Quantifying the User Experience (Second Edition), J. Sauro and J. R. Lewis, Eds., Boston: Morgan Kaufmann, 2016, pp. 185–248. doi: 10.1016/B978-0-12-802308-2.00008-4.
J. R. Lewis, “Measuring Perceived Usability: The CSUQ, SUS, and UMUX,” International Journal of Human–Computer Interaction, vol. 34, no. 12, pp. 1148–1156, Dec. 2018, doi: 10.1080/10447318.2017.1418805.
A. Kaya, R. Ozturk, and C. Altin Gumussoy, “Usability Measurement of Mobile Applications with System Usability Scale (SUS),” in Industrial Engineering in the Big Data Era, F. Calisir, E. Cevikcan, and H. Camgoz Akdag, Eds., in Lecture Notes in Management and Industrial Engineering. Cham: Springer International Publishing, 2019, pp. 389–400. doi: 10.1007/978-3-030-03317-0_32.
P. P. Adinda and A. Suzianti, “Redesign of user interface for e-government application using usability testing method,” in Proceedings of the 4th International Conference on Communication and Information Processing, in ICCIP ’18. New York, NY, USA: Association for Computing Machinery, Nov. 2018, pp. 145–149. doi: 10.1145/3290420.3290433.
A. K. Darmawan, Moh. A. Hamzah, B. Bakir, M. Walid, A. Anwari, and I. Santosa, “Exploring Usability Dimension of Smart Regency Service with Indonesian Adaptation of The System Usability Scale (SUS) and User Experience Questionnaire (UEQ),” in 2021 International Conference on Computer Science, Information Technology, and Electrical Engineering (ICOMITEE), Oct. 2021, pp. 74–79. doi: 10.1109/ICOMITEE53461.2021.9650086.
J. N. Siebert et al., “Usability Testing and Technology Acceptance of an mHealth App at the Point of Care During Simulated Pediatric In- and Out-of-Hospital Cardiopulmonary Resuscitations: Study Nested Within 2 Multicenter Randomized Controlled Trials,” JMIR Human Factors, vol. 9, no. 1, p. e35399, Mar. 2022, doi: 10.2196/35399.
M. Schrepp, J. Kollmorgen, and J. Thomaschewski, “A Comparison of SUS, UMUX-LITE, and UEQ-S,” 2023, p. Vol. 18, Issue 2, February 2023 pp. 86-104.
R. Bringula, “Do Usability Design Features of a Mobile Game Influence Learning?,” 2017.
S. Borsci, S. Federici, S. Bacci, M. Gnaldi, and F. Bartolucci, “Assessing User Satisfaction in the Era of User Experience: Comparison of the SUS, UMUX and UMUX - LITE as a Function of Product Experience,” International Journal of Human-Computer Interaction, vol. 31, pp. 484–495, Jun. 2015.
D. G. Palyama and G. Tomasila, “An Important Aspect of Satisfaction on Mobile Apps: An Usability Evaluation Based on Gender,” JINAV: Journal of Information and Visualization, vol. 3, no. 1, pp. 93–98, Jul. 2022, doi: 10.35877/454RI.jinav1568.
N. A. N. Ahmad and M. Hussaini, “A Usability Testing of a Higher Education Mobile Application Among Postgraduate and Undergraduate Students,” International Journal of Interactive Mobile Technologies (iJIM), vol. 15, no. 09, Art. no. 09, May 2021, doi: 10.3991/ijim.v15i09.19943.
J. Lewis and J. Sauro, “Can I Leave This One Out? The Effect of Dropping an Item From the SUS,” Journal of Usability Studies, vol. 13, pp. 38–46, Nov. 2017.
M. Mol et al., “Dimensionality of the system usability scale among professionals using internet-based interventions for depression: a confirmatory factor analysis,” BMC Psychiatry, vol. 20, p. 218, May 2020, doi: 10.1186/s12888-020-02627-8.
M. Berkman and D. Karahoca, “Re-Assessing the Usability Metric for User Experience (UMUX) Scale,” Journal of Usability Studies, vol. 11, pp. 89–109, May 2016.
