Evaluating Perceived Usability and Gamification Perception in a Lean UX Hotel Booking Prototype

Putri Taqwa Prasetyaningrum; Norshahila Ibrahim

doi:10.63158/journalisi.v8i5.1843

Authors

Putri Taqwa Prasetyaningrum Mercu Buana University of Yogyakarta
Norshahila Ibrahim Sultan Idris Education University

DOI:

https://doi.org/10.63158/journalisi.v8i5.1843

Keywords:

Gamification Perception Questionnaire, Hospitality Technology, Lean UX, Prototype Evaluation, Remote Usability Testing, System Usability Scale

Abstract

This single-group prototype evaluation examines the association between two self-reported post-use perceptions: perceived usability and gamification perception in an early-stage hotel-booking prototype. It does not test whether gamification improves booking performance.  A high-fidelity prototype was developed through two Lean User Experience iterations. After the formative first iteration, 150 adults with prior hotel-booking-app experience completed the same ordered scenario remotely through Maze and then answered the System Usability Scale (SUS) and a study-specific ten-item Gamification Perception Questionnaire (GPQ). Objective task-success, completion-time, error, misclick, and abandonment metrics were not retained for analysis. Mean SUS was 89.85 (SD = 11.37; 95% CI [88.02, 91.68]) and the GPQ descriptive mean was 4.67/5 (SD = 0.38; 95% CI [4.61, 4.73]). The two self-reported measures were positively associated (r = 0.66, 95% CI [0.56, 0.74], p < 0.001). Exploratory gender and age contrasts yielded small effects. The high SUS score represents perceived usability in this sample and does not establish task success or behavioral effectiveness.  The contribution is empirical and design-oriented: it documents a Lean UX prototype evaluation in a transactional hospitality context. Interpretation is limited by the single-group design, possible novelty and ceiling effects, self-selection, remote testing, common-method bias, and the status of the GPQ as a study-specific descriptive index that still requires full psychometric validation.

Downloads

Download data is not yet available.

References

[1] D. Zhang, P. Wu, and C. Wu, “The role of key online reviews in affecting online hotel booking: An empirical investigation,” Ind. Manag. Data Syst., vol. 122, no. 2, pp. 499–520, 2022, doi: 10.1108/IMDS-06-2021-0355.

[2] P. T. Prasetyaningrum, R. Suryani, and M. Vicky, “Implementation of a web-based photography service booking system to enhance micro-business services,” J. Sustain. Communities Dev., vol. 3, no. 1, 2025, doi: 10.15151/SCD.v3i1.24.

[3] ISO 9241-11:2018, Ergonomics of Human-System Interaction—Part 11: Usability: Definitions and Concepts. Geneva, Switzerland: International Organization for Standardization, 2018.

[4] J. Brooke, “SUS: A quick and dirty usability scale,” in Usability Evaluation in Industry, P. W. Jordan, B. Thomas, B. A. Weerdmeester, and I. L. McClelland, Eds. London, U.K.: Taylor & Francis, 1996, pp. 189–194.

[5] J. R. Lewis, “The System Usability Scale: Past, present, and future,” Int. J. Hum.-Comput. Interact., vol. 34, no. 7, pp. 577–590, 2018, doi: 10.1080/10447318.2018.1455307.

[6] A. Bangor, P. T. Kortum, and J. T. Miller, “An empirical evaluation of the System Usability Scale,” Int. J. Hum.-Comput. Interact., vol. 24, no. 6, pp. 574–594, 2008, doi: 10.1080/10447310802205776.

[7] J. Hamari, “Do badges increase user activity? A field experiment on the effects of gamification,” Comput. Hum. Behav., vol. 71, pp. 469–478, 2017, doi: 10.1016/j.chb.2015.03.036.

[8] J. Krath, L. Schürmann, and H. F. O. von Korflesch, “Revealing the theoretical basis of gamification: A systematic review and analysis of theory in research on gamification, serious games and game-based learning,” Comput. Hum. Behav., vol. 125, Art. no. 106963, 2021, doi: 10.1016/j.chb.2021.106963.

[9] S. Trang and W. H. Weiger, “The perils of gamification: Does engaging with gamified services increase users’ willingness to disclose personal information?” Comput. Hum. Behav., vol. 116, Art. no. 106644, 2021, doi: 10.1016/j.chb.2020.106644.

[10] N. J. Thomas and R. Baral, “Mechanism of gamification: Role of flow in the behavioral and emotional pathways of engagement in management education,” Int. J. Manag. Educ., vol. 21, no. 1, Art. no. 100718, 2023, doi: 10.1016/j.ijme.2022.100718.

[11] M. Aparicio, C. J. Costa, and R. Moises, “Gamification and reputation: Key determinants of e-commerce usage and repurchase intention,” Heliyon, vol. 7, no. 3, Art. no. e06383, 2021, doi: 10.1016/j.heliyon.2021.e06383.

[12] P. T. Prasetyaningrum, P. Purwanto, and A. F. Rochim, “Enhancing user engagement in mobile banking through personalized gamification: A Cognitive Evaluation Theory approach,” Int. J. Intell. Eng. Syst., vol. 17, no. 4, pp. 788–807, 2024, doi: 10.22266/IJIES2024.0831.60.

[13] P. T. Prasetyaningrum, P. Purwanto, and A. F. Rochim, “Gamification on mobile banking application: A literature review,” in Proc. 1st Int. Conf. Inf. Syst. Inf. Technol. (ICISIT), 2022, pp. 222–227, doi: 10.1109/ICISIT54091.2022.9873034.

[14] P. T. Prasetyaningrum, P. Purwanto, and A. F. Rochim, “Analyzing customer engagement with gamification approach in the banking sector using the Rasch model,” Ingénierie Syst. Inf., vol. 29, no. 3, pp. 1051–1064, 2024, doi: 10.18280/isi.290323.

[15] E. L. Deci and R. M. Ryan, “Cognitive Evaluation Theory,” in Intrinsic Motivation and Self-Determination in Human Behavior. Boston, MA, USA: Springer, 1985, pp. 43–85, doi: 10.1007/978-1-4899-2271-7_3.

[16] C. P. Niemiec and R. M. Ryan, “Autonomy, competence, and relatedness in the classroom: Applying self-determination theory to educational practice,” Theory Res. Educ., vol. 7, no. 2, pp. 133–144, 2009, doi: 10.1177/1477878509104318.

[17] R. M. Ryan and E. L. Deci, Self-Determination Theory: Basic Psychological Needs in Motivation, Development, and Wellness. New York, NY, USA: Guilford Press, 2017.

[18] E. L. Deci and R. M. Ryan, “The ‘what’ and ‘why’ of goal pursuits: Human needs and the self-determination of behavior,” Psychol. Inq., vol. 11, no. 4, pp. 227–268, 2000, doi: 10.1207/S15327965PLI1104_01.

[19] Y.-K. Chou, Actionable Gamification: Beyond Points, Badges, and Leaderboards. Milpitas, CA, USA: Octalysis Media, 2015.

[20] J. Gothelf, Lean UX: Applying Lean Principles to Improve User Experience. Sebastopol, CA, USA: O’Reilly Media, 2013.

[21] J. Gothelf and J. Seiden, Lean UX: Designing Great Products with Agile Teams, 3rd ed. Sebastopol, CA, USA: O’Reilly Media, 2021.

[22] M. M. Alhammad and A. M. Moreno, “Integrating user experience into Agile: An experience report on Lean UX and Scrum,” in Proc. ACM/IEEE 44th Int. Conf. Softw. Eng.: Softw. Eng. Educ. Training, 2022, pp. 146–157, doi: 10.1145/3510456.3514156.

[23] M. Isomursu, A. Sirotkin, P. Voltti, and M. Halonen, “User experience design goes Agile in Lean transformation—A case study,” in Proc. Agile Conf., 2012, pp. 1–10, doi: 10.1109/Agile.2012.10.

[24] F. H. Lermen, P. K. de Moura, V. B. Bertoni, P. Graciano, and G. L. Tortorella, “Does maturity level influence the use of Agile UX methods by digital startups? Evaluating design thinking, lean startup, and lean user experience,” Inf. Softw. Technol., vol. 154, Art. no. 107107, 2023, doi: 10.1016/j.infsof.2022.107107.

[25] M. C. Ramos-Vega, V. M. Palma-Morales, D. Pérez-Marín, and J. M. Moguerza, “Stimulating children’s engagement with an educational serious videogame using Lean UX co-design,” Entertain. Comput., vol. 38, Art. no. 100405, 2021, doi: 10.1016/j.entcom.2021.100405.

[26] M. G. Pasca, M. F. Renzi, L. Di Pietro, and R. Guglielmetti Mugion, “Gamification in tourism and hospitality research in the era of digital platforms: A systematic literature review,” J. Serv. Theory Pract., vol. 31, no. 5, pp. 691–737, 2021, doi: 10.1108/JSTP-05-2020-0094.

[27] D. Parapanos and E. Michopoulou, “Innovative mobile technology in hotels and the use of gamification,” Tour. Plan. Develop., vol. 20, no. 2, pp. 162–187, 2023, doi: 10.1080/21568316.2022.2107563.

[28] F. Xu, F. Tian, D. Buhalis, J. Weber, and H. Zhang, “Tourists as mobile gamers: Gamification for tourism marketing,” J. Travel Tour. Mark., vol. 33, no. 8, pp. 1124–1142, 2016, doi: 10.1080/10548408.2015.1093999.

[29] F. Xu, D. Buhalis, and J. Weber, “Serious games and the gamification of tourism,” Tour. Manag., vol. 60, pp. 244–256, 2017, doi: 10.1016/j.tourman.2016.11.020.

[30] M. Abou-Shouk and M. Soliman, “The impact of gamification adoption intention on brand awareness and loyalty in tourism: The mediating effect of customer engagement,” J. Destin. Mark. Manag., vol. 20, Art. no. 100559, 2021, doi: 10.1016/j.jdmm.2021.100559.

[31] A. L. Negrusa, V. Toader, A. Sofica, M. F. Tutunea, and R. V. Rus, “Exploring gamification techniques and applications for sustainable tourism,” Sustainability, vol. 7, no. 8, pp. 11160–11189, 2015, doi: 10.3390/su70811160.

[32] T. Wolf, W. H. Weiger, and M. Hammerschmidt, “Experiences that matter? The motivational experiences and business outcomes of gamified services,” J. Bus. Res., vol. 106, pp. 353–364, 2020, doi: 10.1016/j.jbusres.2018.12.058.

[33] P. T. Prasetyaningrum, N. Ibrahim, R. Yuniasanti, P. W. Setyaningsih, and I. R. Subagyo, “Designing gamified systems for mental health support: An exploratory study,” J. Inf. Syst. Inform., vol. 6, no. 2, pp. 1086–1102, 2024, doi: 10.51519/journalisi.v6i2.760.

[34] P. M. Podsakoff, S. B. MacKenzie, J.-Y. Lee, and N. P. Podsakoff, “Common method biases in behavioral research: A critical review of the literature and recommended remedies,” J. Appl. Psychol., vol. 88, no. 5, pp. 879–903, 2003, doi: 10.1037/0021-9010.88.5.879.

[35] World Wide Web Consortium, “Web Content Accessibility Guidelines (WCAG) 2.2,” W3C Recommendation, Oct. 2023. [Online]. Available: https://www.w3.org/TR/WCAG22/. Accessed: Aug. 18, 2026.