Evaluation of DEG7-9 Design Heuristics by Applying Game Experience Questionnaire
Keywords:
Design Heuristics, Digital Educational Game (DEG), Game Experience, Game Experience Questionnaire (GEQ), Human Computer Interaction (HCI)Abstract
This research aimed to validate the effectiveness of the design heuristic procedure called "DEG7-9" in terms of game experience by using the game experience questionnaire called "THGEQ" to evaluate a digital educational game called "Waste Separation," which was designed for children age 7-9 following DEG7-9. Seventy-two students were randomized to play the game. Then, they were asked to indicate their feeling about the DEG by rating 7 statements covering the 7 dimensions of the game experience using the visual analogue scale. After the means for each of the THGEQ statements were computed, the differences in the level of perceptions related to three demographic variables (gender, education level, and age) were compared by the Kolmogorov-Smirnov Test and Mann-Whitney test. It was found that the means for the positive dimensions were moderate to highest, whereas the means for the negative dimensions were low. There were no significant differences in the perceptions of 6 dimensions between the groups of children; only exception was noted in the case of Immersion. THGEQ, which has been translated from KidsGEQ into a set of understandable and concise statements for Thai children, is therefore noted to be appropriate for identifying children’s perceptions of game experience. The game designed by following DEG7-9 could present a quality game experience. Both DEG7-9 and THGEQ heuristics are valuable tools to provide game design teams with an HCI-focused set of design heuristics and GEQ that can be used for designing DEGs and measuring game experience for children age 7-9 years in particular.
References
Robertson, J. and Howells, C., 2008, "Computer Game Design: Opportunities for Successful Learning," Computers and Education, 50 (2), pp. 559-578.
Dörner, R. and Spierling, U., 2014, "Serious Games Development as a Vehicle for Teaching Entertainment Technology and Interdisciplinary Teamwork: Perspectives and Pitfalls," Proceedings of the 2014 ACM International Workshop on Serious Games, Orlando, Florida, USA, pp. 3-8.
Bouzid, T., Darhmaoui, H. and Kaddari, F., 2017, "Promoting Elementary Mathematics Learning through Digital Games: Creation, Implementation and Evaluation of an Edutainment Game to Promote Basic Mathematical Operations," Proceedings of the 2nd International Conference on Big Data, Cloud and Applications, Tetouan, Morocco, pp. 1-4.
Heintz, S. and Law, E.L.C., 2018, "Digital Educational Games: Methodologies for Evaluating the Impact of Game Type," ACM Trans. Comput.-Hum. Interact., 25 (2), pp. 1-47.
Ibrahim, A., 2017, "Playability Heuristics Evaluation for Educational Video Games," International Journal of Core Engineering and Management, 4 (6), pp. 1-12.
Nielsen Norman Group, 1998-2019, UX Design for Children (Ages 3-12), Nielsen Norman Group, USA.
Khanana, K., 2016, Development of Design Heuristics for Digital Educational Games for School Children of 7 to 11 Years Old, Doctoral Dissertation, Department of Computer Science, University of Leicester, UK.
Khanana, K., 2021, "Development of Design Heuristics for Digital Educational Games for Children Aged 7-9," Infomation Technology Journal, 17 (1). (In Thai)
Sungkaew, K., 2018, Development of Design Heuristics for Digital Educational Game for Enabling Children to Learn, Faculty of Science and Technology, Suratthani Rajabhat University. 101 p. (In Thai)
Nielsen, J., 2007, How to Conduct a Heuristic Evaluation [Online], Available: https://www.uio.no/studier/emner/matnat/ifi/INF5261/v07/studentprosjekter/Skattekort/Heuristisk%20evaluering/heuristisk_evaluering.pdf [22 April 2018].
Kim, B., 2015, Understanding Gamification, American Library Association, Chicago, USA.
Hunicke, R., Leblanc, M. and Zubek, R., 2004, "MDA: A Formal Approach to Game Design and Game Research," AAAI Workshop - Technical Report, 1, pp. 1-4.
Bernhaupt, R., 2010, Evaluating User Experience in Games: Concepts and Methods, Springer, London.
Poels, K., Ijsselsteijn, W. and de Kort, Y., 2008, "Development of the Kids Game Experience Questionnaire: A Self Report Instrument to Assess Digital Game Experiences in Children," Proceedings of Meaningful Play 2008, East Lansing, Michigan, USA,
Hunsley, J. and Mash, E.J., 2018, A Guide to Assessments That Work, Oxford University Press, UK.
Kano, A., Horton, M. and Read, J.C., 2010, "Thumbs-up Scale and Frequency of Use Scale for Use in Self Reporting of Children's Computer Experience," Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, Reykjavik, Iceland, pp. 699-702.
Markopoulos, P., Read, J.M., MacFarlane, S. and Hoysniemi, J., 2008, Evaluating Children's Interactive Products: Principles and Practices for Interaction Designers, Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
Sriharee, G., 2018, "Software Engineering Prospective on Digital Game-based Learning for Thailand Education 4.0," The Journal of KMUTNB, 28 (2), pp. 477-488. (In Thai)
Aleem, S., Capretz, L.F. and Ahmed, F., 2016, "Game Development Software Engineering Process Life Cycle: A Systematic Review," Journal of Software Engineering Research and Development, 4 (6).
Lowe, R. and Schnotz, W., 2008, Learning with Animation: Research Implications for Design, Cambridge University Press, UK.
Lewis, J.R., 2006, "Sample Sizes for Usability Tests: Mostly Math, Not Magic," Interactions, 13 (6), pp. 29-33.
Ruengpraprapan, C., 2000, Basic Statistics with Examples Analyzed by MINITAB SPSS and SAS, Khon Kaen University, Khon Kaen. (In Thai)
Elliot, A.J., 2013, Handbook of Approach and Avoidance Motivation, Taylor and Francis, New York.
Elliott, E.S. and Dweck, C.S., 1988, "Goals: An Approach to Motivation and Achievement," Journal of Personality and Social Psychology, 54 (1), pp. 5-12.
Clark, R.C. and Mayer, R.E., 2016, E-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning, Pfeiffer/John Wiley and Sons, San Francisco, CA, US.
Moreno, R. and Mayer, R.E., 2005, "Role of Guidance, Reflection, and Interactivity in an Agent-Based Multimedia Game," Journal of Educational Psychology, 97 (1), pp. 117-128.
Downes, T., 2009, "Blending Play, Practice and Performance: Children’s Use of the Computer at Home," The Journal of Educational Enquiry, 3 (2), pp. 21-34.
Gee, J.P., 2013, Good Video Games and Good Learning: Collected Essays on Video Games, Learning, and Literacy (2nd Ed.), Peter Lang, New York.
Ainsworth, S., 2008, "How Do Animations Influence Learning?," pp. 37-67, in D. Robinson and G. Schraw (Eds.) Current Perspectives on Cognition, Learning, and Instruction: Recent Innovations in Educational Technology that Facilitate Student Learning, Information Age Publishing, North Carolina.
Sweetser, P. and Wyeth, P., 2005, "GameFlow: A Model for Evaluating Player Enjoyment in Games," Computers in Entertainment, 3 (3), pp. 1-24.
Ihamäki, P., 2014, "GameFlow Experience Model: Understanding Player Enjoyment in Pervasive Adventure Geocaching Game," International Journal of Wireless and Mobile Computing, 7 (6), pp. 536-548.
Wang, H. and Sun, C.T., 2011, "Game Reward Systems: Gaming Experiences and Social Meanings," Proceedings of the 2011 DiGRA International Conference: Think Design Play, Hilversum, The Netherlands, pp. 1-12.
Dararuang, A., Lersmethasakul, T. and Gerdsri, N., 2016, "Technology Roadmapping for an Emerging Small Software Business," KMUTT Research and Development Journal, 39 (4), pp. 662-670. (In Thai)
Granic, I., Lobel, A. and Engels, R.C.M.E., 2014, "The Benefits of Playing Video Games," American Psychologist, 69 (1), pp. 66-78.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2020 King Mongkut's University of Technology Thonburi
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Any form of contents contained in an article published in Science and Engineering Connect, including text, equations, formula, tables, figures and other forms of illustrations are copyrights of King Mongkut's University of Technology Thonburi. Reproduction of these contents in any format for commercial purpose requires a prior written consent of the Editor of the Journal.
