CFP last date
21 April 2025
Call for Paper
May Edition
IJCA solicits high quality original research papers for the upcoming May edition of the journal. The last date of research paper submission is 21 April 2025

Submit your paper
Know more
The week's pick
Responsive image
Serverless Architecture for Real-Time Stock Market Data Analytics in Cloud Environments

Gautam Solaimalai
Random Articles
Reseach Article

Serious Game Evaluation System based on Fuzzy AHP

by Kamal Omari, Yassine Chajri, Ayoub Oukhatar
journal cover thumbnail

International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 186 - Number 75
Year of Publication: 2025
Authors: Kamal Omari, Yassine Chajri, Ayoub Oukhatar
10.5120/ijca2025924641

Kamal Omari, Yassine Chajri, Ayoub Oukhatar . Serious Game Evaluation System based on Fuzzy AHP. International Journal of Computer Applications. 186, 75 ( Mar 2025), 32-42. DOI=10.5120/ijca2025924641

@article{ 10.5120/ijca2025924641,
author = { Kamal Omari, Yassine Chajri, Ayoub Oukhatar },
title = { Serious Game Evaluation System based on Fuzzy AHP },
journal = { International Journal of Computer Applications },
issue_date = { Mar 2025 },
volume = { 186 },
number = { 75 },
month = { Mar },
year = { 2025 },
issn = { 0975-8887 },
pages = { 32-42 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume186/number75/serious-game-evaluation-system-based-on-fuzzy-ahp/ },
doi = { 10.5120/ijca2025924641 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2025-03-25T22:41:46.492142+05:30
%A Kamal Omari
%A Yassine Chajri
%A Ayoub Oukhatar
%T Serious Game Evaluation System based on Fuzzy AHP
%J International Journal of Computer Applications
%@ 0975-8887
%V 186
%N 75
%P 32-42
%D 2025
%I Foundation of Computer Science (FCS), NY, USA
Abstract

The rapid advancement of technology has led to a surge in popularity for digital games, prompting training and educational institutions to incorporate them into their curriculums as educational games, commonly referred to as "serious games". These games provide learners with the opportunity to develop knowledge and skills in a fun and interactive manner by virtually recreating learning situations. However, in order to effectively adopt serious games, it is essential to obtain solid evidence of their quality. To address this issue, an evaluation system for serious games is proposed, based on four essential dimensions that a game must satisfy to effectively fulfill its intended purpose. These dimensions have been validated and weighted according to the context of use using the fuzzy AHP method. The system was tested on a serious game called "ROBOCODE," which was validated by an educational commission and used by first-year students at Hassan II University. The results showed the usefulness and relevance of the proposed evaluation system in assessing the adaptability of Serious Games.

References
  1. D. Michael and S. Chen, “Serious Games: Games That Educate, Train, and Inform,” Boston, Mass, Thomson Course Technology PTR, 2006.
  2. M. Papastergiou, “Digital game-based learning in high school Computer Science education: Impact on educational effectiveness and student motivation,” Computers & Education, vol. 52, pp. 1-12, 2009, doi : 10.1016/j.compedu.2008.06.004.
  3. T. M. Connolly, E. A. Boyle, E. MacArthur, T. Hainey and J. M. Boyle, “A systematic literature review of empirical evidence on computer games and serious games,” Computers & Education, vol. 59, pp. 661-686, 2012, doi : 10.1016/j.compedu.2012.03.004.
  4. S. De Freitas and S. Jarvis, “Serious games: a new paradigm for education?,” Serious games, Springer, Dordrecht, pp. 9-23, 2006, doi: 10.1007/978-1-4471-2161-9_2.
  5. Van Eck, R. (2006). Digital game-based learning: It's not just the digital natives who are restless... EDUCAUSE Review, 41(2), 16-30.
  6. Aldrich, C. (2009). Learning by doing: A comprehensive guide to simulations, computer games, and pedagogy in e-learning and education. Jossey-Bass.
  7. Koenig, R., and Roth, D. (2015). The effectiveness of serious games for training and education. Journal of Educational Technology Systems, 43(3), 259-279. https://doi.org/10.1177/0047239515582715
  8. McMahan, A. (2003). Immersion, engagement, and presence: A method for analyzing 3D video games. In Proceedings of the International Conference on Human-Computer Interaction, 3, 459-463.
  9. Deci, E. L., and Ryan, R. M. (2000). The ‘what’ and ‘why’ of goal pursuits: Human needs and the self-determination of behavior. Psychological Inquiry, 11(4), 227-268. https://doi.org/10.1207/S15327965PLI1104_01
  10. Sweetser, P., and Wyeth, P. (2005). GameFlow: A model for evaluating player enjoyment in games. In Proceedings of the 2005 Conference on Future Play, 1-8. https://doi.org/10.1145/1100000.1100002
  11. Gee, J. P. (2003). What video games have to teach us about learning and literacy. Computers in the Schools, 19(3-4), 19-30. https://doi.org/10.1300/J025v19n03_03
  12. Anderson, C. A., and Dill, K. E. (2000). Video games and aggressive thoughts, feelings, and behavior in the laboratory and in life. Journal of Personality and Social Psychology, 78(4), 772-790. https://doi.org/10.1037/0022-3514.78.4.772
  13. Mackey, T. K., and Nayyar, G. (2016). A review of the role of games in public health education. Journal of Health Communication, 21(3), 267-274. https://doi.org/10.1080/10810730.2015.1069771
  14. Susi, T., Johannesson, M., and Backlund, P. (2007). Serious games – An overview. University of Skövde, Sweden.
  15. Rugelj, M., and Novak, M. (2013). Serious games: The impact on learning and skill development. Journal of Educational Multimedia and Hypermedia, 22(1), 5-24.
  16. Schell, J. (2008). The art of game design: A book of lenses. Morgan Kaufmann.
  17. Clark, D. B., and Estes, A. (2008). The influence of video games on learning. International Journal of Gaming and Computer-Mediated Simulations, 1(1), 46-68. https://doi.org/10.4018/jgcms.2008010104
  18. Agarwal, R., and Karahanna, E. (2000). Time flies when you're having fun: Cognitive absorption and beliefs about information technology usage. MIS Quarterly, 24(4), 665-694. https://doi.org/10.2307/3250951
  19. Liu, M., and Chen, M. (2012). The effects of serious games on student learning and engagement. Computers and Education, 58(2), 220-229. https://doi.org/10.1016/j.compedu.2011.08.007
  20. Siang, C., and Lee, W. (2015). Educational games: Data analytics for assessment and improvement. International Journal of Game-Based Learning, 5(3), 51-64. https://doi.org/10.4018/IJGBL.2015070104
  21. Hainey, T., and Connolly, T. M. (2011). Serious games and their educational potential. In Proceedings of the European Conference on Games Based Learning, 243-251.
  22. Nielsen, J. (1994). Heuristic evaluation. In J. Nielsen and R. L. Mack (Eds.), Usability inspection methods (pp. 25-62). John Wiley and Sons.
  23. Togelius, J., and Yannakakis, G. (2013). The art of game design. CRC Press.
  24. Y. El Borji, “Comparative Study to Develop a Tool for the Quality Assessment of Serious Games Intended to be Used in Education,” International Journal of Emerging Technologies in Learning (iJET), vol. 9, pp. 50-55, 2014, doi: 10.3991/ijet.v9i9.4150.
  25. M. Videnovik, A. Madevska Bogdanova and V. Trajkovik, “ SERIOUS GAMES EVALUATION METHODOLOGY”, 2018, doi: 10.21125/iceri.2018.1308.
  26. I. Marfisi-Schottman, “Methodology, Models and Tools for Designing Learning Games”, 2012.
  27. M. R. Lepper and T. W. Malone, “Intrinsic motivation and instructional effectiveness in computer-based education,” Aptitude, learning, and instruction. Hillsdale, NJ : Erlbaum, pp. 255-286, 1987.
  28. E. Sanchez, “Key criteria for Game Design. A Framework”, Rapport du MEET Project, European Commission, 2011.
  29. A. J. Abdellatif, B. McCollum and P. McMullan, “Serious Games: Quality Characteristics Evaluation Framework and Case Study,” in Proc. IEEE Integrated STEM Education Conference (ISEC), 2018, pp. 112-119, doi: 10.1109/ISECon.2018.8340460.
  30. G. Petri, C.Gresse von Wangenheim and Borgatto, “MEEGA+: A Method for the Evaluation of the Quality of Games for Computing Education”, in Brazilian Symposium on Games and Digital Entertainment, 2019, doi: 10.5753/cbie.wcbie.2019.951.
  31. F. Bellotti, B. Kapralos, K. Lee, P. Moreno-Ger and R.Berta, “Assessment in and of Serious Games: An Overview”, Advances in Human-Computer Interaction, 2013, doi: 10.1155/2013/136864.
  32. A. Serrano-Laguna, B. Manero, M. Freire and B. Fernández-Manjón, “A methodology for assessing the effectiveness of serious games and for inferring player learning outcomes,” Multimedia Tools and Applications, vol. 77, 2018, doi: 10.1007/s11042-017-4467-6.
  33. K. Emmerich and M.Bockholt, “Serious Games Evaluation: Processes, Models, and Concepts”, Lecture notes in computer science, 2016, doi: 10.1007/978-3-319-46152-6_11.
  34. Y. Xu, P. M. Johnson, C. A. Moore, R. S. Brewer and J. Takayama, “SGSEAM: Assessing serious game frameworks from a Stakeholder Experience perspective”, in ACM International Conference Proceeding Series, 2013, doi: 10.1145/2583008.2583018.
  35. J. W. Creswell, “Research design: qualitative, quantitative, and mixed methods approaches,” 2nd ed. ed. Sage Publications, Thousand Oaks, California, 2003.
  36. A. Ghannem, “Characterization of serious games guided by the educational objectives”, in TEEM '14: Proceedings of the Second International Conference on Technological Ecosystems for Enhancing Multiculturality, 2014, pp.227–233, doi: 10.1145/2669711.2669904.
  37. I. Mayer, G. Bekebrede, C. Harteveld, H. Warmelink, Q. Zhou, T. van Ruijven, J. Lo, R. Kortmann and I. Wenzler, “The research and evaluation of serious games: Toward a comprehensive methodology,”.British Journal of Educational Technology. Vol. 45, pp. 502-507, 2014, doi: 10.1111/bjet.12067.
  38. D. W. Wilson et al., “Serious games: an evaluation framework and case study,” System Sciences (HICSS), 49th Hawaii International Conference, 2016, pp. 638-647, doi: 10.1109/HICSS.2016.85.
  39. I. Mayer, “Towards a comprehensive methodology for the research and evaluation of serious games,” Procedia Comput. Sci. vol. 15, pp. 233–247, 2012, doi: 10.1016/j.procs.2012.10.075.
  40. G. Petri, “A METHOD FOR THE EVALUATION OF THE QUALITY OF GAMES FOR COMPUTING EDUCATION”, 2018.
  41. P. Sweetser and P. Wyeth, “ GameFlow: a model for evaluating player enjoyment in games,” Computers in Entertainment, vol. 3, pp. 1-24, 2005, doi: 10.1145/1077246.1077253.
  42. J. Takatalo, J. Häkkinen, J. Kaistinen, G. Nyman, “Presence, Involvement, and Flow in Digital Games,” In Bernhaupt, R. (Ed.). Evaluating User Experience in Games: Concepts and Methods, pp. 23-46, Springer, 2010, doi: 10.1007/978-1-84882-963-3_3.
  43. S. D. Freitas and M. Oliver, “How can exploratory learning with games and simulations within the curriculum be most effectively evaluated?,” Computers & Education, vol. 46, pp. 249-264, 2006, doi:10.1016/j.compedu.2005.11.007.
  44. A. Baker, J. Zhang and R. E. Caldwell, “Reinforcing Array and Loop Concepts Through a Game-Like Module,” The 17th International Conference on Computer Games, 2012, pp. 175-179.
  45. G. C. Wangenheim, R. Savi and F. A. Borgatto, “DELIVER! – An educational game for teaching Earned Value Management in computing courses,” Information and Software Technology, vol. 54, pp. 286-298, 2011, doi: 10.1016/j.infsof.2011.10.005.
  46. P. Wouters, E. van der Spek and H. van Oostendorp, “Current practices in serious game research: A review from a learning outcomes perspective,” Games-based learning advancements for multisensory human computer interfaces: Techniques and effective practices, pp. 232-255, 2009, doi: 10.4018/978-1-60566-360-9.ch014.
  47. K. Amokrane and D. Lourdeaux, “Virtual Reality Contribution to training and risk prevention,” the proceeding of the International Conference on Artificial Intelligence, 2009, pp. 466 472, http://hal.archives-ouvertes.fr/hal-00462120.
  48. J. P. Astolfi, “L’erreur, un outil pour enseigner,” ESF, 1997.
  49. N. El-Kechaï and C. Després, “A plan recognition process, based on a task model, for detecting learner’s erroneous actions,” Lecture Notes in Computer Science, vol. 4053, pp. 329 338, 2006, doi:10.1007/11774303_33.
  50. J. Zhang, R. E. Caldwell and E. Smith, “Learning the Concept of Java Inheritance in a Game,” The 18th International Conference on Computer Games (CGAMES), 2013, pp. 212-216, doi:10.1109/CGames.2013.6632635.
  51. B. Manero, C. Fernandez-Vara and B. Fernandez-Manjon, “E-Learning Takes the Stage: From La Dama Boba to a Serious Game,” IEEE Revista Iberoamericana de Tecnologias del Aprendizaje, Vol. 8, pp. 179-204, 2013, doi :10.1109/RITA.2013.2285023.
  52. S. Lanyi, J. Brown, P. Standen, et al., “Results of user interface evaluation of serious games for students with intellectual disability,” Acta Polytechnica Hungarica, Vol. 9, pp. 225-245, 2012.
  53. Z. Mikovec, P. Salvik and J. Zara, “Cultural Heritage, User Interfaces and Serious Games at CTU Prague,”15th International Conference on Virtual Systems and Multimedia, 2009, pp. 211-116.
  54. ISO/IEC 9126:1998 Ergonomic requirements for office work with visual display terminals - Part 11: Guidance on usability, 1998.
  55. J. Nielsen, “Usability Engineering,” Morgan Kaufmann Publishers Inc, San Francisco, CA, USA, 1993.
  56. M. Muratet, P. Torguet, F. Viallet, et al., “Experimental feedback on Prog&Play: a serious game for programming practice,” Computer Graphics Forum, vol. 30, pp. 61-73, 2011.
  57. D. Rodríguez-Cerezo, A. Sarasa-Cabezuelo, M. Gomez-Albarran and J. Sierra, “Serious games in tertiary education: a case study concerning the comprehension of basic concepts in computer language implementation courses,” Computers in Human Behavior, vol. 31, pp. 558-570, 2014, doi: 10.1016/j.chb.2013.06.009.
  58. B. L. Fredrickson, “The role of positive emotions in positive psychology: The broaden-and-build theory of positive emotions,” American psychologist, vol. 56, pp. 218-226, 2001, doi: 10.1037/0003-066X.56.3.218.
  59. K. Poels, Y. D. Kort, W. Ijsselsteijn, “It is always a lot of fun!: exploring imensions of digital game experience using focus group methodology,” Proc. of Conf. on Future Play, Toronto, Canada, 2007, pp. 83-89.
  60. C. V. Carvalho, “Is game-based learning suitable for engineering education?,” Proc. of the Global Engineering Education Conf., IEEE, 2012, pp.1-8, doi: 10.1109/EDUCON.2012.6201140.
  61. F. Fu, R. Su and S. Yu, “EGameFlow: A scale to measure learners' enjoyment of elearning games”, Computers & Education, vol. 52, pp. 101-112, 2009, doi: 10.1016/j.compedu.2008.07.004.
  62. M. Wrzesien and M. Alcaniz, “Learning in serious virtual worlds: evaluation of learning effectiveness and appeal to students in the E-Junior project,” Computers & Education, vol. 55, pp. 178–187, 2010, doi: 10.1016/j.compedu.2010.01.003.
  63. C. Girard, J. Ecalle and A. Magnant, “Serious games as new educational tools: how effective are they? A meta-analysis of recent studies,” Journal of Computer Assisted Learning, vol. 29, 2013, doi: 10.1111/j.1365-2729.2012.00489.x.
  64. O. Dele-Ajayi, R. Strachan, J. Sanderson and A. Pickard, “Learning Mathematics Through Serious Games: An engagement framework,” Frontiers in Education Conference (FIE), 2016, doi: 10.1109/FIE.2016.7757401.
  65. L. E. Law and X. Sun, “Evaluating user experience of adaptive digital educational games with Activity Theory,” International Journal of Human-Computer Studies, vol. 70, pp. 478-497, 2012, doi:10.1016/j.ijhcs.2012.01.007.
  66. E. Zavadskas, Z. Turskis and S. Kildiene, “State of art surveys of overviews on MCDM/MADM methods,” Technological and Economic Development of Economy, vol. 20, pp. 165-179, 2014, doi: 10.3846/20294913.2014.892037.
  67. A. Zadeh, “Fuzzy sets,” Information and Control, Vol. 8, pp. 338-353, 1965, doi: 10.1016/S0019-9958(65)90241-X.
  68. A. Lazim, “Fuzzy Multi Criteria Decision Making and its Applications: A Brief Review of Category”, Procedia - Social and Behavioral Sciences, 2013, vol. 97, pp. 131-136, doi: 97. 10.1016/j.sbspro.2013.10.213.
  69. J. J. Buckley, “Fuzzy hierarchical analysis,” Fuzzy Sets and Systems, vol. 17, pp. 233-247, 1985, doi:10.1016/0165-0114(85)90090-9.
  70. T. L. Saaty, “Decision Making for Leaders: The Analytic Hierarchy Process for Decisions in a Complex World”, RWS Publications, Pittsburgh, 1995.
  71. R. Likert, “A technique for the measurement of attitudes,” Archives of psychology, vol. 140, pp. 5–55, 1932.
  72. S. Y. Chyung, K. Roberts, I. Swanson and A. Hankinson, “Evidence-Based Survey Design: The Use of a Midpoint on the Likert Scale,” Performance Improvement. vol. 56, pp. 15-23, 2017, doi: 10.1002/pfi.21727.
  73. Z. Awang, A. Afthanorhan and M. Mamat, “The Likert scale analysis using parametric based Structural Equation Modeling (SEM),” Computational Methods in Social Sciences (CMSS). "Nicolae Titulescu" University of Bucharest, Faculty of Economic Sciences, vol. 4, pp. 13-21, 2016.
  74. E. G. Carmines and R. A. Zeller, “Reliability and Validity Assessment”, vol. 17, Thousand Oaks, CA, SAGE Publications, 1979, doi: 10.4135/9781412985642.
  75. R. F. DeVellis, “Scale development: theory and applications”, vol. 26, 2nd ed. Thousand Oaks, CA, SAGE Publications, 2003.
Index Terms

Computer Science
Information Sciences
Serious Game

Keywords

Serious Game- Evaluation system- Fuzzy AHP

Powered by PhDFocusTM