Open Access

ARTICLE

Multi-Modal Data Analysis Based Game Player Experience Modeling Using LSTM-DNN

Sehar Shahzad Farooq¹, Mustansar Fiaz¹, Irfan Mehmood², Ali Kashif Bashir³, Raheel Nawaz⁴, KyungJoong Kim⁵, Soon Ki Jung^1,*
1 School of Computer Science and Engineering, Kyungpook National University, Daegu, Korea
2 Faculty of Engineering & Informatics, School of Media, Design and Technology, University of Bradford, Bradford, BD7 1DP, UK
3 Department of Computing and Mathematics, Manchester Metropolitan University, Manchester, UK
4 Department of Operations, Technology, Events and Hospitality Management, Manchester Metropolitan University, UK
5 Institute of Integrated Technology, Gwangju Institute of Science and Technology, Korea
* Corresponding Author: Soon Ki Jung. Email:
(This article belongs to this Special Issue: Machine Learning for Data Analytics)

Computers, Materials & Continua 2021, 68(3), 4087-4108. https://doi.org/10.32604/cmc.2021.015612

Received 30 November 2020; Accepted 23 March 2021; Issue published 06 May 2021

Abstract

Game player modeling is a paradigm of computational models to exploit players’ behavior and experience using game and player analytics. Player modeling refers to descriptions of players based on frameworks of data derived from the interaction of a player’s behavior within the game as well as the player’s experience with the game. Player behavior focuses on dynamic and static information gathered at the time of gameplay. Player experience concerns the association of the human player during gameplay, which is based on cognitive and affective physiological measurements collected from sensors mounted on the player’s body or in the player’s surroundings. In this paper, player experience modeling is studied based on the board puzzle game “Candy Crush Saga” using cognitive data of players accessed by physiological and peripheral devices. Long Short-Term Memory-based Deep Neural Network (LSTM-DNN) is used to predict players’ effective states in terms of valence, arousal, dominance, and liking by employing the concept of transfer learning. Transfer learning focuses on gaining knowledge while solving one problem and using the same knowledge to solve different but related problems. The homogeneous transfer learning approach has not been implemented in the game domain before, and this novel study opens a new research area for the game industry where the main challenge is predicting the significance of innovative games for entertainment and players’ engagement. Relevant not only from a player’s point of view, it is also a benchmark study for game developers who have been facing problems of “cold start” for innovative games that strengthen the game industrial economy.

---

Keywords

Game player modeling; experience modeling; player analytics; deep learning; LSTM; game play data; Candy Crush Saga

---