Planet Adventures: An Augmented Reality Game using Facial Emotion Recognition

Abstract

Augmented reality is now on the forefront of technological advancements around the world with major consumer electronic companies like Apple, Microsoft, Ninatic, Lucyd, Augmented Reality Labs etc., investing in it to develop an AR interface for its users. In this paper, we proposed an approach in creating a game of using various technologies in sync with augmented reality. The game developed by us can be played by using facial gestures without any complex devices. We also have explored various approaches and methods to implement an AR experience and presented the best suited AR for development of this application. Facebook’s SparkAR studio with integrated AI models are used in this proposed framework to recognise the face gestures based on DeepFace. The proposed AR game overcame the limitations of other AR games by using light weight and efficient technologies like visual scripting and 2D assets and eliminated the use of high-level hardware. A survey on user experience have been done using beta version and found good performance when compared to other similar AR games.