Introduction

  Modern technologies have significantly changed the possibilities to interact with a computer, without using any keyboard or mouse. For example, a user can interact with a computer by wearning a special headset which gets leveraged in virtual reality (VR) applications. However, this work doesn’t deal with the VR technology, but instead utilizes a 3D camera from Intel which captures facial characteristics of a person and translates them into head poses. To provide a better feel for the movements, a virtual environment gets created including various objects such as a cuboid, a pyramid and a platform. For example, by turning the head to the right, the user looks to the pyramid or by turning to the left the user looks at the cuboid.

 

Purpose

  The purpose of this work is to provide another method to people who are disabled by their hands or have problems to use them to achieve their daily work. In addition, this method provides an idea fur further research in healthcare and other fields like military, robotics etc. Bellow are some examples listed, where this technique could be used as well. Some of them are listed bellow. Detailed information on how the application works can be found in my bachelor thesis. Unfortunately, this is only available in the Greek language (maybe I will translate it into English in the future).

• Training pilots in the cabin on how to observe an enemy.
• Apply lie detection based on facial chatacteristics.
• Facial analysis to observe the mood of a person.
• In the modern computer game industry.
• A robot’s head can be controlled by a user to look around in a dangerous environment.

 

Development

Development system	Windows 10 Professional 64 bit, Intel i7, Nvidia GTX860m, 8GB RAM, 128GB SSD, 1TB HDD
Development tools	Visual Studio 2013, Qt Creator
Programming languages	C++, GLSL 4.3
Libraries	Intel RealSense SDK, OpenGL, Qt
Repository

 

Images