BSc Thesis – Control of Virtual Objects by the User in Virtual Environments

Control of Virtual Objects by the User in Virtual Environments

Project Overview

Designed and developed a touchless 3D camera interaction system that enables hands-free spatial navigation within a virtual environment without traditional input devices like a keyboard or mouse. Utilizing an Intel 3D depth camera, the application tracks real-time facial characteristics and converts them into precise head pose telemetry. To provide intuitive visual feedback, the system maps head rotation to camera orientation inside a 3D environment containing dynamic geometric landmarks, such as cuboids, pyramids, and platforms, allowing users to seamlessly survey the virtual space simply by turning their head.

Purpose

The primary objective of this project was to establish an alternative, hands-free human-computer interaction (HCI) method to assist individuals with physical upper-limb disabilities or motor impairments in executing daily computing tasks. Beyond accessibility, the project provides a foundational framework for further research across healthcare, military control systems, and service robotics. Full technical documentation and architectural details are available in the Bachelor’s Thesis (currently available in Greek).

Key Features & Capabilities
  • Real-time head pose tracking using facial landmark detection via an Intel 3D depth camera
  • Touchless 3D camera navigation mapping physical head rotation to virtual viewport orientation
  • Hands-free human-computer interaction (HCI) designed for assistive tech and motor accessibility
  • Interactive 3D virtual environment with spatial geometric landmarks for motion feedback
  • Hands-free pilot cabin target tracking and threat observation training
  • Facial analysis capabilities adaptable for emotional/mood monitoring and non-verbal detection
  • Remote teleoperation control allowing operators to direct robot head orientation in hazardous environments
  • Alternative hands-free camera control mechanisms for immersive gaming interfaces

Development

System Windows 10 Pro, Intel i7, Nvidia GTX860m, 8GB RAM
IDE & Tools Visual Studio 2013, Qt Creator
Programming language C++
Computer Graphics & UI OpenGL, GLSL 4.3, Qt
Visual Modeling Software Visual Paradigm
Libraries Intel RealSense SDK
3D Camera Intel RealSense Camera F200
Repository

Screenshots & Images