Back to Work

Human-in-the-loop: control of a human-scale interactive platform for immersion in a virtual environment

EPFL thesis project

Bringing physical movement into virtual reality.

Human-in-the-loop explores how a person can interact with a virtual world through their own body, combining a ski simulation with a responsive robotic platform.

The idea

VR becomes more immersive when the body is part of the interface.

Instead of experiencing a virtual slope only through sight and sound, the user can lean, shift their weight and feel the platform respond. The result is a closer connection between what happens in the virtual world and what the body feels in the real one.

Enter the virtual world

The user explores a ski environment designed in Unreal Engine 5.

Move naturally

The platform reads the user’s force and movement instead of relying only on a joystick.

Feel the experience

The physical platform reacts to the virtual terrain, making the experience more tangible.

The loop

Every movement connects the virtual and physical worlds.

The user, the virtual scene and the robotic platform continuously inform one another. That exchange is what turns a visual simulation into a physical experience.

Diagram showing the connection between the user, robot, virtual avatar and virtual scene
Visual showing how force and kinetic feedback deepen immersion

Beyond the screen

Physical feedback adds another layer of presence.

Sight and sound create a convincing world. Movement and force make that world feel closer, giving the user a more direct connection with the experience.

Looking ahead

A framework that can move beyond a single experience.

The same approach can support new kinds of physical interaction, from training and sport education to rehabilitation, entertainment and teleoperated systems. The virtual world can change, while the connection between the user and the platform remains.

A larger immersive room showing another possible application of a physical-virtual experience

Built with

A bridge between software and the physical world.

Unreal Engine 5Wi-Fi / UDPLoad cellsRobotic platform