Yanran Chen
Back to Projects
Interactive

VR Digital Factory Experience

Immersive VR system combining real-time interaction, AI-driven characters, and spatial exploration.

vrunreal-enginemetahumanai-interactiondigital-factoryui
Immersive VR system for industrial environment exploration

This project explores how immersive virtual reality can enhance interaction with industrial environments. A VR system was developed in Unreal Engine integrating AI-driven characters, interactive UI systems, and spatial navigation. The project focuses on improving user experience, interaction intuitiveness, and accessibility in complex 3D environments.

  • Develop an immersive VR environment for interactive exploration.
  • Integrate AI-driven interaction using MetaHuman and conversational systems.
  • Design intuitive UI/UX for VR interaction and navigation.
  • Developed the VR environment and interaction system in Unreal Engine.
  • Integrated MetaHuman and AI interaction using Convai plugin.
  • Designed VR UI systems including hand-attached interfaces and virtual keyboard.
  • Implemented interactive elements and environment transitions.
  • Built VR environment and optimized it for real-time interaction.
  • Integrated MetaHuman character as an interactive agent in the scene.
  • Developed AI communication pipeline using Convai for voice and text interaction.
  • Designed and implemented virtual keyboard and display system.
  • Implemented physical interaction systems such as switches and doors.
  • Created layout transition system for multi-scene navigation.
  • Developed hand-based UI for improved accessibility.
  • Added controller guidance system to improve user onboarding.
  • Delivered a fully interactive VR prototype with AI-driven interaction.
  • Improved usability through intuitive UI and interaction systems.
  • Enabled immersive exploration and interaction within a virtual environment.
  • Established a foundation for future intelligent VR applications.
  • Unreal Engine (VR)
  • MetaHuman Framework
  • Convai Plugin (AI interaction)
  • Motion Controllers
  • Hand UI System
  • Blueprint system

Year

2024-2025

Group

Interactive

Role

VR Developer / Interaction Designer

Duration

4 months

Team

Research team at WZL

Deliverable

Interactive VR prototype

Tools

Unreal Engine, Blender, MetaHuman, Convai, VR Controllers

Tags

vrunreal-enginemetahumanai-interactiondigital-factoryui
Story Band
Controller and joystick guidance inside the VR walkthrough

Controller Guidance

Built-in controller guidance helps users understand movement and interaction quickly, making the VR experience approachable from the first moment of entry.

Menu interface inside the VR production walkthrough

Immersive Menu Layer

The menu system keeps core functions legible inside the headset, giving users a clear interface for navigation, content access, and task flow without breaking immersion.

Modeled corner of the real factory environment in VR

Spatial Factory Context

A modeled corner of the real factory environment gives the walkthrough spatial credibility, translating industrial context into an immersive scene that feels grounded and reviewable.

Media, interface, and process detail

VR Digital Factory Experience: Users can direct an AGV toward a target position inside the virtual factory, extending the experience from passive viewing into task-oriented control.
Users can direct an AGV toward a target position inside the virtual factory, extending the experience from passive viewing into task-oriented control.
VR Digital Factory Experience: Video, image, and resource panels can be opened directly inside the VR experience, keeping supporting material embedded within the immersive workflow.
Video, image, and resource panels can be opened directly inside the VR experience, keeping supporting material embedded within the immersive workflow.
Back to Projects
Prev / Factory Layout Simulator
Next / Welding Robot Twin