How to Become a AI AR/VR AI Engineer

Build a VR escape room in Unity where an LLM-driven game master gives dynamic hints based on player progress. Integrates speech recognition, a cloud LLM API, and text-to-speech with avatar lip sync.

Train a hand-gesture classification model using MediaPipe landmarks, export to ONNX, and deploy inside a Unity XR app. Users trigger AR UI actions with custom gestures at interactive frame rates.

Build an AR app (ARCore/ARKit) that performs semantic segmentation and plane detection, overlays contextual information on real-world objects, and uses a lightweight LLM to answer questions about the scene.

Capture real-world museum exhibits with video, reconstruct them using 3D Gaussian Splatting, and create a VR walkthrough experience with an AI guide that answers questions about each exhibit using RAG over curated knowledge bases.

Design an AI agent that observes a user performing a procedural task in VR (e.g., equipment assembly), detects errors using pose estimation and step classification, provides real-time corrective feedback via a conversational avatar, and generates a performance report.

Create an AR app where users scan a room, then use a diffusion model to generate and preview furniture arrangements and style transformations overlaid on their real space, with voice-based refinement commands.

Build a multi-user VR whiteboard where an AI assistant converts rough sketches into polished diagrams, summarizes meeting notes spoken aloud, and suggests next steps based on conversation context.

Optimize a suite of AI models - object detection, OCR, scene captioning - for a Qualcomm Snapdragon-powered AR glasses reference device. Build a heads-up display that provides contextual information in the user's field of view.