
MR Blueprint is an augmented reality application built for Meta Quest 3 that transforms physical space into an interactive physics sandbox. Leveraging the precision of the Logitech MX Ink stylus, the system enables users to create and manipulate physics simulations by drawing directly in their environment. Gestures such as lines, circles, and pressure-based strokes are interpreted as constraints like springs, hinges, and collision boundaries, with parameters dynamically mapped from stylus input. Built in Unity using XR tooling and real-time rigidbody physics, the project introduces a novel interaction paradigm where users author behavior instead of geometry. By removing traditional UI friction, MR Blueprint encourages intuitive experimentation and positions spatial computing as a medium for learning, prototyping, and creative exploration.
MR Blueprint explores a new interaction model for spatial computing: drawing physics instead of configuring it. Users can place virtual objects into their real-world environment and define how they behave through direct stylus input—connecting objects with spring constraints, applying forces through gestures, and shaping boundaries with simple strokes.
The system is built in Unity using XR frameworks, with a custom gesture interpretation pipeline that translates noisy, freeform input into stable physics behaviors. Stylus pressure, tilt, and motion are mapped to simulation parameters such as stiffness, direction, and force magnitude, enabling expressive and tactile control over interactions.
Key technical challenges included maintaining simulation stability with dynamically generated constraints and designing intuitive mappings between human input and deterministic physics systems. The result is a responsive, exploratory experience that lowers the barrier to understanding and experimenting with physical systems.
This project is currently in the semi-finalist stage (Top 50 of 1,325 participants) in DevStudio 2026 by Logitech, progressing from concept pitch to full prototype development.