Multimodal Augmented Reality for Composing and Executing Robot Tasks (MARCER) is a multimodal end-user robot programming system that combines large language models, trigger-action programming, and augmented reality to enable users to create reactive robot programs using verbal commands. This was published at HRI 2025.
A Best Paper Honorable Mention Award! We designed and evaluated an immersive Cyber-Physical Control Room interface for remote mobile robots, showing it improved operator effectiveness by 28% in a mock disaster response scenario and enhanced human-robot teamwork.
PRogramAR merges augmented reality (AR) with trigger-action programming (TAP) for easy robot programming and real-time debugging, enhancing human-robot collaboration.
Along with many other workshop organizers, we ran a successful HRI Pioneers workshop!
This paper explores how to improve robot debugging tools, evaluating 3D visualizations, a 2D GUI, and emerging 3D augmented reality with feedback from 24 roboticists.
My extended abstract was accepted to HRI Pioneers! A highly selective workshop held in conjunction with HRI.
My extended abstract was accepted to the workshop Virtual, Augmented, and Mixed Reality - Human-Robot Interaction (VAM-HRI)!