Mixed Reality and Human-Robot Interaction

Report on Current Developments in Mixed Reality and Human-Robot Interaction

General Direction of the Field

The recent advancements in the field of Mixed Reality (MR) and Human-Robot Interaction (HRI) are pushing the boundaries of both technology and application domains. The focus is increasingly shifting towards creating more inclusive, sustainable, and intuitive systems that can seamlessly integrate into various aspects of human life, from healthcare to education and beyond.

Inclusive Design and Collaboration: One of the prominent trends is the emphasis on designing MR systems that are inclusive and accessible to a diverse range of users. This includes addressing the challenges faced by individuals who may not have access to dedicated MR devices, ensuring that all participants feel engaged and included in collaborative environments. The integration of cross-device systems and compensating for the disadvantages of non-immersive devices are key areas of innovation.

Sustainability in MR Ecosystems: As MR technology becomes more ubiquitous, there is a growing concern about its environmental impact. Researchers are exploring ways to make MR systems more sustainable by reducing their carbon footprint. This involves optimizing hardware design, network configurations, and energy consumption in non-processor components. The goal is to create MR ecosystems that are not only efficient but also environmentally responsible.

Enhanced Human-Robot Interaction: The field of HRI is witnessing significant advancements, particularly in the area of shared-control systems. These systems aim to enhance the safety and intuitiveness of human-robot collaboration by providing intuitive navigation and collision avoidance mechanisms. The integration of sensor arrays and novel control algorithms, such as Passive Artificial Potential Fields, is making it possible to create more responsive and user-friendly robotic systems.

Restoration of Physical Function through Sensory Manipulation: Another innovative direction is the use of sensory manipulation to restore physical function, particularly in patients with chronic pain. By altering the body schema through augmented sensory stimuli, researchers are exploring ways to restore self-efficacy and improve motor capacity. This approach leverages the deficits caused by chronic pain to develop therapeutic interventions that can significantly enhance the quality of life for patients.

Noteworthy Papers

  • XR Prototyping of Mixed Reality Visualizations: Demonstrates the potential of Extended Reality Prototyping (XRP) in controlling complex machinery, particularly in medical imaging robots, by reducing perceived latency and modeling human behavior.

  • Designing for Device Inclusivity in Mixed Reality Collaboration: Proposes strategies to ensure inclusivity in MR collaboration by compensating for the disadvantages of non-immersive devices, enhancing user engagement and belonging.

  • Scoping Sustainable Collaborative Mixed Reality: Identifies key challenges and promising research directions for improving the sustainability of MR ecosystems, focusing on energy savings and carbon-aware optimizations.

  • Enabling Shared-Control for A Riding Ballbot System: Introduces a shared-control approach for collision avoidance in a self-balancing riding ballbot, significantly reducing collisions and cognitive load while enhancing user safety.

  • Restoration of Reduced Self-Efficacy Caused by Chronic Pain: Explores the use of sensory manipulation to restore self-efficacy in chronic pain patients, offering a novel therapeutic approach to improving motor capacity.

These papers represent some of the most innovative and impactful contributions to the field, pushing the boundaries of what is possible in MR and HRI.

Sources

XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot

Don't Leave Me Out: Designing for Device Inclusivity in Mixed Reality Collaboration

Restoration of Reduced Self-Efficacy Caused by Chronic Pain through Manipulated Sensory Discrepancy

Scoping Sustainable Collaborative Mixed Reality

Enabling Shared-Control for A Riding Ballbot System

The mutual pulling force of human muscle fibers can treat mild cancer and rhinitis

The Design of Informative Take-Over Requests for Semi-Autonomous Cyber-Physical Systems: Combining Spoken Language and Visual Icons in a Drone-Controller Setting