Advancements in AR and MR for Enhanced Human-Computer Interaction

The recent developments in the research area highlight a significant shift towards integrating augmented reality (AR) and mixed reality (MR) technologies to enhance human-computer interaction, particularly in fields such as robotic surgery, teleoperation, and immersive storytelling. Innovations focus on improving visualization, interaction, and user experience through advanced AR/MR applications, gesture-based controls, and haptic feedback systems. These technologies aim to bridge the gap between virtual and physical worlds, offering more intuitive and efficient ways to perform complex tasks, from surgical procedures to remote presentations and educational experiences.

Noteworthy advancements include the use of AR for better surgical planning and execution, the development of gesture syntax for smart space interaction, and the exploration of haptic feedback in AR environments. Additionally, there's a growing interest in leveraging AR and IoT for immersive storytelling, making it accessible to a broader audience. The integration of these technologies not only enhances the user experience but also opens new avenues for research and application in various domains.

Highlighted Papers:

  • An innovative mixed reality approach for Robotics Surgery: Introduces a system improving surgical procedures with AR, offering better visualization and planning.
  • Assessing the Acceptance of a Mid-Air Gesture Syntax for Smart Space Interaction: Explores a novel gesture-based command syntax for smart spaces, showing high user acceptance.
  • Assisting MoCap-Based Teleoperation of Robot Arm using Augmented Reality Visualisations: Demonstrates how AR visualizations can improve robot arm teleoperation.
  • Enhancing Interaction with Augmented Reality through Mid-Air Haptic Feedback: Presents a flexible architecture for haptically-enabled AR applications, enhancing user interaction.
  • Jigsaw: Authoring Immersive Storytelling Experiences with Augmented Reality and Internet of Things: Introduces a system for creating immersive AR and IoT-based storytelling experiences, accessible to beginners.

Sources

An innovative mixed reality approach for Robotics Surgery

Assessing the Acceptance of a Mid-Air Gesture Syntax for Smart Space Interaction: An Empirical Study

Assisting MoCap-Based Teleoperation of Robot Arm using Augmented Reality Visualisations

Video-Conferencing Beyond Screen-Sharing and Thumbnail Webcam Videos: Gesture-Aware Augmented Reality Video for Data-Rich Remote Presentations

Modeling User Preference in Single-Finger Grasping Interactions

Visualizing Uncertainty in Image Guided Surgery a Review

Evaluating Robotic Approach Techniques for the Insertion of a Straight Instrument into a Vitreoretinal Surgery Trocar

Enhancing Interaction with Augmented Reality through Mid-Air Haptic Feedback: Architecture Design and User Feedback

ViewVR: Visual Feedback Modes to Achieve Quality of VR-based Telemanipulation

Jigsaw: Authoring Immersive Storytelling Experiences with Augmented Reality and Internet of Things

Holoview: Interactive 3D visualization of medical data in AR

Built with on top of