Head-worn devices such as virtual reality (VR) headsets or augmented reality (AR) glasses can be used to control mobile manipulators by tracking the user’s head movements and translating them into commands for the robot. For example, the user could move their head to look at a specific object, and the robot would move its manipulator to grasp the object.
A new study from Carnegie Mellon University’s Robotics Institute (RI) aims to improve autonomy for people with such motor impairments by introducing a head-worn device that allows them to control a mobile manipulator.
Teleoperated mobile manipulators can help people complete daily tasks, but many existing technologies, such as hand-operated joysticks or web interfaces, require a user to have significant fine motor skills to control them effectively. A new device equipped with a hands-free microphone and head-worn sensor that allows users to control a mobile robot via head motion and speech recognition has been developed by robotics Ph.D. student Akhil Padmanabha.
Head-Worn Assistive Teleoperation (HAT) requires fewer fine motor skills than other interfaces, offering an alternative for users who face constraints with technology currently on the market.
More than five million people in the United States have some form of paralysis and may have difficulty performing daily tasks such as grabbing a glass of water or putting on clothes. A new study from Carnegie Mellon University’s Robotics Institute (RI) aims to improve autonomy for people with such motor impairments by introducing a head-worn device that allows them to control a mobile manipulator.
Teleoperated mobile manipulators can help people complete daily tasks, but many existing technologies, such as hand-operated joysticks or web interfaces, require a user to have significant fine motor skills to control them effectively. A new device equipped with a hands-free microphone and head-worn sensor that allows users to control a mobile robot via head motion and speech recognition has been developed by robotics Ph.D. student Akhil Padmanabha.
Head-Worn Assistive Teleoperation (HAT) requires fewer fine motor skills than other interfaces, offering an alternative for users who face constraints with the technology currently on the market.
In addition to Padmanabha, the research team includes Qin Wang, Daphne Han, Jashkumar Diyora, Kriti Kacker, Hamza Khalid, Liang-Jung Chen, Carmel Majidi, and Zackory Erickson. In a human study, participants both with and without motor impairments performed multiple household and self-care tasks with low error rates, minimal effort, and a high perceived ease of use. The research team will present their paper, “HAT: Head-Worn Assistive Teleoperation of Mobile Manipulators,” at the IEEE’s International Conference on Robotics and Automation in London.
There are several challenges to implementing head-worn device control for mobile manipulators, such as ensuring accurate tracking of head movements, developing intuitive user interfaces, and addressing safety concerns. However, research in this area is ongoing, and it is likely that we will see more advanced and sophisticated head-worn device control systems for mobile manipulators in the future.
