VR application gives users ‘superhuman’ ability to open and control tools
Summary
By employing machine learning, the team developed ‘HotGestures’, an innovative approach analogous to hot keys in desktop applications, allowing users to control a range of 3D modelling tools through simple hand movements. ‘HotGestures’ enables users to create figures and shapes in virtual reality without the need to navigate traditional menus, maintaining an uninterrupted focus on their tasks. This system not only simplifies the interaction but also enhances the user experience by reducing the cognitive load typically associated with tool selection in virtual environments. Professor Per Ola Kristensson, from Cambridge’s Department of Engineering and co-Director of the Centre for Human-Inspired Artificial Intelligence, highlighted the significance of this advancement: “Users gain some qualities when using VR, but very few people want to use it for an extended period of time.” Beyond ergonomic and visual fatigue challenges, Kristensson pointed out that VR needs to offer unique capabilities, distinct from those in the real world. Moving beyond the concept of hot keys, the Cambridge team’s ‘HotGestures’ allow users to open and control tools in VR through intuitive gestures.