Skip to main content

Exploring the Development of Multi-Modal Computing

Smartphones have changed the way that users interact with devices, where touch is the main method of interaction. Moreover, the development of wearables that provide VR (virtual reality) and AR (augmented reality) technology is helping to advance gesture control applications.

While most software app developers are primarily focused on providing a method of control for VR and AR computing devices, such as head-mounted displays, there's an emerging ecosystem of companies working to bring this technology to smartphones and personal computers as well.

According to the latest worldwide market study by Juniper Research, gesture and motion control will become vital components for certain forms of human-computer interaction during the next decade.

New User Interface Market Development

The application of gesture and motion control technology in smartphone-based VR will be particularly important in promoting new usage. Juniper forecasts 128 million devices equipped with the technology by the end of 2016, rising to 492 million by 2020 -- that's a growth of over 280 percent.

The Juniper study found that progress has already occurred in the development of gesture and motion interfaces, from vendors such as Leap Motion and Thalmic Labs. Juniper says that they expect nearly 50 percent of all wearables and almost all VR to use the technology by 2021.

However, for more established platforms like PCs and smartphones, Juniper believes that usage will remain low -- with less than 5 percent of such devices using gesture control by that time.


The arrival of motion control for smartphone VR in 2017 will start a shift towards multi-modal computing -- utilizing peripherals, motion and gesture control. However, this will simply extend current functionalities, holding back adoption across devices as a whole, unless the user interface (UI) paradigm changes.

Gesture and motion control is currently an add-on for most consumer electronic devices, despite many smartphones and media tablets having sensors which can enable the technology.

"VR and wearables have shown the way that gesture and haptics can provide fresh ways to interact with technology," said James Moar, senior analyst at Juniper Research. "The game changer for other platforms will be when technology firms are brave enough to reinvent their UIs to incorporate gesture and motion control, rather than considering it an optional add-on."

Popular posts from this blog

Big Data Analytics Revenue to Reach $215.7 Billion

Across the globe, more leaders seek actionable insight from the customer data they've stored in huge data lakes. Worldwide spending on big data and business analytics (BDA) solutions is forecast to reach $215.7 billion in 2021 -- that's an increase of 10.1 percent over 2020, according to the latest worldwide market study by International Data Corporation (IDC). Moreover, BDA technology investment will likely gain momentum over the next five years as the global economy recovers from the COVID-19 pandemic. The compound annual growth rate (CAGR) for global BDA spending over the 2021-2025 forecast period will be 12.8 percent. Big Data Analytics Market Development "As executives seek solutions to enable better, faster decisions, we're seeing relatively healthy BDA spending across all industries. Leveraging data for insights into everything from internal business operations to the customer journey is top of mind and of strategic importance," said Jessica Goepfert, vice

Warehouse Robot Deployment Gains New Momentum

The retail and wholesale back-office infrastructure market is being transformed by technology. The warehousing industry has accelerated automation efforts due to the increased order volume and labor shortages driven by the global pandemic. In addition to technology solutions such as handheld devices with enhanced capabilities, autonomous, collaborative, and mobile robots are proving to be the fastest-growing productivity-enhancing solution in the warehouse workspace. Commercial Robotics Market Development According to the latest worldwide market study by ABI Research, global commercial robot revenue in warehouses will have a Compounded Annual Growth Rate (CAGR) of over 23 percent from 2021 to 2030 and exceed $51 billion by 2030. "Mobile robots are at the heart of the warehouse robotics market and account for most shipments and revenue. These robots, made up of Autonomous Guided Vehicles (AGVs) and Autonomous Mobile Robots (AMRs), are being used to move goods within the warehouse a

Hybrid Work: How to Enhance Employee Productivity

When you hire qualified talent for a key role and trust them to perform, you'll likely achieve the best outcome. Skilled and experienced people will deliver results, regardless of the challenges. That's a key lesson learned from the pandemic experience as most knowledge workers were asked to work from their homes. However, some resist returning to an open-plan office. It's unacceptable. Meanwhile, forward-thinking leaders decided a "return to normal" is undesirable, and in hindsight, everyone should aspire to be more accomodating than before. Therefore, location flexibility is okay. Hybrid Workforce Market Development How will people adapt to these changes? They'll apply the modern IT tools at their disposal. They'll learn new skills and thrive. Nearly 80 percent of employees are now successfully using online collaboration tools for work in 2021 -- that's up from just over half of workers in 2019, according to the latest market study by Gartner. This g