Skip to main content

Exploring the Development of Multi-Modal Computing

Smartphones have changed the way that users interact with devices, where touch is the main method of interaction. Moreover, the development of wearables that provide VR (virtual reality) and AR (augmented reality) technology is helping to advance gesture control applications.

While most software app developers are primarily focused on providing a method of control for VR and AR computing devices, such as head-mounted displays, there's an emerging ecosystem of companies working to bring this technology to smartphones and personal computers as well.

According to the latest worldwide market study by Juniper Research, gesture and motion control will become vital components for certain forms of human-computer interaction during the next decade.

New User Interface Market Development

The application of gesture and motion control technology in smartphone-based VR will be particularly important in promoting new usage. Juniper forecasts 128 million devices equipped with the technology by the end of 2016, rising to 492 million by 2020 -- that's a growth of over 280 percent.

The Juniper study found that progress has already occurred in the development of gesture and motion interfaces, from vendors such as Leap Motion and Thalmic Labs. Juniper says that they expect nearly 50 percent of all wearables and almost all VR to use the technology by 2021.

However, for more established platforms like PCs and smartphones, Juniper believes that usage will remain low -- with less than 5 percent of such devices using gesture control by that time.


The arrival of motion control for smartphone VR in 2017 will start a shift towards multi-modal computing -- utilizing peripherals, motion and gesture control. However, this will simply extend current functionalities, holding back adoption across devices as a whole, unless the user interface (UI) paradigm changes.

Gesture and motion control is currently an add-on for most consumer electronic devices, despite many smartphones and media tablets having sensors which can enable the technology.

"VR and wearables have shown the way that gesture and haptics can provide fresh ways to interact with technology," said James Moar, senior analyst at Juniper Research. "The game changer for other platforms will be when technology firms are brave enough to reinvent their UIs to incorporate gesture and motion control, rather than considering it an optional add-on."

Popular posts from this blog

How Prediction Markets Outran The Rulebook

Prediction markets have stopped behaving like a betting curiosity and started behaving like market infrastructure. Executives who still file them under gambling are working from a stale map, and so are many of the regulators trying to govern them. A new Juniper Research market study gives prediction markets substantial attention, and its core message for decision-makers is that legitimacy, not demand, is now the binding constraint. Volume Has Outrun the Rulebook Juniper Research reports that combined monthly volume across Kalshi and Polymarket stood below $5 billion in September 2025 and reached roughly $24 billion by April 2026. Around the FIFA World Cup, a single month surpassed $50 billion, roughly matching the entire regulated U.S. sports betting handle for 2025. That is close to a tenfold climb in under a year, and it happened in full public view. Institutional Capital Has Taken a Position Intercontinental Exchange, parent of the New York Stock Exchange, committed $1 billion to Po...