Skip to main content

Exploring the Development of Multi-Modal Computing

Smartphones have changed the way that users interact with devices, where touch is the main method of interaction. Moreover, the development of wearables that provide VR (virtual reality) and AR (augmented reality) technology is helping to advance gesture control applications.

While most software app developers are primarily focused on providing a method of control for VR and AR computing devices, such as head-mounted displays, there's an emerging ecosystem of companies working to bring this technology to smartphones and personal computers as well.

According to the latest worldwide market study by Juniper Research, gesture and motion control will become vital components for certain forms of human-computer interaction during the next decade.

New User Interface Market Development

The application of gesture and motion control technology in smartphone-based VR will be particularly important in promoting new usage. Juniper forecasts 128 million devices equipped with the technology by the end of 2016, rising to 492 million by 2020 -- that's a growth of over 280 percent.

The Juniper study found that progress has already occurred in the development of gesture and motion interfaces, from vendors such as Leap Motion and Thalmic Labs. Juniper says that they expect nearly 50 percent of all wearables and almost all VR to use the technology by 2021.

However, for more established platforms like PCs and smartphones, Juniper believes that usage will remain low -- with less than 5 percent of such devices using gesture control by that time.


The arrival of motion control for smartphone VR in 2017 will start a shift towards multi-modal computing -- utilizing peripherals, motion and gesture control. However, this will simply extend current functionalities, holding back adoption across devices as a whole, unless the user interface (UI) paradigm changes.

Gesture and motion control is currently an add-on for most consumer electronic devices, despite many smartphones and media tablets having sensors which can enable the technology.

"VR and wearables have shown the way that gesture and haptics can provide fresh ways to interact with technology," said James Moar, senior analyst at Juniper Research. "The game changer for other platforms will be when technology firms are brave enough to reinvent their UIs to incorporate gesture and motion control, rather than considering it an optional add-on."

Popular posts from this blog

How a Digital-First CEO Leads Transformation

Some leaders reject the notion that "wait and see" is the best response to disruptive change. Savvy senior executives are already driving digital business transformation throughout their organization in an effort to gain a bold strategic advantage. According to the latest market study by International Data Corp (IDC), Digital-First CEOs plan to drive at least half of their income from digital business products, services, and experiences by 2027 -- that's ahead of the market average of 39 percent. Driven by their response to the COVID-19 pandemic, these business leaders have changed how they think about the relationship between business and technology, and how they approach the next digital transformation era -- from scaling digital technology to guiding a viable digital business. Digital Business Market Development IDC defines digital business as value creation based on technology, which entails: 1) Automated customer-facing processes and internal operations; 2) Provision

Digital Solutions for Industrial & Manufacturing Firms

Executive leaders of fast-moving consumer goods (FMCG) are seeking guidance on how to apply new business technology in their manufacturing operations. CIOs and CTOs are tasked with gaining insight into the best solutions for digital transformation. ABI Research evaluated the impact politics, regulation, the economy, supply chain, ESG, and technology are having on FMCG, pharma, producers of steel, chemicals, pulp and paper -- as well as the mining and oil & gas sectors. Digital Transformation Market Development "Our assessment found that the FMCG sector is under pressure from all sides," says Michael Larner, industrial & manufacturing research director at ABI Research . Securing raw materials is challenging considering lockdowns in China and limited grain supplies from Ukraine. Supply shocks are raising input costs, and operating costs are rising with higher energy costs coupled with the pressure to pay higher wages and work sustainably. "We all hoped that with th

5G Fixed Wireless Access Revenue to Reach $24B

Available Internet access at an affordable cost is essential for everyone to participate in the Global Networked Economy. The deployment of fifth-generation (5G) wireless communications infrastructure is enabling the introduction of lower-cost broadband services in some markets. Fixed Wireless Access (FWA) allows mobile network operators (MNO) to deliver high-speed Internet connections in areas that have either insufficient or no prior wireline broadband access services. It's also used in urban, suburban, and rural areas where fiber optic communication is considered too expensive to install and maintain. With this new technology, MNOs have the potential to provide broadband capability at similar levels to fiber optic networks. Fixed Wireless Access Market Development Therefore, FWA can be used to supplement existing wired broadband Internet service offerings, provide additional broadband capacity, or act as a backup service for home or business applications. Although FWA is well es