Skip to main content

'AI at the Edge' Creates New Semiconductor Demand

As more CIOs and CTOs focus attention on selecting the best-fit IT infrastructure for their particular cognitive computing needs, vendors of semiconductor technologies are exploring new ways to optimize their investment in solutions at the edge of enterprise networks.

Revenue from the sale of Artificial Intelligence (AI) chipsets for edge inference and inference training will grow at 65 percent and 137 percent respectively between 2018 and 2023, according to the latest worldwide market study by ABI Research.

During 2018, shipment revenues from edge AI processing reached $1.3 billion, and by 2023 this figure is forecast to reach $23 billion. While it's a massive increase, that doesn’t necessarily favor current market leaders Intel and NVIDIA.

AI Chipset Market Development

According to the ABI assessment, there will be intense vendor competition to capture this revenue between established players and several prominent startup players.

"Companies are looking to the edge because it allows them to perform AI inference without transferring their data. The act of transferring data is inherently costly and in business-critical use cases where latency and accuracy are key, and constant connectivity is lacking, applications can’t be fulfilled," said Jack Vernon, industry analyst at ABI Research.

Moreover, locating AI inference processing at the edge also means that companies don’t have to share private or sensitive data with public cloud service providers, a scenario that has proven to be problematic in the healthcare and consumer sectors.

That said, edge AI is going to have a significant impact on the semiconductor industry. The biggest winners from the growth in edge AI are going to be those vendors that either own or are currently building intellectual properties for AI-related Application-Specific Integrated Circuits (ASICs).

By 2023, it's predicted that ASICs could overtake GPUs as the architecture supporting AI inference at the edge, both in terms of annual vendor shipments and revenues.

In terms of market competition, on the AI inferencing side, Intel will be competing with several prominent AI start-ups -- such as Cambricon Technology, Horizon Robotics, Hailo Technologies, and Habana Labs -- for dominance of this market segment.

NVIDIA with its GPU-based AGX platform has also been gaining momentum in industrial automation and robotics. While FPGA leader Xilinx can also expect an uptick in revenues on the back of companies using FPGAs to perform inference at the edge, Intel as an FPGA vendor is also pushing its Movidius and Mobileye chipset.

Outlook for AI Chipset Applications Growth

For AI training, NVIDIA will hold on to its current position as the market leader. However, other AI applications at the edge will likely favor alternative vendors.

"Cloud vendors are deploying GPUs for AI training in the cloud due to their high performance. However, NVIDIA will see its market share chipped away by AI training focused ASIC vendors like Graphcore, who are building high-performance and use-case specific chipsets," concluded Vernon.

Popular posts from this blog

Why Healthcare and Smart City Apps Drive 5G IoT

Fifth-generation (5G) wireless technology for cellular networks is a successor to fourth-generation (4G) wireless technology. By 2023, Juniper Research anticipates that there will be over 1 billion 5G connections globally. The technology will provide the data infrastructure for the advancement of wireless communications and for new developments in the Internet of Things (IoT) -- including smart cities and healthcare. 5G IoT Market Development According to the latest worldwide market study by Juniper Research, 5G IoT connections will reach 116 million globally by 2026 -- that's increasing from just 17 million connections in 2023. Juniper analysts predict that the healthcare sector applications and government or other smart city services will drive this outstanding 1,100 percent growth over the next three years. Juniper examined 5G adoption across key industry sectors -- such as the automotive, mobile broadband, and smart homes -- and forecasts healthcare and smart cities will accoun

How Savvy Leaders Re-Imagine Work in 2023

As we look to the year ahead, there will be significant challenges and opportunities facing the Chief Human Resource Officer (CHRO) role. In order to be successful, savvy HR leaders must be prepared to take proactive steps that adapt and evolve. "HR leaders have faced an increasingly unpredictable environment amid many organizations mandating a return to office, permanently higher turnover and burnt out employees," said Emily Rose McRae, senior director at Gartner . HR Innovation Market Development One of Gartner's key predictions for 2023 is that the use of artificial intelligence (AI) and automation will continue to increase within the enlightened digital workplace. This transition will require HR leaders to develop new skills and competencies in order to effectively manage and lead teams that are increasingly relying on these enabling technologies. Additionally, HR leaders will need to ensure that their organizations are investing in the necessary infrastructure and re

Top 10 CFO Priorities Require Rethinking Finance

The Chief Financial Officer (CFO) role is essential to digital business growth. While CFOs do not get closely involved in the tactical details of the digital transformation of their functions, they still recognize its strategic importance. According to the latest survey by Gartner, CFOs are faced with the challenge of balancing the need for substantive digital business innovation with financial cost control and risk management. "CFOs will be stretched thinly across many activities in 2023. The survey revealed a wide range of actions CFOs plan to either lead or be significantly involved with," said Marko Horvat, vice president at Gartner. Survey Findings: The Top Ten Priorities Cost Optimization - Cost reduction remains the top priority for CFOs as they look for ways to cut costs and improve efficiency in their operations. This includes identifying cost-saving opportunities through automation, outsourcing, and business process improvement. Business Continuity - The global C