Skip to main content

'AI at the Edge' Creates New Semiconductor Demand

As more CIOs and CTOs focus attention on selecting the best-fit IT infrastructure for their particular cognitive computing needs, vendors of semiconductor technologies are exploring new ways to optimize their investment in solutions at the edge of enterprise networks.

Revenue from the sale of Artificial Intelligence (AI) chipsets for edge inference and inference training will grow at 65 percent and 137 percent respectively between 2018 and 2023, according to the latest worldwide market study by ABI Research.

During 2018, shipment revenues from edge AI processing reached $1.3 billion, and by 2023 this figure is forecast to reach $23 billion. While it's a massive increase, that doesn’t necessarily favor current market leaders Intel and NVIDIA.

AI Chipset Market Development

According to the ABI assessment, there will be intense vendor competition to capture this revenue between established players and several prominent startup players.

"Companies are looking to the edge because it allows them to perform AI inference without transferring their data. The act of transferring data is inherently costly and in business-critical use cases where latency and accuracy are key, and constant connectivity is lacking, applications can’t be fulfilled," said Jack Vernon, industry analyst at ABI Research.

Moreover, locating AI inference processing at the edge also means that companies don’t have to share private or sensitive data with public cloud service providers, a scenario that has proven to be problematic in the healthcare and consumer sectors.

That said, edge AI is going to have a significant impact on the semiconductor industry. The biggest winners from the growth in edge AI are going to be those vendors that either own or are currently building intellectual properties for AI-related Application-Specific Integrated Circuits (ASICs).

By 2023, it's predicted that ASICs could overtake GPUs as the architecture supporting AI inference at the edge, both in terms of annual vendor shipments and revenues.

In terms of market competition, on the AI inferencing side, Intel will be competing with several prominent AI start-ups -- such as Cambricon Technology, Horizon Robotics, Hailo Technologies, and Habana Labs -- for dominance of this market segment.

NVIDIA with its GPU-based AGX platform has also been gaining momentum in industrial automation and robotics. While FPGA leader Xilinx can also expect an uptick in revenues on the back of companies using FPGAs to perform inference at the edge, Intel as an FPGA vendor is also pushing its Movidius and Mobileye chipset.

Outlook for AI Chipset Applications Growth

For AI training, NVIDIA will hold on to its current position as the market leader. However, other AI applications at the edge will likely favor alternative vendors.

"Cloud vendors are deploying GPUs for AI training in the cloud due to their high performance. However, NVIDIA will see its market share chipped away by AI training focused ASIC vendors like Graphcore, who are building high-performance and use-case specific chipsets," concluded Vernon.

Popular posts from this blog

Global Digital Business and IT Consulting Outlook

Across the globe, CEOs and their leadership teams continue to seek information and guidance about planned Digital Transformation initiatives and the most effective enterprise organization change management practices. Worldwide IT and Business Services revenue will grow from $1.13 trillion in 2022 to $1.2 trillion in 2023 -- that's a 5.7 percent year-over-year growth, according to the latest market study by International Data Corporation (IDC). The mid-term to long-term outlook for the market has also increased -- the five-year CAGR is forecast at 5.2 percent, compared to the previous 4.9 percent. Digital Sevices & Consulting Market Development IDC has raised the growth projection despite a weak economic outlook, because of vendor performances across 2022, growth indicators from adjacent markets, increased government funding, and inflation impacts. The actual 2022 market growth was 6.7 percent (in constant currency), which was 87 basis points higher than forecast last year, alth

Digital Talent Demand Exceeds Supply in Asia-Pac

Even the savviest CEO's desire for a digital transformation advantage has to face the global market reality -- there simply isn't enough skilled and experienced talent available to meet demand. According to the latest market study by IDC, around 60-80 percent of Asia-Pacific (AP) organizations find it "difficult" or "extremely difficult" to fill many IT roles -- including cybersecurity, software development, and data insight professionals. Major consequences of the skills shortage are increased workload on remaining digital business and IT employees, increased security risks, and loss of "hard-to-replace" critical transformation knowledge. Digital Business Talent Market Development Although big tech companies' layoffs are making headlines, they are not representative of the overall global marketplace. Ongoing difficulty to fill key practitioner vacancies is still among the top issues faced by leaders across industries. "Skills are difficul

Mobile Device Market Still Awaiting Recovery

The mobile devices market has experienced three years of unpredictable demand. The global pandemic, geopolitical pressures, supply chain issues, and macroeconomic headwinds have hindered the sector's consistent growth potential. This extremely challenging environment has dramatically affected both demand and supply chains. It has led to subsequent inflationary pressures, leading to a worsening global cost of living crisis suppressing growth and confidence in the sector. In tandem, mobile device industry stakeholders have become more cautious triggering market uncertainties. Mobile Device Market Development Operating under such a backdrop, the development of mobile device ecosystems and vendor landscapes have been impacted severely. Many of these market pressures persisted throughout 2022 and now into 2023, borne chiefly by the smartphone market. According to the latest worldwide market study by ABI Research, worldwide smartphone shipments in 2022 declined 9.6 percent Year-over-Year