Skip to main content

Posts

Showing posts with the label NPU

GenAI Smartphone Sales Rise Worldwide

The concept of "AI at the edge" redefines how artificial intelligence is delivered. Rather than relying exclusively on centralized servers in the cloud, edge AI moves inference directly onto local devices where data and information are processed. Worldwide end-user spending on Generative AI (GenAI) smartphones is set to reach $298.2 billion by the close of 2025, according to the latest market study by Gartner. This milestone signals robust growth in digital hardware sales with a shift in how mobile technology is evolving to meet the demands of a more AI-dependent, experience-driven marketplace. Smartphone AI Market Development Smartphones have long stood at the center of the modern connected life. Now, the integration of GenAI marks a new era where devices transition from reactive tools to proactive intelligent companions. Gartner’s study draws a clear line between traditional smartphones and GenAI smartphones — those equipped with dedicated neural engines (NPUs) able to run...

GenAI Smartphones Forecast to Drive Growth

The semiconductor and smartphone industry stands on the brink of a transformative era, driven by the rapid integration of Generative AI (GenAI) technology into mobile devices. According to the latest global market study by International Data Corporation (IDC), GenAI smartphone shipments are forecast to grow by 363.6 percent in 2024 alone, reaching 234.2 million units. This surge represents 19 percent of the overall smartphone market. As we look toward the future, the adoption of GenAI is anticipated to redefine mobile device user interaction. GenAI Smartphone Market Development GenAI smartphones are defined by their ability to run on-device generative AI models efficiently, thanks to a system-on-a-chip (SoC) featuring a neural processing unit (NPU) with a performance capability of 30 tera operations per second (TOPS) or more, using the int-8 data type. This technological advancement promises to enhance the mobile user experience by enabling more personalized and proactive GenAI tool f...

GenAI Goes Everywhere via Device Chipsets

Soon you will start to experience Artificial Intelligence (AI) benefits everywhere -- in the public cloud, at the edge of mobile networks, and on many personal digital devices. Generative AI (GenAI) workloads have moved beyond the bounds of cloud environments and can now run on-device supported by implementing heterogeneous AI chipsets. Combined with an abstraction layer that can efficiently distribute AI workloads between processing architectures and compressed LLMs with under 15 billion parameters, these advanced chipsets can enable us to run generative AI inferencing locally. On-Device AI Market Development ABI Research estimates worldwide shipments of heterogeneous AI chipsets will reach over 1.8 billion by 2030 as personal computers, smartphones, and other form factors will increasingly ship with on-device AI capabilities. "Cloud deployment will act as a bottleneck for generative AI to scale due to data privacy, latency, and networking cost concerns. Solving these challenges...