Hardware acceleration unit for artificial intelligence tasks
An AI accelerator, deep learning processor, or neural processing unit (NPU) is a class of specialized hardware accelerator[1] or computer system[2][3] designed to accelerate artificial intelligence and machine learning applications, including artificial neural networks and machine vision. Typical applications include algorithms for robotics, Internet of Things, and other data-intensive or sensor-driven tasks.[4] They are often manycore designs and generally focus on low-precision arithmetic, novel dataflow architectures or in-memory computing capability. As of 2024[update], a typical AI integrated circuit chip contains tens of billions of MOSFETs.[5]
AI accelerators are used in mobile devices, such as neural processing units (NPUs) in Apple iPhones[6] or Huawei cellphones,[7] and personal computers such as Apple silicon Macs, to cloud computing servers such as tensor processing units (TPU) in the Google Cloud Platform.[8] A number of vendor-specific terms exist for devices in this category, and it is an emerging technology without a dominant design.
Graphics processing units designed by companies such as Nvidia and AMD often include AI-specific hardware, and are commonly used as AI accelerators, both for training and inference.[9]
^"Intel unveils Movidius Compute Stick USB AI Accelerator". July 21, 2017. Archived from the original on August 11, 2017. Retrieved August 11, 2017.
^"Inspurs unveils GX4 AI Accelerator". June 21, 2017.
^Wiggers, Kyle (November 6, 2019) [2019], Neural Magic raises $15 million to boost AI inferencing speed on off-the-shelf processors, archived from the original on March 6, 2020, retrieved March 14, 2020
^"Google Designing AI Processors". Google using its own AI accelerators.
^Moss, Sebastian (March 23, 2022). "Nvidia reveals new Hopper H100 GPU, with 80 billion transistors". Data Center Dynamics. Retrieved January 30, 2024.
^"Deploying Transformers on the Apple Neural Engine". Apple Machine Learning Research. Retrieved August 24, 2023.
^"HUAWEI Reveals the Future of Mobile AI at IFA".
^Jouppi, Norman P.; et al. (June 24, 2017). "In-Datacenter Performance Analysis of a Tensor Processing Unit". ACM SIGARCH Computer Architecture News. 45 (2): 1–12. arXiv:1704.04760. doi:10.1145/3140659.3080246.
^Patel, Dylan; Nishball, Daniel; Xie, Myron (November 9, 2023). "Nvidia's New China AI Chips Circumvent US Restrictions". SemiAnalysis. Retrieved February 7, 2024.
An AIaccelerator, deep learning processor, or neural processing unit (NPU) is a class of specialized hardware accelerator or computer system designed...
imposed restrictions on exports to China of GPU and AIaccelerator chips used for generative AI. Chips such as the NVIDIA A800 and the Biren Technology...
2023) an emerging class of microprocessor; it is a specific type of AIaccelerator, designed to accelerate machine vision tasks. Vision processing units...
Tensor Processing Unit (TPU) is an AIaccelerator application-specific integrated circuit (ASIC) developed by Google for neural network machine learning...
Continue to Dominate the AIAccelerator Market for Now". InformationWeek. Retrieved 11 June 2020. Tiernan, Ray (2019). "AI is changing the entire nature...
Kobielus, James (27 November 2019). "GPUs Continue to Dominate the AIAccelerator Market for Now". InformationWeek. Archived from the original on 19 October...
competitors include AMD, Intel, Qualcomm and AIaccelerator companies such as Cerebras and Graphcore. It also makes AI-powered software for audio and video processing...
official roadmap by 2016. Ryzen AI is the brand name for AMD's hardware and software implementation of its XDNA AIaccelerator, based on intellectual property...
Vector processor Video card Video display controller Video game console AIaccelerator GPU Vector Processor internal features List of AMD graphics processing...
Chassis The product line is intended to bridge the gap between GPUs and AIaccelerators in that the device has specific features for deep learning workloads...
NVIDIA Deep Learning Accelerator (NVDLA) is an open-source hardware neural network AIaccelerator created by Nvidia. The accelerator is written in Verilog...
BrainChip added the Rochester Institute of Technology to its University AIaccelerator program. The next month, BrainChip was a part of Intel Foundry Services...
a hardware accelerator, though they are usually referred with a more specific term, such as 3D accelerator, or cryptographic accelerator. Traditionally...
supercomputers. Accelerator virtualization Gschwind was an early advocate of AI Hardware Acceleration with GPUs and programmable accelerators. As IBM's Chief...
marketed as first desktop processor to feature a dedicated AIAccelerator branded as "Ryzen AI". On April 1, 2024, AMD quietly released the Ryzen 8000 series...
pumped two-phase (P2P) liquid cooling infrastructure for the Gaudi3 AIaccelerator. In March 2024, Vertiv joined the Nvidia Partner Network (NPN) as a...
work, who, if anyone, should be able to claim ownership of the work? AIaccelerator Artificial brain Biomorphic Cognitive computer Computation and Neural...
14.7x boost in AI performance compared to Exynos 2200 Unified Shaders : Texture Mapping Units : Render Output Units : Ray Accelerators and Workgroup Processor...
began to establish marketing standards for "AI PCs" powered by Windows. These include a hardware AIaccelerator, as well as a Copilot button on the keyboard...
§ Vector extension Digital signal processor Field-programmable gate array AIaccelerator Vision processing unit Manycore Stream processing Computer for operations...
manycore PCI-e accelerator for data-intensive tasks Teraflops Research Chip, a manycore processor using message passing TrueNorth, an AIaccelerator with a manycore...
communicate with other devices and accelerators in a heterogeneous system. The MI300X is a dedicated generative AIaccelerator that replaces the CPU cores with...
is a specific type of AIaccelerator, designed to accelerate machine vision tasks Tensor Processing Unit (TPU), an AIaccelerator application-specific...
February 2016. Retrieved 23 October 2015. "GPUs Continue to Dominate the AIAccelerator Market for Now". InformationWeek. December 2019. Archived from the original...
5 million and $8.5 million respectively. Hailo unveiled its Hailo-8 AIaccelerator on May 14, 2019. Hailo secured Series B funding of $60 million on March...
Graphcore Limited is a British semiconductor company that develops accelerators for AI and machine learning. It has introduced a massively parallel Intelligence...
Global Information