AI EncyclopediaChips & deep techChips
NPU (neural processing unit)
NPU
A chip built to run AI calculations inside a phone or laptop while using little power.
Overview
Big AI runs on GPUs in faraway data centers. The NPU is a chip made to run smaller AI right inside the device. It handles jobs such as photo touch-ups, real-time interpretation and voice dictation.
Processing on the device means you do not need the internet, you do not have to send your data outside, and responses are fast. This approach is called on-device AI.
An everyday example
It is like cooking the simple dishes right away in a small kitchen at home, instead of ordering every meal from a big restaurant.
Why it matters
Most devices sold as "AI phones" or "AI PCs" have an NPU inside. It is also a way to use AI while protecting your personal information.
Also calledon-device AI chip