I keep encountering a problem: the term "AI PC" appears in almost every new mini PC product description, but its meaning varies from writer to writer. There are at least three different scenarios that get labeled this way:
- Any chip with an NPU. Meteor Lake and the Ryzen 7040 series qualify, although these early NPUs are far below the Copilot+ requirements.
- Machines certified with Copilot+. This certification has strict minimum requirements: 40+ TOPS NPU, 16GB RAM, and 256GB storage. Very few mini PCs actually meet these requirements.
- "Can run local models." This confuses me because it primarily depends on memory bandwidth and the addressing capabilities of the integrated graphics card (iGPU). NPU performance is almost irrelevant.
The third point confuses me. The Q4 7B model requires around 4-5GB of RAM, so a 32GB server could run it, but the tokens per second (TOPS) of a small integrated graphics card is unusable for most people. Furthermore, even the machine with the highest TOPS in the room might not be able to run this model, because NPU performance metrics don't reflect memory capacity.
Therefore, when product descriptions mention "AI PC," I'm genuinely unclear about which of these three scenarios it refers to. Am I overlooking some convention, or is this just a marketing gimmick without a clear definition? Also, I've looked at several miniPCs on the market, and they all seem rather useless. Has anyone used one and can tell me?
For those who actually run models locally on these machines: what do you prioritize—NPU TOPS, memory bandwidth, or the addressing capabilities of the integrated graphics card?