Edge AI
Run ML inference on the device (phone, IoT, car) instead of in the cloud.
Pros: no latency, privacy, offline. Cons: limited model size. Powered by NPUs, quantised models (Llama on phone), TensorFlow Lite, ONNX Runtime Mobile, Core ML. Apple Intelligence is a prime example.