Byte-Sized
Small Language Models Make Edge AI Practical
Sub-3B parameter models achieve usable quality for on-device AI applications.
2025-11-22
Small language models (SLMs) under 3 billion parameters are making on-device AI practical. Models like Phi-3-mini, Gemma-2B, and Llama-3.2-1B can now run on smartphones, IoT devices, and embedded systems with acceptable quality for many use cases. Key applications include offline voice assistants, local document processing, and privacy-preserving AI that never sends data to the cloud.