Artificial Intelligence
Ternary LLMs Shrink 27B Reasoning to Laptop Scale
PrismML's Bonsai 2 27B achieves 98.2% parity with FP16 models in just 5.9 GB, proving ternary weights can run high-grade AI locally.
Topic
Edge Computing
A collection of essays to explore, one idea at a time.
Essays
Newest first
AI
Bonsai 27B and the Shift to Pocket-Sized Edge AI
Discover how the Bonsai 27B model running locally on smartphones is revolutionizing Edge AI, ensuring privacy, zero latency, and changing app development.