Model
45d agoBonsai 27B Reasoning Model Fits On iPhone
PrismML compressed a 27-billion-parameter model to under 4 GB. This version retains 90 percent of original performance, specifically maintaining high scores in math and coding. Apple is reportedly testing the technology now.
The Signal
This compression allows complex reasoning capabilities to run locally on mobile hardware without relying on cloud infrastructure.