Vikas Chandra

Billion-parameter language models now run in real time on flagship mobile devices through advances in model compression and deployment techniques, making on-device inference viable for latency-sensitive and privacy-critical applications.

“Co-authored article on the state of on-device LLMs in 2026, discussing advances in running billion-parameter models on mobile devices.”