@hn_59f309
about 1 month ago
I had a go at this using the on-device models in edge and chrome, phi4-mini and gemini nano, worked surprisingly well for such small models. https://ryanseddon.com/ai/how-to-build-an-agent-on-device/

Smallest Gemini model, designed for on-device inference in Android (starting on Pixel 8 Pro) and Chrome, enabling local AI features without cloud calls.
@hn_59f309
about 1 month ago
I had a go at this using the on-device models in edge and chrome, phi4-mini and gemini nano, worked surprisingly well for such small models. https://ryanseddon.com/ai/how-to-build-an-agent-on-device/
@hn_e494f0
3 months ago
The model is not opensource. Also now we are stuck with walled garden for models thats deeply integrated at OS or Browser level. 1. Apple Models not open - so we cannot run Android, also not on Desktop Chrome or Edge. 2. Microsoft Phi3 - Can run inside iOS ,but on Android only as an APP but not on OS level or no supported APIs. Can run on Desktop Edge not chrome. 3. Google GEmini nano - Can only run inside Android and Desktop Chrome not Edge, not on iOS as weights are not open. So we cannot get a similar answer from LLM as its different models, you cannot across ecosystem.