There's Intelligence in Our Pockets
I was standing in the basement of my local wine store, holding two bottles of wine. No network. No qualified assistance nearby.
Now, I love a fine wine, but I'm not an expert. So an offline tool for quick queries would have been helpful.
It became the perfect excuse to explore on-device AI, so I built an app around it.
Uncork is my personal wine advisor that runs both deterministically and conversationally, entirely on my phone, without cloud dependency.
The app isn't a single install. It downloads Gemma 4 E2B via Hugging Face. The app also contains a public dataset of ~119K wine reviews. And I did add an on-request web search in later versions for database writes.
It's specific to me. 𝗢𝗻𝗲 𝘂𝘀𝗲𝗿, 𝗼𝗻𝗲 𝗽𝗿𝗼𝗯𝗹𝗲𝗺. And that's the whole point.
I can converse naturally with my AI sommelier, enjoying the benefits of personalisation, privacy, and control that a local model can afford.
For now, I'm working on UI and Evals, and a paper on my findings will soon follow.
𝗕𝘂𝘁 𝘄𝗵𝘆 𝗱𝗼𝗲𝘀 𝘁𝗵𝗶𝘀 𝗺𝗮𝘁𝘁𝗲𝗿. It matters because hardware and software are coming together. Forecasts say that 45% of smartphones shipped this year can run generative AI. It's expected to reach 52% in 2027. Apple's Foundation Models and Google's AICore indicate the platform layer is moving in the same direction.
The phone in your pocket is becoming a place where intelligence lives. And we can now build the one-user AI-enhanced apps that no commercial roadmap would fund.
Additionally, running locally also means no infrastructure costs, no API bills, more privacy, and control that stay with the user.
Frontier models will design them. Smaller models will run them locally.
Perhaps we'll see minimalist interfaces, with apps and capabilities quietly and contextually running in the background.
Or maybe, the future isn't about apps at all.
Maybe it's software that's generated when needed and disappears when it isn't.