Bonsai-8B vs Dune

“131 tokens/sec on M4 Pro at 1.15 GB is genuinely impressive — I can embed this in a macOS app without any cloud dependency, no rate limits, no privacy concerns. The Apache 2.0 license means I can ship commercial products on top of it. This is the edge AI story I've been waiting for.”

“The primitive here is dead simple and correct: an HID device whose key mappings are driven by a macOS accessibility API hook watching the frontmost application — the AI layer handles the mapping logic so you don't write profiles by hand. That's the right DX bet. The moment of truth is day two, not day one: does the context inference hold up when you have twelve apps open and you're alt-tabbing between your editor and a Slack thread? If the answer is yes, this is the macro pad I'd actually leave plugged in. The specific decision that earns a ship from me is that they rejected the 'define every profile yourself' pattern that killed every Stream Deck workflow I've ever set up.”

“63.8 on MMLU is respectable but it's still noticeably behind mid-range cloud models on reasoning tasks. The GSM8K score of 54.2 means it'll fumble multi-step math that users expect to just work. Until 1-bit gets to 70B scale, it's a neat demo that falls short in production use cases where quality matters.”

“Direct competitor is the Stream Deck Mini plus a $10/yr Keyboard Maestro license, which already does context-aware macro switching with zero AI ambiguity. The specific scenario where Dune breaks is the one that happens constantly: two apps open side-by-side, ambiguous context, and three keys that do the wrong thing because the model guessed wrong — that's worse than a dumb macro pad, not better. What kills this in 12 months is Apple shipping Focus-mode-aware Shortcuts automation natively in macOS 16, at which point the software layer this hardware depends on is commoditized. To earn a ship: show me six months of real-world context accuracy data, not a Product Hunt leaderboard.”

“The trajectory here is what matters: 1-bit models are getting faster to train and competitive faster than expected. When custom Apple Neural Engine kernels land for BitNet-style weights, we'll see 200+ tokens/sec on a phone. Bonsai-8B is the proof-of-concept that makes that future feel real.”

“The thesis Dune is betting on: within three years, AI context awareness will be accurate enough that zero-configuration physical controls outperform manually-configured ones, and users will pay a hardware premium for that. That's a falsifiable claim riding a specific trend line — on-device app-state inference getting cheap enough to run as a background daemon — and Project Mirage is early, not late, to it. The second-order effect nobody is talking about: if this works, it inverts the macro pad market from a power-user niche into a normie peripheral, because the configuration tax that kept civilians away disappears. The future state where this is infrastructure is a desk where every physical control knows what you're doing without being told.”

“I've been looking for something I can embed in a creative writing or brainstorming app that doesn't require an internet connection. At 44 tokens/sec on iPhone, Bonsai-8B is finally fast enough to not break the creative flow. The 'no account required' angle is a genuine selling point for privacy-conscious users.”

“The job-to-be-done is singular and clear: stop context-switching your hands when your screen context already switched. The meetings use case is the product's sharpest edge — calendar sync plus one-click join plus mic/camera toggles is a complete workflow replacement, not a feature — and that alone justifies the purchase for anyone on four-plus calls a day. The product has a real opinion: it decides your key assignments, you don't. That's brave and almost certainly right. The gap that would turn this ship into a skip is if the broader context-awareness layer — editor vs. browser vs. design tool — turns out to be shallow window-title matching dressed up as AI; ship the meetings story hard and make everything else a bonus.”