A developer got an 80-billion-parameter model running on a Mac and a 35-billion-parameter one on an iPhone, using aggressive compression. If this keeps working, the question 'can I run a serious AI locally without paying for a cloud service' gets a real answer much sooner than expected.
Subject
Tools
Everything filed under Tools, newest first. all subjects →
A small system called InMyStyle adapts a local language model to rewrite AI-edited text to match your personal writing voice, trained on your own documents and running on your own machine. The idea that your AI writing assistant could actually sound like you, without sending your documents to a server somewhere, is the kind of quiet development that could change how people feel about using these tools for personal writing.
A developer makes the case for retyping AI-generated code by hand instead of copy-pasting it, the same way writing out notes by hand helps you remember a lecture better than photographing the whiteboard. If you skip the typing, you skip the understanding, and sooner or later the code you cannot explain will bite you.
Simon Willison joined a podcast to talk about open-weight AI models, meaning models whose underlying numbers are public and can be run by anyone. If the last few years of AI felt like something happening to you, open-weight models are where the conversation shifts to something you could actually participate in.
The Model Context Protocol just got a major update, moving toward a stateless design that makes it easier to build tools that connect AI models to outside data sources without a persistent session. Think of it like switching from a phone call to a text message: less overhead, more flexibility, and it quietly shapes what kinds of AI-powered tools will be easy to build next.
Two developers are asking a genuinely interesting question: now that AI agents can do multi-step tasks, what should the screen actually look like? The GUI for AI might be the next big design problem, the same way the desktop and the touchscreen each remade how we use computers.
A research team trained an AI tutor to ask guiding questions instead of just handing over answers, the way a good teacher does. It is a small behavioral shift, but it points toward AI education tools that actually build understanding rather than just completing homework for you.
Ethan Mollick updated his opinionated guide to which AI tool to use for which task, and Simon Willison found the evolution of that guide itself interesting. Watching how expert recommendations shift over time is a decent way to track which tools are actually earning their place.
A study tested whether a general-purpose LLM could catch internal contradictions inside real hospital discharge summaries, and found it could surface a real class of errors but failed in predictable ways at scale. If your workplace is exploring AI for document review, this is a useful map of where it helps and where it quietly breaks.
Researchers are building conversational AI tutors specifically designed to reduce the anxiety people feel when practicing a foreign language out loud. If you or someone you know has ever frozen up speaking a new language in front of people, a patient, non-judgmental AI conversation partner is a genuinely practical application worth keeping an eye on.
Anthropic published a Claude Cookbook full of real, working examples for getting better results out of the API, and the Hacker News community found it worth discussing. If you have ever stared at a blank prompt wondering how to structure a complex task, this is a practical starting point with actual code you can run.
A new Mac app called Nativ makes it straightforward to run AI models entirely on your own machine, no internet connection and no data leaving your laptop. For anyone handling sensitive documents at work, local models are moving from a hobbyist experiment toward something genuinely practical.
Bloomy launched an AI tutoring platform for K-12 that diagnoses what a student actually doesn't know before assigning work, rather than just marching everyone through the same material. If it holds up, this is the difference between a tutor who listens and a textbook that talks.
Claude Code, Anthropic's coding tool, recently switched to a faster underlying runtime and startup got 10 percent quicker on Linux. Almost nobody noticed. That is actually the point: the best infrastructure improvements are invisible, and the model you talk to sits on top of many quiet layers of engineering that never introduce themselves. When an AI tool feels snappy or slow, it is rarely the model itself. It is the whole stack underneath.
Simon Willison built a small tool that highlights the clichés that tend to show up in AI-generated writing, phrases like 'no fluff, no filler' that have become a kind of verbal fingerprint. It is a practical thing you can use to quickly spot whether a document you received was written by a person or assembled by a model on autopilot.
Someone compiled the entire Firefox browser to WebAssembly so it runs inside another browser. It is a fun technical stunt, but it quietly shows how flexible the underlying software layer is becoming, which is the same kind of flexibility that makes AI models easier to run in unexpected places.
A hobbyist connected an LLM to MikroTik network hardware and had it help manage router configurations in plain English. It is a small project, but it points at something real: the next wave of AI use is going to be in the unglamorous, infrastructure-y corners of tech that never had friendly interfaces before.
Simon Willison charted his own code output over time and found a visible jump that lines up with when he started using stronger coding assistants. It is a small, honest, personal data point, which is a rarer thing in AI discourse than it should be.
If you pay for a coding assistant by the token, this is a grocery receipt you never consented to. Claude Code was front-loading thousands of tokens of overhead before doing anything useful, and that overhead adds up fast on a real project.
sqlite-utils, a popular tool for wrangling data with simple commands, just got a dot-release with small quality-of-life improvements. This matters because a lot of people use it to prep and explore data before feeding it to AI tools, so small improvements here save real time in real workflows.
A team spent a year learning that teaching a five-year-old to read is genuinely hard, even for AI, because a good tutor has to know when to push, when to back off, and how to keep a child from just guessing randomly. If you have young kids, this space is moving fast and it is worth paying attention to what actually works versus what just looks impressive in a demo.
A senior developer publicly banned AI-generated pull request and commit messages from his team, saying they were worse than useless for understanding what actually changed in the code. This is a good reminder that AI is great at sounding thorough while skipping the part that actually helps someone else.
Simon Willison built a small web component using GPT-5.5 and shared the exact prompt he used, which is a useful reminder that a lot of real software is now being written this way, one prompt at a time. Watching what experienced developers actually prompt for, and how they share that work, tells you more about where the tools are headed than most product announcements do.
A new tool called GeoSQL lets Claude and Codex work with geospatial data, meaning you can ask an AI to query and reason about maps and location data without writing the SQL yourself. For anyone who works with geographic data and has always needed a specialist to write those queries, this is the kind of small tool that quietly saves an afternoon.
A team built Rowboat, an open-source local alternative to Claude's desktop app, because they wanted something that feels less like a chat window and more like a real work surface you can customize. If you have ever wished your AI assistant could fit into your actual workflow instead of the other way around, this is worth a look.
OfficeCLI is an open-source tool that lets AI agents read and edit Microsoft Office files directly, which sounds mundane until you realize it means an AI can now touch the spreadsheet your whole team depends on. Worth keeping an eye on how quickly agent tools start reaching into everyday work files.
Here is the concept worth sitting with: a model and a tool are two different things, and upgrading one does not automatically fix the other. Think of it like your car and the roads it drives on. A faster engine is great, but if the road has new curves the car was not expecting, you slow down or crash. When developers build tools that talk to AI models, they write instructions assuming a certain model behavior. A newer model is like a new driver who learned slightly different habits. It may be smarter overall, but it does not automatically follow the old instructions the same way. That is why the stories today about degraded Codex performance and Claude breaking its own edit tool are connected. Better models and reliable tools are a package deal, and right now the industry is still figuring out how to keep them in sync.
Simon Willison shipped a release candidate for sqlite-utils 4.0 with Claude doing most of the coding work, at a total cost of about $149. That is a real data point for anyone wondering what AI-assisted development actually costs on a meaningful open-source project, not a toy script.
Armin found that newer Claude models sometimes call an editing tool incorrectly in ways older models did not, meaning a model upgrade quietly broke a working pipeline. This is a good reminder that when you update the model underneath a tool, you are not just getting improvements, you are also getting a slightly different personality that may not play well with the old instructions.
HaloGuard is an open, freely available safety-classifier model that beats much larger commercial alternatives on filtering unsafe prompts, in multiple languages, at about one-tenth the computing cost. For anyone building an AI-powered product on a real budget, this is the kind of news worth bookmarking.
Kimi K2.7, a code-focused model from the Chinese AI lab Moonshot, just landed inside GitHub Copilot, the coding assistant used by millions of developers. If your team relies on Copilot, the model quietly suggesting their next line of code just changed, no announcement, no opt-in required.
Someone built a political-compass-style quiz specifically about AI and AI ethics, and it's a genuinely interesting way to figure out where you actually stand rather than where you assume you do. Takes a few minutes and is more honest than most AI opinion pieces.
A person ran their MRI results through Claude and found it surfaced details their radiologist had mentioned but not fully explained. This is not a replacement for a doctor, but it is a preview of what it looks like when AI becomes the second reader you can actually afford.
Wayfinder is a small open-source router that looks at your question and decides whether to send it to a big cloud model or a smaller one running on your own machine. That means cheaper bills and more privacy, without you having to think about it each time.
OpenKnowledge launched as a free, open-source note-taking app that connects directly to Claude and other AI agents, and 286 Hacker News readers found it worth their time. If you have ever wanted AI help inside your personal notes without sending everything to a company's server, this is worth a look.
Nvidia published a cooling design that runs data centers at 45 degrees Celsius and cuts water consumption to nearly zero. The environmental footprint of AI is real, and better cooling is one of the more concrete levers anyone has found so far.
A researcher used Claude to port a small but capable image-inpainting model so it runs entirely inside a web browser, no server required. That matters to you because it hints at a near future where powerful image-editing tools live in a plain webpage, with no subscription, no upload, and no company holding your photos.
Simon Willison shipped a new version of sqlite-utils with better support for database migrations, which is a small tool update but a signal worth noting: the serious AI builders are investing heavily in the unglamorous plumbing that makes data manageable. If you ever want to build something on top of a local model, clean data tooling is usually the part that trips you up first.
Someone fine-tuned a tiny local model, Qwen at just 0.6 billion parameters, to sort questions into categories, and it worked well enough to impress a lot of people. The practical takeaway is that you do not always need a massive cloud-based model to do something useful, which has real implications for cost, privacy, and what you can run on your own hardware.
A handful of product updates landed this week, including Claude getting better at producing shareable code artifacts and Perplexity adding persistent memory it calls Brain. The pattern is the same across all of them: AI tools are slowly getting better at remembering who you are and what you were working on, so you spend less time re-explaining yourself each session.
MCP, the protocol that lets AI agents connect to outside tools and services, is getting sharper because it handles login and authentication outside the model's view. That matters because it means the agent does not need to see your credentials to use them, which is a small design choice with real security consequences.
A team trained a model to read messy court documents and pull out structured information about human smuggling networks, the kind of slow, expensive work that currently buries investigators in paperwork. It is a good example of AI doing genuinely useful, unglamorous work where the payoff is real.
A study of 70,000 customer support conversations found that measuring how a customer sounds (happy, frustrated) tells you almost nothing about whether their problem was actually solved. For any business using AI to handle support, this is a reminder that a chatbot can make someone feel heard while completely failing them.
A new benchmark tests AI coding agents the way people actually use them, through back-and-forth conversation rather than one big task dropped in a box. If your job involves working with AI coding tools, the way those tools get measured is about to look a lot more like your real workday.
A developer laid out a practical setup for running AI coding tools at home without a big cloud bill, and 300 people on Hacker News thought it was worth their time. If you have been curious about experimenting yourself, this kind of guide is the on-ramp.
A developer published a practical guide to making AI-generated front-end code less sloppy, and 196 people found it worth bookmarking. If you have ever pasted AI-written HTML into a project and winced at the result, this is the kind of hands-on fix that actually saves you time on Monday morning.
A new benchmark was built specifically to test AI shopping assistants on multi-turn conversations, the kind where you say 'I need something for a wedding' and then 'actually it is outdoor' and then 'my budget changed.' Current models handle these real shopping conversations worse than the clean single-question tests suggest, so the gap between demo and reality is still wide.
Simon Willison's datasette-agent now lets tools pause mid-task and ask the user a question, which is a small but important step toward agents that check in rather than barrel forward. That single feature is the difference between a tool that surprises you and one you can actually supervise.
Hundreds of developers on Hacker News shared the small, personal tools they quietly built for themselves using AI, and the thread is full of genuinely useful ideas. It is a good reminder that the most practical AI story is usually the quiet one, not the headline.
Simon Willison shipped a tiny tool that runs MicroPython, a lightweight version of the Python programming language, directly in a browser using WebAssembly. It is a small release, but the pattern of shrinking AI and coding tools down so they run anywhere without a server keeps marching forward, and that eventually matters to anyone who uses web apps.
A designer wrote about replacing most of their Figma work with Claude, just describing layouts in plain language and letting the model generate the interface. If you work in any visual or creative field, this is worth reading not as inspiration but as a map of which parts of your workflow are already automatable today.
A developer ran a careful analysis of the rsync codebase and found evidence that AI-assisted contributions correlated with more bugs, not fewer. If you are using AI tools to write or review code at work, this is a concrete reminder that the output still needs a real human looking at it, not just a quick skim.
Someone fine-tuned a language model specifically to write technical documentation in the plain, direct style of 1990s software manuals, and the AI crowd found it charming and a little instructive. It is a small proof that you can steer a model toward a very specific voice or era, which has real uses if you maintain any kind of style guide at work.
Alibaba put out a free command-line tool that reviews your code automatically, and it picked up nearly 200 upvotes fast. Think of it as a tireless colleague who reads every pull request without getting grumpy about it, which matters if you do any coding at all, even occasionally.
A developer released Mnemo, a local memory layer you can plug into any LLM so it actually remembers things across conversations, stored on your own machine, not in the cloud. It is early and scrappy, but the idea of giving a model persistent memory without handing that memory to a company is worth paying attention to.
Let's Encrypt, the nonprofit that handles security certificates for a huge chunk of the web, is planning for a post-quantum future. Quantum computers powerful enough to break today's encryption are not here yet, but the locks we put on the internet today need to last for decades, so this kind of quiet, unsexy preparation is exactly the right thing to be doing now.