Note: This is a re-post of my LinkedIn article.
I didn’t know it would cost this much!
I had a recent conversation with one IT Director who had an intern burn their entire monthly quota of ChatGPT credits in 2 days. An angry, C-suite executive called him complaining that ChatGPT wasn’t working anymore. He had to quickly upgrade the plan to keep things going.
These stories are common, but they don’t have to be. I keep hearing people and companies exclaiming about the costs of their AI models. Most harnesses like the Codex app from OpenAI, Hermes Agent, or Claude Desktop are free – the models are where almost all of the cost lies.
Avoid Vendor Lock-In
This is the same old tale of vendor lock-in that the IT industry has dealt with for years. You pick a vendor (VMware, Microsoft, OpenAI, whatever), get your discounts, and build your IT processes around them. It’s a mistake. It’s also a mistake to not consider open source, or in the world of LLMs, open-weight models. Things are moving fast, adaptability is key!
I’ve been using OpenClaw and Hermes Agent for many months now. It’s not to generate revenue and no one is sponsoring me, it’s for learning and hobbies. That means costs need to be very low. What I’m doing at home is what anyone and even any company can do as well. Let’s take a look at proprietary models and their open weight/value competitors:

Here’s the takeaway: After 30 days, operating costs dropped 87% and output quality only fell 4% on average – same revenue. That’s HUGE!
What About Data Theft
Here’s the #1 concern I hear, “I’m afraid of data theft or the Chinese companies training on my data.” Yes, real concern for companies but it’s easily addressable.
Many providers have configurable options for ZDR (Zero Data Retention) and to exclude your requests from being trained on. You can get most of these models under your existing company agreement with AWS or Azure, in fact. Both platforms have very strong guardrails that can be configured. Here’s a screenshot of my guardrail configuration for my health agent:

Some platforms that offer these models simply enable ZDR automatically. Here’s a snippet from OpenCode’s Privacy page:
The plan is designed primarily for international users, with models hosted in the US, EU, and Singapore for stable global access. Our providers follow a zero-retention policy and do not use your data for model training.
So, it’s not in China, not training on your data, and your data has zero-retention policies applied to it. Same kind of things are configurable on other platforms.
Balance It Out
You don’t have to pick one or the other. I have the ability to switch to Claude Sonnet or Opus at any time for certain tasks. It’s been a long time since I’ve had to but if my agent is stuck in a loop or just making too many mistakes, I can always pay-as-you-go on a Claude model.
The important thing is to use a tool that allows this. I use Hermes Agent as my daily driver; others have configured Claude Desktop to be able to do it (might break at any update) or use something like Goose or OpenWebUI – there are dozens of front ends.
Skip the manual switching entirely by using an LLM router/gateway. I’ve mentioned Manifest previously but recently Routerly caught my eye. Routerly has built-in smart routing and you can host it on-premises so your data stays yours.
Dismissing the open source (e.g., MiMo), open weight (e.g., Kimi, GLM) and low cost (Qwen is proprietary but it’s cheap) models is just costing you unnecessarily. Just because they don’t have the ad spend, US presence, and sales reps bugging you doesn’t make them less good. I’m almost exclusively using these models for coding, planning, writing, researching, and pretty much everything else we all use agents for today.
If you’ve tried the most recent versions of these models, what do you think? Are they on par with ChatGPT/Codex and Claude?







