Skip to main content
Let's discuss Tech - Join our Community
Let's discuss Tech - Join our Community
A developer typing on a laptop with a code editor open
Cheaper capable coding models change who can afford to build with them.
Technology

An Open-Weight Coding Model Rose Sixfold Without New Pretraining

Z.ai's GLM-5.3 reuses the exact 743-billion-parameter base of its predecessor, and the entire capability jump came from post-training rather than a new pretraining run.

Will Lisil|Director & Digital Creator
6 min read

In Brief

Z.ai's GLM-5.3 improved from 4.6% to 28.3% on Terminal-Bench 3.0 using the same 743B base as GLM-5.2, with no new pretraining. It trails GPT-5.6 Sol and Claude Fable 5 on the hardest coding benchmarks but leads on AutomationBench and CyberGym, at far lower cost. Weights are expected in late August.

The most expensive thing about building a frontier language model is the pretraining run. It is the part that needs a data centre, a nine-figure budget and months of uninterrupted compute, and it is the reason the list of organisations that can build one is short. So the most interesting number attached to Z.ai's GLM-5.3, released on 14 August, is not a benchmark score. It is that the model skipped that step entirely.

GLM-5.3 reuses the exact same 743-billion-parameter mixture-of-experts base as GLM-5.2, with roughly 40 billion parameters active per token. No new pretraining. Every gain came from scaled post-training. On Terminal-Bench 3.0, one of the harder agentic coding evaluations, the result moved from 4.6% to 28.3% — a sixfold jump on a frozen base. For anyone tracking whether an open-weight coding model can stay in touch with the closed frontier, that is a more consequential fact than any single score.

Truth in Technology, Delivered by MW3.BIZ

Join thousands who trust us for unbiased insights on AI, blockchain, and the future of tech

By subscribing, you agree to our Terms and Privacy Policy.

What Changed Without a New Base Model

Z.ai attributes the improvement to expanded training environments and longer reinforcement-learning runs on top of the frozen base, using its IndexShare and Scalable Agentic Optimization methods and the slime framework. In plain terms: the underlying knowledge did not change, but the model's ability to plan, use tools and recover from its own mistakes across a long task did.

That distinction matters commercially. If capability gains of this size can come from post-training, then the barrier to producing a competitive coding model drops from "own a data centre" to "own a good training environment and the patience to run it". The base model becomes infrastructure that can be improved on repeatedly, rather than a one-shot bet.

The gains were not confined to one benchmark. Per Qubrid's breakdown of the release, DeepSWE v1.1 rose from 46.2% to 66.9%, SWE-Marathon v1.1 from 19.4% to 42.5%, and AutomationBench from 26.2% to 48.2%. On the security side, ExploitBench more than doubled, from 24.4% to 54.4%.

The Numbers Z.ai Is Claiming

Alongside the jumps, GLM-5.3 posts 88.2% on Terminal-Bench 2.1, 78.1% on FrontierSWE, 58.0% on NL2Repo and 73.0% on Toolathlon Verified. On the agentic GDPval-AA v2 evaluation it scores 1,769 Elo, up from 1,508.

One caveat should travel with all of those figures: with the exception of GDPval-AA v2, they are vendor-run. That is normal practice for model launches across the industry, and it is not evidence of anything improper, but a self-reported score is a claim awaiting replication rather than a settled result. The independent number in the set — GDPval-AA v2 — happens to be one where GLM-5.3 leads Moonshot AI's Kimi K3, 1,769 Elo to 1,668.

Throughput is the quieter advantage. Artificial Analysis measures GLM-5.3 at 115 tokens per second, against 40 for Kimi K3. For an agent looping through a long refactor, sustained speed compounds into wall-clock time in a way a single benchmark row does not capture.

Where It Still Trails the Closed Frontier

It would be a misreading to call this parity. On Terminal-Bench 3.0, GPT-5.6 Sol leads at 34.6% and Claude Fable 5 at 33.7%, with GLM-5.3 at 28.3%. On DeepSWE the order is the same: 72.7%, 69.7% and 66.9%. On ExploitBench the gap is wide, with Claude Fable 5 at 78.0% and GLM-5.3 at 54.4%.

Moonshot AI is candid about the same gap for its own model. In the Kimi K3 release notes — a 2.8-trillion-parameter mixture-of-experts model with a one-million-token context, whose weights went out in late July — the company writes that while overall performance "still trails the most powerful proprietary models", the model demonstrated frontier-level performance. Both labs are describing the same shape: close on many axes, behind on the hardest ones.

There are also two narrower leads worth recording, because they are the ones a security-minded team will care about: GLM-5.3 tops the comparison on AutomationBench at 48.2% and on CyberGym at 84.5%, ahead of both closed models on those two.

The Cost Gap Is the Real Story for Small Teams

Capability decides what is possible. Price decides who gets to try. Z.ai's coding-plan subscriptions start at $12.60 a month on annual billing for the Lite tier, with Pro at $56 and Max at $117.60. Per-token pricing for GLM-5.3 had not been published at launch; the public table still ends at GLM-5.2, at $1.40 per million input tokens and $4.40 per million output.

Set that against Kimi K3's published API rates of $3.00 per million cache-miss input tokens and $15.00 per million output tokens, and the spread within the open-weight field alone is several-fold. An independent head-to-head by Composio put both models at seven of twelve tasks solved on its agentic evaluation, with per-case costs of roughly $0.89 to $1.50 for GLM against $1.83 to $5.25 for Kimi — comparable outcomes, materially different bills.

Token efficiency points the same way. On Z.ai's internal code evaluation, GLM-5.3 reached 31.4% accuracy using around 50,000 output tokens, where Claude Opus 4.8 reached 29.5% using 120,000. Treat the accuracy figures as vendor-reported, but the token ratio is the number that shows up on an invoice at the end of the month.

From a technology-democratization perspective, this is the part that matters most to us at MW3.biz. A capability that only exists behind the highest price tier is, in practice, available to a small number of well-funded teams. The same capability at a tenth of the cost — with weights that can eventually be run on your own hardware — is available to a student, a two-person startup, or a developer in a country where frontier API pricing is simply out of reach. We would not tell anyone the closed models are the wrong choice; they lead several of the benchmarks above on merit. Our view is that the gap closing from below is how capability actually reaches people, and it deserves attention when it happens.

Open Weights, With an Asterisk

The phrase "open weight" is doing real work in this story, and it needs qualifying. At launch, GLM-5.3's weights were not released. They are staged behind roughly a two-week safety evaluation, which puts the expected drop in late August. Until then the model is API-available and, functionally, proprietary.

The licence is also unsettled. GLM-5.2 shipped under MIT, which is about as permissive as it gets, but Z.ai has not published GLM-5.3's terms, and its predecessor's licence does not establish them. There is no checkpoint, tokenizer, quantisation specification or hardware guidance yet either, so self-hosting is not currently a question anyone can answer.

This is worth flagging plainly, because "open" has become a marketing word as much as a technical one. The honest status today is: one open-weight model you can actually download and run (Kimi K3, and GLM-5.2 before it), and one that has announced an intention to become one. Builders planning around the second should plan for the announced date to move.

What a Solo Builder Should Actually Do Now

The practical advice is unglamorous. Do not migrate a working pipeline on the strength of a launch-day benchmark table, particularly a vendor-run one. Do run your own evaluation on the tasks you actually repeat, because the published numbers cluster around agentic coding and security work, and if that is not your workload the ranking may not survive contact with it.

Two operational details will catch people out. GLM-5.3 introduces a breaking API change: reasoning cannot be switched off, and the minimum setting is a low reasoning effort rather than none. And if your plan depends on self-hosting, wait for the actual weights and licence rather than the announcement of them.

The wider trend is the one to plan around. Cost pressure has been pushing small teams toward infrastructure they control for a while now, and readers who followed our reporting on what record SaaS inflation is doing to build-versus-buy decisions will recognise the pattern. A capable open-weight coding model that runs on your own hardware turns that from a cost argument into an architectural one — but only once the weights are genuinely in your hands.

Tags:#open-weight coding model#GLM-5.3#Kimi K3#agentic coding#open source AI#AI coding tools#Z.ai#Moonshot AI
Keywords:open-weight coding modelGLM-5.3Kimi K3Terminal-Benchagentic coding

Key Takeaways

  • GLM-5.3 reuses GLM-5.2's exact 743B mixture-of-experts base with no new pretraining; the entire gain came from scaled post-training.
  • Terminal-Bench 3.0 rose from 4.6% to 28.3%, with DeepSWE v1.1 up from 46.2% to 66.9% and ExploitBench from 24.4% to 54.4%.
  • It still trails GPT-5.6 Sol and Claude Fable 5 on Terminal-Bench 3.0, DeepSWE and ExploitBench, while leading on AutomationBench and CyberGym.
  • All benchmarks are vendor-run except GDPval-AA v2, the one independent evaluation, where GLM-5.3 leads Kimi K3 by 1,769 Elo to 1,668.
  • The weights were not released at launch and the licence is unpublished; open weights are expected in late August, so self-hosting plans should wait for the actual files.

Frequently Asked Questions

It means Z.ai did not run a new pretraining pass, the most expensive stage of building a model. GLM-5.3 sits on the identical 743-billion-parameter base as GLM-5.2, and all of its capability gains come from post-training: expanded environments and longer reinforcement-learning runs on frozen weights.

Not yet. At launch the weights were held back behind a roughly two-week safety evaluation, with release expected in late August. No licence has been published for GLM-5.3, and GLM-5.2's MIT terms do not automatically carry over. Until the files ship it is API-available and effectively proprietary.

It trails on the hardest coding benchmarks: GPT-5.6 Sol leads Terminal-Bench 3.0 at 34.6% and Claude Fable 5 at 33.7%, against GLM-5.3's 28.3%. It leads on AutomationBench at 48.2% and CyberGym at 84.5%. Most of these figures are vendor-run and should be treated as claims pending replication.

Because price decides access. Z.ai's coding plans start at $12.60 a month on annual billing, and an independent Composio comparison found per-case costs of roughly $0.89 to $1.50 against $1.83 to $5.25 for Kimi K3 at comparable success rates. Similar capability at a fraction of the bill widens who can build with it.

Run your own evaluation first. The published results concentrate on agentic coding and security tasks, so they may not predict performance on your workload. Also note a breaking API change: reasoning cannot be disabled, with a minimum low reasoning effort setting.

Sources

  1. Qubrid AI - GLM-5.3 Benchmarks, Architecture and Pricing(accessed 2026-08-25)
  2. Moonshot AI - Kimi K3 Tech Blog: Open Frontier Intelligence(accessed 2026-08-25)
  3. Composio - GLM 5.2 vs Kimi K3 head-to-head evaluation(accessed 2026-08-25)