Who’s Afraid of Chinese Models? – Economic and Strategic Implications
Economic Overview: Inference Costs Dominate
Inference (COGS) is the key cost driver for AI services, not training R&D.
“running inference on a model … costs money, and the amount of money an AI provider spends on inference is … directly correlated to revenue.” “If it costs 50 cents to generate the tokens that drive $1 in revenue, then $100 million in revenue will have $50 million in COGS; $100 thousand in revenue will only have $50 thousand in COGS.”
Token Efficiency vs Raw Price
Token price alone does not determine cost; token efficiency matters.
“A token from one model … is not the same as a token from another model. What is fungible is what is constructed from tokens, which is to say intelligence.” “Kimi … reportedly uses significantly more tokens than Sol, rendering its price advantage moot.”
Commodity Market Dynamics
In a commodity market, the lowest marginal‑cost supplier captures profit; higher‑cost suppliers may be driven out.
“Supplier A will sell 10 units … earning $10/unit … Supplier B … earning $5/unit … Supplier C … earning $0/unit.” “Bankruptcy risk is where fixed costs come back to the forefront … the market‑clearing price approximates the marginal cost of the highest‑cost unit needed to satisfy demand.”
Current State: Supply Constraints Keep Prices High
Current high prices for frontier models stem from compute scarcity, not inherent cost advantage of Chinese models.
“Right now … demand exceeds supply for frontier models, and supply is limited by a lack of compute.” “I highly doubt that Chinese models are cheaper to serve on a marginal cost basis, they just seem cheaper because Anthropic and OpenAI are so supply constrained that they are charging far more than they would if there were sufficient supply to meet the demand for intelligence.”
Frontier Labs' Advantages Beyond Cost
Frontier labs retain advantages via token efficiency, data feedback loops, ecosystem lock‑in, and safety narratives.
“Anthropic and OpenAI likely have among the lowest costs per unit of frontier‑quality intelligence, thanks to model capability, serving scale, and token efficiency.” “whoever is running inference is also collecting data, and that data goes into making the next iteration of the model better.” “Claude Code and Codex are proving to be quite sticky; whichever harness you start working with is likely to be the one you stick with.”
China's Strategic Motives
China pushes open weights to commoditize complements and gain influence in physical industries.
“We should adhere to the principle of openness and win‑win and boost innovation‑driven development … AI is moving from the digital world into the physical world.” “Alibaba … launched a preview version of its flagship Qwen3.8 Max model … describing it as second only to Anthropic PBC’s Fable 5.”
Distillation: Benefits and Risks
Distillation gives Chinese labs a structural edge, but restricting it harms U.S. open model developers; some commenters argue for fair‑use laws.
“Chinese labs can simply use frontier labs models as teachers, allowing for rapid improvement at much lower costs.” “Western open weight model makers … end up distilling the distillation, just with a detour through Chinese labs.” “The U.S. should pass a law that (1) makes explicit that collecting data for training models is fair use, and (2) bars terms of service that forbid distillation.” Comment: “Sounds great to me; live by the sword, die by the sword.” (@aavaa)
Cybersecurity as a Genuine Concern
The only substantive risk is that restricted access to frontier models forces defenders to rely on potentially less‑secure Chinese models for incident response.
“Hugging Face … turned instead to the open‑source GLM 5.2 model from China’s Z.ai lab … to analyse the 17,000+ logs … attackers left behind.” “defenders … have a capable model you can run on your own infrastructure … vetted and ready before an incident.”
Commentary on Valuations and Market Perception
Some commenters warn that high VC valuations of Anthropic and OpenAI could collapse if price competition intensifies.
“The people who are most afraid of Chinese models are the VCs who poured into Anthropic and OpenAI at astronomically high valuations … If the frontier labs are forced to cut prices … these valuations are unjustified.” (@tristanj)
Counterpoints on Openness and Trust
Others argue that openness, not origin, determines trust, and that Chinese models are not monolithic.
“An open model can be audited, fine‑tuned, and technically run entirely on your own hardware. A closed model is basically ‘trust us.’” (@jke_kang) “There is no ‘Chinese LLM’. Each ‘lab’ is distinct and their models behavior is as unique as those from OpenAI and Anthropic.” (@alizaki)
Sources
Related
- Dispatch
- Dispatch
- Dispatch
- Dispatch
- Dispatch