Synthesis — LLM Providers
The evolving thesis. Spun out of the hub _inbox llm-providers cluster on 2026-06-01, seeded
by deepseek-api-docs and grown with three landscape sources the router went and found
(open-weight roundup, API-pricing comparison, the llm-stats leaderboard).
Current thesis
The 2026 model market is defined by a collapsing price floor meeting a still-premium frontier, with open weights as the force pushing the two apart.
- A ~600× cost spread (llm-api-pricing): budget APIs at ~$0.10/1M input vs frontier reasoning at $30/$180. deepseek disrupted the bottom — capable open weights plus an OpenAI-compatible ultra-cheap API — dragging the floor down and forcing proprietary labs to justify their premium. On 2026-09-22 the proprietary labs cut too (opus-and-sol-and-luna-willison): GPT-6 Sol $2/$10 and Luna $0.10/$0.50 halve their GPT-5.6 predecessors, and Opus 5.5 takes 20% off Opus 5. The lists now match across labs at three points ($2/$10, $4/$20, $10/$50), so the premium the labs defend is no longer visible in price.
- Open-weight has caught up enough for production (open-weight-models): Llama 4, Qwen3, gemma-4, DeepSeek, Kimi, GLM. Two structural enablers — sparse MoE (frontier capability at practical inference cost) and Apache-2.0/MIT licensing clarity — plus a context explosion (256K → 1M → 10M tokens), and now multimodality at the local tier: gemma-4 12B runs encoder-free vision + native audio on 16GB (gemma-4-12b-announcement), making memory footprint a competitive axis alongside capability/cost/context. quantization is the second footprint lever (after sparse MoE): Gemma 4's QAT checkpoints push the floor to a sub-1GB E2B and a 2-bit mobile scheme, claimed above PTQ quality gemma-4-qat — footprint is now contested by training technique, not just architecture. ternary-weights takes that one step further (2026-08-02): neutrino-1 claims an 8B-class model at 2.56 GB download / 3.88 GB on disk with weights trained in a ternary format rather than quantized into one, so there is no float model anywhere in its lineage. If it holds, footprint stops being a treatment applied to a model and becomes a property of it — but every number supporting it is first-party and the method is unpublished. A fourth lever appeared on 2026-08-26: Qwen3.8-Flash-Next carries 51B N-gram embedding parameters that are addressed deterministically and can live in host memory, on top of a 125B-total / 6B-active MoE backbone. Sparse MoE separated total from active parameters; this separates stored capacity from the per-token matrix-multiply entirely, and Qwen prices the result at $0.15/$0.47 per 1M.
- "Best model" is multi-axis (llm-benchmarks): composite scores over capability × speed × price × context. Proprietary labs (anthropic, OpenAI) still lead reasoning; open/Chinese labs (Qwen, DeepSeek) lead cost-per-quality; xAI leads context — and with Grok 4.5 now also contests cost-per-quality from inside the closed frontier (grok-4-5-price-vs-benchmarks). A sharper cost axis emerges from that source: cost-per-task = per-token price × tokens-per-task, so a token-efficient model can be cheaper in practice even at a higher sticker rate (and vice-versa — Fable 5 is both pricey per token, $10/$50, and no cheaper per task).
The unifying tension: capability still concentrates at a few proprietary frontier labs, while cost and access are being democratized from below by open weights. Whether the frontier premium holds depends on whether open-weight reasoning closes the gap — the live question of the wiki.
Open weights have a third face (2026-07-26): the behaviour is editable too. The wiki has read open weights as licensing (who may run it) and footprint (who can afford to). abliteration adds a lever the license grants without naming: gemma-4-31b-it-scotoma is Gemma 4 31B-it with its refusal behaviour surgically weakened in layers 7–41 and republished under Google's own Apache-2.0. Alignment shipped as weights is alignment shipped as something a third party can rewrite in an afternoon and redistribute on the same terms. The contrast with the closed tier is exact: a Claude refusal arrives as an HTTP 200 you can route around but never delete (claude-refusals-and-fallback). And the instrument doing the cutting is Anthropic's own Jacobian lens — an interpretability tool built for auditing models, pointed at modifying one.
The provider map now sorts into five positions plus a reseller layer. The market is no longer a simple open-vs-closed binary; the players cluster by strategy:
- Consumer frontier (closed): openai (GPT/o-series; the API shape everyone else clones) and anthropic hold the reasoning lead and the $30/$180 premium. xai-grok sits here too — proprietary, reasoning-focused — distinctive for a 2M-token context (the "xAI leads context" claim) and an open→closed arc (Grok-1 was Apache-2.0; everything since closed), the inverse of the open-first labs. But Grok 4.5 (mid-2026) breaks the premium framing (grok-4-5-price-vs-benchmarks): at $2/$6 it prices below the whole field and runs the China playbook — good-enough benchmarks, win on cost-per-task (xAI claims 4.2× fewer tokens than Opus 4.8). A closed US frontier lab adopting the price-floor strategy is new, and it blurs the "premium frontier vs cheap challengers" split the thesis rests on.
- Open-weight challengers: qwen (Alibaba) is the strongest evidence open weights are closing from below — the deepest open model ladder (0.6–32B dense + MoE; reasoning/VL/audio/Coder/omni), mostly Apache-2.0, 200k+ Hugging Face derivatives, and open-first (unlike dual-track google) — alongside deepseek, Meta's llama (the family that catalyzed the wave), and Z.ai, whose GLM-5.2 (MIT, 753B-A40B MoE, text-only) became the #1 open-weight model on artificial-analysis in June 2026 — the lead in the open field is no longer DeepSeek/Qwen alone. InternScience's Agents-A1 (late June 2026, Apache-2.0, 35B MoE on Qwen3 lineage) joins as an agentic challenger claiming trillion-parameter-class agentic performance by training technique, not scale (self-reported).
- US open-weight, customization-as-product (new, 2026-07): Thinking Machines Lab shipped Inkling (Apache-2.0, 975B-A41B multimodal MoE, 45T tokens, 1M ctx) while saying outright it is "not the strongest overall model available today, open or closed" inkling-announcement. That is a position no one else on this map holds. It doesn't compete on the capability × price × context board at all: the weights are free, the pitch is a base you fine-tune, and the money is one layer up on Tinker, its fine-tuning platform. Where google gives away gemma-4 to seed mindshare for a paid gemini frontier, Thinking Machines has no frontier tier to seed — adaptation is the product. It also fills a geographic hole: per Willison inkling-willison-review, the US open-weight bench is now Inkling + NVIDIA Nemotron + Gemma 4, and Inkling is the only one from a company whose open weights are the strategy rather than a side-bet. Note the seam with mistral-ai's Forge below — two labs converging on training-as-a-service over their own open weights from opposite directions.
- European open-weight → sovereign platform: mistral-ai (Apache-2.0 Mixtral MoE) — the open axis is no longer China-only. Its mid-2026 site (mistral-platform) shows the position evolving up-stack: from a model lab to a sovereign, EU-hosted full-stack platform (agents Vibe / Vibe for Code, Studio, custom-training Forge, dedicated Compute; self-hosted / EU-cloud / partner deployment). That collapses the gap to the enterprise/sovereign row below — Mistral reaches the same data-residency play as cohere but from the open-weight side, so "European open-weight" and "sovereign enterprise" are becoming one position, not two.
- Enterprise / sovereign: cohere competes not on consumer reach but on data residency and compliance (private cloud, on-premise, regional EU/APAC/UK) for regulated industries — the founders' Transformer-paper roots (Aidan Gomez) behind an early "same architecture, different deployment model" bet. Crucially its North Mini Code (9 Jun 2026, the first North-family model) is Apache-2.0 open-weight (30B MoE / 3B active, runs on a single H100): Cohere pursues sovereignty through open weights and local deployment, so it sits on the open-weight axis too, not opposite it — the sovereign angle is go-to-market, not licensing. It scores 33.4 on the independent artificial-analysis Coding Index, opening a developer-coding play on top of the enterprise base.
- Dual-track: google ships both a closed frontier (gemini) and permissive open weights (gemma-4) — see Recurring reads.
Llama also sharpens the licensing thread: open-weight but not OSI-open (custom community license, OSI-disputed), against the Apache-2.0 cleanliness of gemma-4/mistral-ai/qwen — "open" is a spectrum, not a binary. Across the top sits a cloud-reseller layer: amazon-bedrock is not a model maker but a one-API aggregator of Claude/Llama/Mistral/Cohere/Nova — the demand-side mirror of the map, where model choice becomes a config parameter and differentiation moves up to routing/caching/data. Through a reseller, open and closed models are the same API call; the buyer meets the whole price/openness spectrum through one pane.
That layer has a second, self-hosted shape: the ai-gateway you run yourself. omniroute (MIT, ~30K stars) fronts a claimed 290+ providers from a process on your laptop, cascading from subscription seats down through cheap providers to free ones as each quota dies, and it pushes the demand-side logic past routing into two levers the reseller never offered — client-side prompt compression (12 stacked engines, 15–95% claimed) and free-tier aggregation (~1.53B tokens/month pooled across 43 provider free tiers). Both are unilateral: neither needs the provider's agreement, and the second arguably runs against its interest, which is why the project itself flags 15 of those pools as ToS-questionable. The reseller commoditized model choice; the local router commoditizes the provider's generosity.
Recurring reads
- Compatibility as strategy — challengers (deepseek) conform to OpenAI-compatible (and now Anthropic-compatible) API shapes to erase switching costs; the incumbent API is becoming a de-facto standard.
- Cost is dominated by output tokens (2–6× input) and slashed by caching/batch/routing — so
engineering, not just model choice, sets real cost. The caching lever cuts twice over:
Anthropic's cache-aware ITPM (claude-api-rate-limits) means cached input tokens don't
count toward the rate limit, so prompt caching raises effective throughput (a 2M ITPM limit at
an 80% hit rate processes ~10M tokens/min) on top of the ~90%-off read price — the engineering
lever now buys headroom, not just discount. Model routing is now a first-class
API primitive, not just app glue (claude-refusals-and-fallback): Anthropic ships
server-side
fallbacksthat retry a safety-declined request down a model chain (fable-5 → opus-4.8) inside one call, with per-attempt billing (usage.iterations[]), afallback-creditbeta to avoid double-paying prompt cache, and sticky routing that pins a conversation to whoever accepted. The "engineering sets real cost" thread hardens into the provider's own surface — and note refusals are an HTTP 200, invisible to error-rate monitoring. - Dual-track labs — google ships both a closed frontier (gemini) and a permissive
open-weight family (gemma-4), unlike the open-only Chinese labs or closed-only frontier labs.
Open weights double as developer-mindshare seeding, not just a product. The May 2026 roundup
google-ai-updates-may-2026 adds a wrinkle: both tracks are now pitched at the same
use-case — agents and coding (Gemini 3.5 "frontier intelligence for agents and coding"; Gemma 4
12B "agentic workflows"). The open/closed split is about licensing and footprint, not target
workload — a lab can run one agent-and-coding pitch across the whole price/openness spectrum.
Q2 2026 earnings (alphabet-q2-2026-earnings) add the usage-scale dimension both prior roundups
lacked. The story stops being only which model and becomes how much volume: ~22B tokens/minute
across Google's APIs (up ~38% Q/Q from ~16B), a 950M-MAU Gemini app, 9M+ developers, and
~900M Gemma downloads — the dual track measured on both rails at once (closed tokens +
open downloads). The model side widened too: a full cost-tier ladder (Gemini 3.6 Flash / 3.5
Flash-Lite) plus the first domain-specialized Gemini (3.5 Flash Cyber, "comparable to larger
models") and Gemini 4 in pre-training — so the provider is now differentiating by tier and vertical,
not just a single frontier number. All company-reported (T1 provenance, unaudited here); the durable read
is that the market's growth axis is now consumption volume, the demand-side complement to the output-token
cost thread. Cross-spoke: Cloud +82% / $514B backlog / TPU 8t-8i / Axion / the million-accelerator
Virgo Network (
../cloud-wiki), AI Mode past 1B MAU merged with AI Overviews (../search-marketing-wiki), and ADK ~70M downloads / Gemini Enterprise in ~90% of the Fortune 100 (../agentic-tooling-wiki) are logged there. The open rail has a shape the closed one doesn't (2026-08-20, awesome-gemma). Counting models rather than downloads: Gemini is a handful of tiers sold by the token, while Gemma is a base plus 16 first-party domain forks — MedGemma, TxGemma, TranslateGemma, VaultGemma, ShieldGemma, Gemma Scope and the rest (gemma-variants) — given away. Several are built on Gemma 2 or 3, so three generations are live at once and the variants are not re-based each release. Two are research instruments rather than products. The dual track is therefore not one strategy run at two license terms: the closed side differentiates by price tier, the open side by domain, and only the closed side is a product line in the ordinary sense.
Generative-media sub-theme (watch for spin-out)
The gemini line now has sourced generative-media tiers with their own pricing units, not just
$/token: Nano Banana 2 Lite (text-to-image, $0.034/1k images,
~4 s) and Gemini Omni Flash (video, $0.10/sec, Veo-3.1-Fast parity, 10 s max). This is a distinct
modality from the text/multimodal LLMs at the spoke's core — and a parallel to how audio-gen was
carved out to ../speech-audio-wiki. For now it stays here as part of the Gemini family; if non-Google
image/video-gen sources accumulate (≥3), a dedicated generative-media spoke is the spin-out candidate.
Logged so the cluster is visible rather than buried.
Source 2 — and the first non-Google one (2026-07-22). mage-flow-turbo is Microsoft's MIT-licensed 4B text-to-image model (rectified flow matching, 4-step distilled, native 512–2048px), claiming 0.59 s per 1024² image on an A100 and parity-or-better against Qwen-Image 20B / Z-Image 6B / FLUX.2 32B. It moves the sub-theme in two ways. It splits the modality along the same open-vs-closed axis the text market runs on — Google's image tier is priced per image, this one is weights you download, so the generative-media cluster now has both a hosted-API instance and an open-weight one, and only the first has a price. And its argument is the spoke's own recurring one, one modality over: 4B beating 20–32B is agents-a1's "not by scale" claim in image form, bought with tokenizer–backbone co-design and step distillation instead of agent horizon. Same T3 caveat as A1: first-party card, first-party comparison set, no independent re-run — and the corpus still has no artificial-analysis equivalent for image models, which is the missing referee for this whole sub-theme. Cluster now at 2 of 3.
Source 3, and the trigger is met (2026-09-10). studio-1939-lora is a third-party style LoRA for a video model — two ranks over minimax-h3, trained on frames from one public-domain 1939 animated feature, served through fal's standard LoRA endpoints. It is the first generative-media source here that is neither a provider's hosted tier nor a lab's open weights, but somebody else's modification of somebody else's model, which is the open-weight argument finally showing up one modality over. It also brings the sub-theme's first workflow numbers rather than model numbers: 261 shots in 28 minutes for one 8-minute film, 108 in 21 for another, and character identity held across scenes by repeating a frozen description verbatim rather than by conditioning on a reference image. T3 — a creator's card, no comparison, nothing independently run.
The cluster is now at 3 non-Google-plus-Google sources across image and video, which is the spin-out condition this section wrote for itself. Recording it rather than acting on it: creating a generative-media spoke moves pages and is a structural change, and the last several spin-outs were the curator's call. What is now true is that the trigger fired, and that the three sources cover three different layers (hosted tier, open weights, third-party adapter), which is a healthier founding corpus than three of the same kind would be. Still missing, and it was the gap named at source 2: no artificial-analysis equivalent for image or video models — the referee this whole sub-theme lacks.
Open questions
- What is a capability claim worth when the artifact is checkable but the model isn't? (opened 2026-08-03)
Every model page in this wiki rests on numbers the vendor produced and nobody outside can re-run — the
standing complaint behind the benchmark tensions below. astra breaks the pattern in an unexpected
direction: OpenAI introduced its unreleased next model in a mathematics paper, and shipped
ten machine-checkable Lean proofs with it (
../research-wiki: ten-proofs, lean-certificate). A stranger can verify the mathematics on a laptop with no access to the model. What that stranger cannot verify is anything about Astra — not how many attempts the proofs took, not how much human steering went in, not that a shipped version behaves comparably. So the field now has a claim shape where the output is falsifiable and the capability still isn't, which is better than a vendor eval table and is not the same as a benchmark. Watch whether other labs copy the form (verifiable artifacts alongside announcements) or whether it stays confined to domains with formal checkers — mathematics and program verification, and very little else this wiki tracks. The related tell: Astra's one published quantity, ~$2,000 of tokens, is priced at Sol rates, so even the cost figure is denominated in a different model. Updated 2026-09-05, and the update makes the question worse rather than better. Astra is now on the API at $10/$50 per million (astra-pelican-grid, simon-willison, T2), which retires the denominated-in-another-model tell — the same volume costs $3,300–$4,000 at its own card — and leaves the harder half untouched. A month after the mathematics announcement, the model is purchasable and the only outside evidence about it is one person's grid of SVG pelicans, judged by eye. No system card, no independent benchmark, no third party running the ten problems against the shipped endpoint — an experiment that is now merely expensive rather than impossible. So the claim shape has not spread and has not been tested; it has simply gone on sale. Note also what the first outside contact was: not an eval suite but a hobbyist probe, which is what the market actually produces in the first 24 hours, and which this wiki should keep grading T2 for what it is — a comparison somebody ran across four models they did not build, with costs published and failures shown — while never mistaking it for a measurement. - How long do the free tiers survive being pooled? (opened 2026-07-26) A free tier is a marketing cost the provider prices against expected casual use. omniroute and its class turn 43 of them into a single ~1.53B-token/month budget with automatic failover between them, which is a different product than the one each provider thought it was giving away. Either the pools shrink and get fingerprinted (per-key heuristics, gateway detection), or free access stops working as an acquisition channel at all. The project's own "15 providers ToS-flagged so you decide" is the tell that this is already contested. No data yet on whether any named pool has tightened in response.
- Does compression become a provider feature or stay client-side? Prompt compression is currently something a gateway does to a provider — omniroute claims 15–95% fewer tokens billed. Providers already sell the cooperative version (prompt caching), which pays them; the adversarial version doesn't. Watch whether the labs answer with cheaper caching or with terms against it.
- What is a safety claim worth on a downloadable model? (opened 2026-07-26) google releases Gemma 4 with a refusal posture; ReadyArt republishes it with that posture edited and the Apache-2.0 license intact. The lab's alignment work survives exactly as long as nobody bothers to remove it, and the removal is a weight merge, not a retrain. Two things to watch: whether open-weight licenses start carrying behavioural terms (they can't be enforced on weights already downloaded), and whether labs shift safety into things an editor can't reach — pre-training data, or serving-side classifiers that only exist on the API. Note the one honest complication in the founding source: scotoma's own card says it "refuses basically as much as its base model," so the edit may be less powerful than the framing. No evals either way — that's the gap.
- Does the frontier premium survive? If open-weight reasoning (DeepSeek/Qwen) closes on
Anthropic/OpenAI, the $30/$180 tier loses its moat. Watch llm-benchmarks over time. Latest data
point (2026-06-18): GLM-5.2 tops the open-weight artificial-analysis index and sits
#2 to Claude Fable 5 on Code Arena WebDev at ~1/5 the price — the closest an open model has come to the
closed coding lead. The standing caveat: it's token-hungry (~43K output tokens/task), so the cheap
per-token rate overstates the real-cost gap — the "output tokens dominate cost" thread cutting the other
way. Same caveat hits Sonnet 5 (2026-06-30): its prompting guide
notes a new tokenizer emitting ~30% more tokens for the same text, so the headline per-token price
understates real cost relative to 4.6 — token-accounting, not just rate, sets the bill. The effort
parameter cuts the other way: medium on Sonnet 5 ≈ high on Sonnet 4.6, so you can buy the old
intelligence tier at a lower effort/token setting. Net cost depends on which lever dominates per
workload. New angle (2026-06-30): the squeeze now also comes from inside the frontier labs.
Claude Sonnet 5 is pitched as performing close to Opus 4.8
at the Sonnet price ($3/$15 standard, $2/$10 introductory), with safety hardening and an explicitly
agentic design. A lab compressing its own mid-tier toward the flagship erodes the $30/$180 premium
without any help from open weights — and feeds the agentic-tooling thesis that "Sonnet + harness beats
raw Opus." Vendor-reported (HLE 43.2% / 57.4% w-tools, OSWorld-Verified 81.2%, SWE-bench Verified
85.2% per the system card); awaits an independent
artificial-analysis re-run. Caveat from the system card: Anthropic itself says Sonnet 5
"trails our Opus and Mythos-class models" on almost all benchmarks, so "close to Opus" is a
price-adjusted claim, not parity — the premium is squeezed, not erased. The card also discloses a
model class above Opus, "Mythos" (Claude Mythos 5), treated as Anthropic's current capability
frontier — the proprietary ladder has a rung the public market hasn't priced yet. New mechanism
(2026-06-30): Agents-A1 adds a third way the premium could erode — neither cheaper
tokens nor a flagship squeezing its own mid-tier, but training technique: a 35B open-weight MoE
claiming frontier-class agentic scores (GAIA 96.0, IFEval 94.8) by multi-teacher domain distillation
- long agentic horizons rather than scale. Self-reported (T3), so it awaits an artificial-analysis re-run; if it holds, "frontier agentic behavior at mid-size open weights" is the strongest version of the closing-from-below thread yet. Strongest data point yet, and it's the lab's own (2026-07-24): Opus 5 ships at $5/$25 — the exact price of Opus 4.8 — while Anthropic claims it more than doubles 4.8 on Frontier-Bench and lands within 0.5% of Fable 5 on CursorBench 3.2 (claude-opus-5-announcement). A generation of claimed capability at a flat rate is the intra-lab squeeze running a second time, one rung higher: after compressing the mid-tier toward the flagship with Sonnet 5, Anthropic now compresses the flagship toward its own premium tier and markets the compression as the product ("close to Fable 5 at half the price"). The premium isn't being competed away from below so much as discounted from inside. Two corrections to earlier readings: the proprietary ladder's top rung is not what the system card implied — Mythos 5 now reads as a domain specialist (ahead only on cybersecurity and biology research, "substantially behind" Opus 5 elsewhere), so the unpriced rung above Opus is narrower than assumed; and the pitch is stated almost entirely as cost-per-task ratios with no absolute scores, which is the cost-per-task frame becoming the vendor's default unit of self-description. The strongest closing-from-below data point yet, with a catch in the licence (2026-07-28, kimi-k3). Moonshot's K3 ships 2.8T/104B-active weights publicly and posts a split decision against the current flagships rather than last generation's: ahead on GPQA Diamond (93.5 vs Opus 4.8's 91.0), SWE-Marathon (42.0 vs Fable 5's 35.0), BrowseComp and Video-MME; behind on DeepSWE (67.5 vs 70.0). Trading wins with the closed frontier — not approaching it — is a harder data point than glm-52 or agents-a1, and the benchmark table is unusually candid about its confounds (different harnesses per model, a modified SWE-Marathon branch, and a note that Fable 5 hit fallbacks on 35% of tasks in their run, which would have hurt the rival's score). Still first-party; awaits artificial-analysis. The catch is that the terms tightened as the capability closed. K2.6 was Modified MIT; K3 ships a bespoke licence that is MIT-shaped except for a Model-as-a-Service revenue threshold (US$20M / 12 months) requiring a separate commercial agreement — structurally Llama's move, gating the clouds and API resellers rather than users (open-weight-models). So the answer to this question is becoming two-sided: capability is being competed away from below faster than the openness is. The open-weight wedge stays sharp on price and access, while the leading open labs quietly reserve the serving business for themselves.
- Is caching efficiency an intra-lab cost axis? A T4 practitioner anecdote
(Njenga, 2026-07) times a single
"Hello"in Claude Code and finds Fable 5 costing $0.4745 vs ~3.2× less on Sonnet 5 — because Sonnet read more from cache (24.8k vs 15.6k tokens) and cache reads bill below fresh input. If it holds, two models from the same lab diverge on real cost through how well each caches a session, not just their sticker rates — the llm-api-pricing caching lever operating within a provider. But it's one unrepeated run behind a paywall, and it cuts against Fable being the fast, coding-strong pick (Code Arena WebDev leader), so treat it as a flag, not a finding. Corroborated on the sticker side (2026-07-08): The Decoder's Grok-4.5 comparison (grok-4-5-price-vs-benchmarks) lists Fable 5 at $10/$50 — ~3.3× Sonnet 5's $3/$15, matching Njenga's ~3.2×. So the gap is at least partly a list-price difference, not only caching — Fable 5 is genuinely the dearer model. That reframes the "fast/cheap" expectation: Fable 5 may be a premium creative/coding tier, not a budget one. Third read (2026-07-09): Hassid's buyer's guide (dont-use-fable-5-hassid) again lists $10/$50, so three independent third-party sources now agree on the sticker — well-corroborated, though still wanting a T1 Anthropic sheet. He adds a usage-economics layer the rate alone misses: because the model re-reads the whole thread each turn, real cost scales with conversation length (his tests: ≈$0.15 short, ≈$6 at 19 turns, ≈$14 at 40) and Fable reportedly shifts to pay-per-use credits after 2026-07-12. His buyer's ladder — Fable 5 only for hard goals at high/max effort (1–2 turns), Opus 4.8 as the cheaper-and-smarter everyday workhorse, Sonnet 5 not justified over Opus — is a practitioner inversion of Anthropic's own mid-tier push (see the Sonnet-5 "close to Opus" thread above): a non-Anthropic voice arguing the flagship, not the mid-tier, is the value pick. Opinion (T3), but it sharpens the open "which lever dominates net cost" question toward turns/context length, not just per-token rate. Sticker now implied by a T1 source (2026-07-24): Anthropic prices Opus 5 at $5/$25 and calls it "half the price" of Fable 5 (claude-opus-5-announcement), which arithmetically puts Fable 5 at $10/$50 — the figure three third-party reads gave. Inference from a first-party claim rather than a published sheet, but the three T3/T4 reads are no longer alone. The caching half of this question is untouched by it and still rests on Njenga's single run. Closed — the rate was published all along (2026-08-03). Anthropic's 9 June launch announcement states "$10 / $50 per Mtok" directly; the hub holds it as research-wiki/claude-fable-5-mythos-5-announcement, created a month before this spoke's Fable 5 page. So this thread's four-source triangulation was corroborating a published figure, not substituting for one — and it landed on the number exactly, which is the stronger result. The correction is narrow: only the claim that no first-party rate existed was wrong. What this says about the corpus is the larger point — the answer sat in a sibling spoke for two months and this spoke never saw it. Entity dedup hasentity-indexto prevent exactly that; claims have no equivalent, so a cross-spoke check belongs in the ingest gate for any question a page marks as open. Context window, max output and intended tier remain genuinely undisclosed by Anthropic, and the caching half still rests on Njenga's single run. - Is "open weight" still one category? (new, 2026-07-16) The thesis treats open weights as a single force pushing the price floor down, on the assumption that downloadable ⇒ self-hostable ⇒ cheap. Inkling strains that. It is Apache-2.0 and encoder-free-multimodal like gemma-4 — and it needs 2TB+ of aggregated VRAM in BF16, ~600GB at NVFP4 inkling-announcement, against Gemma 4 12B's 16GB. Same licence, ~125× the hardware. If the open field is really two fields — local-tier weights (a footprint play, where quantization is the lever) and cluster-tier weights (a customization play, where you rent GPUs or the maker's platform anyway) — then only the first actually attacks the price floor, and the second competes with the closed frontier on control and fine-tunability instead. Watch whether later releases sort into those two poles or fill the middle.
- Does giving the weights away and selling the tuning work? thinking-machines-lab is the clean test: no frontier tier, no inference margin to protect, revenue at Tinker. If it holds, the open-weight wedge stops being only a price attack on incumbents and becomes a business model of its own. One release deep, so this is a question, not a finding — there's no pricing sheet, no independent benchmark re-run, and no track record.
- How stale is this? Pricing and rankings churn weekly; every page here is a dated snapshot.
Vendor/SEO bias — pricing-comparison and leaderboard sources have incentives; numbers are indicative. A neutral, reproducible benchmark would be the highest-value next source.Addressed (2026-06-12): artificial-analysis is the methodology-disclosed, continuously-re-run independent platform (Intelligence Index v4.0 = composite of GPQA Diamond / HLE / τ²-Bench / Terminal-Bench / SciCode; blended price at a 7:2:1 cache:input:output ratio; live TTFT) — the reproducible yardstick to track the "does the frontier premium survive?" question against. It also makes the host/reseller layer measurable (same weights across providers). Residual caveat: composite weighting + the 7:2:1 blend are disclosed editorial choices, and it's still a churning snapshot. Watch item (2026-07-23, weak): Kimi K3 is claimed at 2.8T open-weight with public weights on 2026-07-27, and #1 editorial writing + edging Fable 5 on frontend coding — but the only source is a T4 creator-opinion essay (fable5-gpt56-kimi-k3-creators) with no scores. If it lands as described it's another closing-from-below data point beside glm-52/agents-a1; until the 27th it's an unverified anchor, not evidence.- Geopolitics/licensing — Chinese open-weight leaders (DeepSeek, Qwen, Kimi) dominate the open field; enterprise/regulatory acceptance is unmodeled here.
Growth edges
Ranked; each names the kind of source that would close it (see ../QUALITY.md → Growth edges).
- An independent re-run of any vendor benchmark claim. Every model page here rests on numbers the vendor produced and nobody outside can reproduce; it is the standing complaint behind the spoke's benchmark tensions. — needs: a T1/T2 third-party evaluation of a model this wiki already pages. Partly advanced 2026-09-01 and re-specified, not closed. coderabbit-fable-5-1-review is a T2 evaluation by someone other than the labs, covering four paged models on one task — so the third-party half is met. The independent and reproducible halves are not: the harness belongs to a company selling the filter its own precision figures argue for, and neither the 45 tasks nor the scoring rubric is published, so nobody can re-run it either. It also does not re-run a vendor claim; it measures a different job. — needs now: an evaluation whose task set and rubric are published, by a party with nothing to sell downstream of the result.
- Whether the verifiable-artifact form spreads. astra shipped machine-checkable Lean proofs with a capability claim — falsifiable output, unfalsifiable capability. — needs: a second lab doing the same, or an analysis of the form.
- Free-tier economics. How long a pooled free tier survives is asked and unsourced. — needs: a first-party pricing/policy change with stated reasoning (T3 acceptable — it is a first-party fact). Partly advanced 2026-08-29: anthropic-scientist-access-expansion is a first-party access policy with stated reasoning, but it gives away seats to a screened class, not an open pool — the opposite design to the one being asked about here. It bounds the giveaway by identity instead of by quota, which is one answer to the pooling problem and worth watching for imitators.
Coverage edges (added 2026-08-08, at the curator's request for a wider backlog). These widen what the spoke covers instead of answering an open question above; one ordinary solid source closes any.
- The terms nobody reads. Data retention, whether prompts train the model, and zero-retention tiers decide which provider an enterprise may legally use, and no page scores that dimension — llm-api-pricing prices tokens only. — needs: the providers' own terms and enterprise addenda (T3, first-party facts), read side by side.
- Batch and off-peak pricing. Most providers sell asynchronous batch work at roughly half price, which changes the cost comparisons this spoke keeps making. — needs: first-party batch pricing and its stated turnaround guarantees.
- Embeddings and rerankers. A whole product line with its own pricing and leaderboards, absent from a spoke that otherwise tracks every model release. — needs: provider docs plus MTEB.
- The GPU-cloud hosts serving open weights have no nodes. The concept is covered —
ai-gateway splits managed resellers from self-hosted routers, and amazon-bedrock and
omniroute are paged. What is missing is the class beneath it: awesome-gemma listed 14
hosted providers for one open model, and of Cerebras, Together AI, Fireworks, Baseten, Runpod
and Cloudflare Workers AI, none has a page anywhere in the corpus (Modal is paged, but in
../platform-ops-wikias compute, not as a model host). These are where an open-weight model actually gets bought per-token, so the spoke's pricing comparisons currently miss the market that open-weight-models creates. OpenRouter is named in ai-gateway but has no node of its own. — needs: their own per-token pricing pages (T3, first-party facts), or a third-party comparison of open-model hosting rates against direct frontier APIs. - Availability, not just capability. No page holds an outage record, an SLA, or a status-page history, so a model can be scored here without anyone asking whether it stays up. — needs: published status-page history or a postmortem.
- Does any other provider run a research access program? research-access-programs rests on a single provider's announcement, so the spoke has a concept and no market. OpenAI, Google, Mistral and the open-weight labs all court academics and none is paged. — needs: two or three providers' own academic/nonprofit program pages, read side by side.
- Claude Science has no page. A named Anthropic research product, launched June 2026, appears in this wiki only as one sentence quoted inside the scientist-access post. — needs: its own product page or launch post (T1, first-party).
- A measured latency number for a diffusion LLM. inception-labs sells Mercury entirely on speed and publishes nothing measurable; the spoke holds no benchmark, no tokens-per-second figure and no independent test of a non-autoregressive text model. — needs: a T1/T2 third-party latency or quality evaluation of Mercury against a named autoregressive model at stated conditions (Artificial Analysis would qualify). Added 2026-09-10.
- Entities known only through the page that found them. New 2026-10-07, promoted from the hub dream ledger. HALF-CLOSED the same day (research pass) by lfm2-technical-report (T1, arXiv 2511.23404, 31 Liquid AI authors): liquid-ai now has a first-party account of the LFM line itself — architecture, parameter range, training data volume, self-reported benchmarks — not just the one chess fine-tune in machine-learning-wiki that found it. Game-engines' Michal Valient is untouched; he is a different spoke's entity and still known only through his company's own biography. — needs, for the Valient half: any independent source describing him directly.
The tier ladder doesn't order everything
The spoke's working model of Anthropic's line is a price/capability ladder: claude-sonnet-5 mid, claude-opus-5 flagship-by-price, claude-fable-5 premium, Mythos a domain specialist. Every comparison held here — the benchmark ratios, the cost-per-task framing, the $10/$50-vs-$5/$25 split — sorts on that one axis.
Anthropic's own documentation shows one dimension running the other way. Per anthropic-model-docs, Opus 5's reliable knowledge cutoff is May 2026; Fable 5's and Sonnet 5's are January 2026. The tier sold as below the frontier carries four months more world knowledge than the tier above it.
That is not a contradiction — nothing claims Fable 5 is newer — but it is a hole in how this spoke has been reasoning. Recency is a real axis of model quality for anything touching current events, current prices, or recent releases, and no source in the corpus prices it. A buyer choosing Fable 5 for "the best model" gets a better reasoner with an older world. Watch whether the next Anthropic release keeps the flagship-lags-by-recency shape or closes it.
It also sharpens the standing caution about where these facts come from. The knowledge cutoff appears in the docs and in no launch post — same place the Opus 5 effort ladder turned out to be mis-stated (see anthropic-model-docs). Launch posts are the right source for positioning and the wrong one for anything a buyer or developer would act on; this spoke had been building almost entirely from them.
The premium tier is also the rationed one (2026-08-30, quality cycle). Re-reading claude-api-rate-limits against Anthropic's docs — the page had gone 63 days stale — turned up a fact the spoke's price comparisons cannot see: Fable 5 gets a quarter of Opus 5's input-tokens-per-minute at every tier (500K vs 2M on Start, 1.5M vs 5M on Build, 4M vs 10M on Scale), and half the RPM above Start. Opus 5 and Sonnet 5 also now carry buckets separate from the 4.x pools.
So the ladder has a third dimension beside price and capability: throughput you are permitted. The model Anthropic places above its own flagship on intelligence, and charges double for, is the one an organization can push least traffic through. That is the same shape as Cerebras's sold-out coding tiers — where the spoke recorded that fast inference is rationed, not just priced — arriving now from a frontier lab and about its top model rather than a speed reseller. Two independent instances make it a pattern worth naming: at the frontier, capacity is the constraint the rate card does not show.
And for some buyers the ladder has no upper half at all (2026-08-27). In anthropic-scientist-access-expansion Anthropic states that researchers in biology and chemistry "will still be limited to our Opus-class models," that Fable blocks professional biology and drug-development queries on dual-use grounds, and that Mythos-class access for life-sciences professionals runs through a program built in partnership with the US government, whose first participants are now enrolled. The ladder is therefore cut horizontally by field: the rungs a buyer can reach depend on what they work on, and the buyers with the strongest case for frontier capability in biology are the ones held furthest from it. Nothing in this spoke's price comparisons can see that, because a per-token table has no column for who is allowed to pay. See research-access-programs.
The third dimension has a discount attached (2026-09-04). claude-message-batches-api completes the throughput picture the two sections above sketch. Batch traffic is billed at half list and runs on its own rate limits — the docs say using it "does not affect rate limits in the Messages API" — so a buyer who can wait gets both the cheaper token and capacity that was never in the real-time bucket. Set against the rationing finding, that reads as a price on immediacy: the same model, the same tokens, at half the money, provided you surrender the guarantee of when. What Anthropic actually sells at the top of the ladder is not the model, it is synchronous access to it.
The levers also interfere. Prompt caching — this spoke's other double-acting lever — works inside a batch only best-effort, because batched requests run concurrently and in any order; Anthropic's own suggested fix is to buy the 1-hour cache duration, a paid workaround for a discount. So the "stack the levers to ~25% of list" arithmetic on llm-api-pricing is optimistic where two levers touch, and the spoke should stop treating the discounts as additive.
A provider that is not autoregressive (2026-09-10)
inception-platform-docs puts inception-labs's Mercury models in the corpus: diffusion LLMs sold for chat, reasoning, tool calling and code, behind an OpenAI-compatible API. Every other text provider in this spoke ships a transformer decoder that emits one token at a time. This one denoises a span in parallel, and the difference reaches the API surface — streaming arrives block-wise, in "chunks of refined text," and an optional mode streams the intermediate noisy states so a client can watch the answer resolve.
The competitive claim is latency, and the spoke cannot check it. The docs say "fastest" and "frontier-quality" and publish no benchmark, no tokens-per-second figure and no comparison against any named model. llm-benchmarks holds no Mercury result; neither does anything else here. So the spoke's multi-axis "best model" frame has a provider on it whose entire pitch sits on the one axis with no evidence attached. That is a growth edge, not a finding.
Where the price lands depends on which price you read. List is $0.20 input / $0.75 output per 1M — budget tier, beside Mistral Small and GPT-4.1 Nano. An 80%-off banner runs across the docs, taking Mercury 2.5 to $0.04/$0.15, below anything in llm-api-pricing. A promotional floor is not a floor, and the page records both numbers for that reason. Cached input is a flat 10× discount on all three models, which is more legible than most published caching rules.
The chosen market is narrow and well-picked. Not capability rankings: inline code completion (a
FIM endpoint and a Next-Edit endpoint, wired into Cursor, Zed and VS Code) and realtime voice
(ElevenLabs and Vapi integrations, an instant reasoning level). Both are workloads where
autoregressive decode is felt directly by a human waiting. A new architecture entering at the two
points where the incumbent architecture's cost is most visible is a coherent strategy even without a
published number behind it.
And the architecture cuts the other way too. Mercury is text-only — no vision, no image input, stated in the FAQ — from a company whose method comes from image generation. The generative-media sub-theme this spoke watches (mage-flow-turbo) is diffusion moving into media; this is diffusion moving out of it, into the workload transformers own.
A second non-autoregressive pitch, with a self-graded number (2026-09-16)
system-one-models-and-jev puts typesafe-ai beside inception-labs as the spoke's second provider selling not a transformer decoder on the latency axis. The difference is the shape of the output: Mercury still writes text, Jev returns a typed value with a probability — a yes/no, one of up to 255 choices, a score — and so cannot type-error or hallucinate in the only sense that applies to it, because it cannot emit prose. That makes "can't hallucinate" a true statement about a narrow object, and the post's own comparisons (70–500 ms against 3–329 s; $0.042 input, free output) are measured on the four closed-set classification workflows where such a model is at home.
Unlike Mercury, there is a number: 67.8% aggregate accuracy on evals.typesafe.ai. It should be read with the grading rule in view. The reference label is an average of GPT-6 Astra and Fable 5.1 at high thinking, so 67.8% is agreement with two other vendors' models rather than with anything known to be correct, and the reference models cannot lose on their own labels. The eval was written by the vendor's capabilities team, which the post says. So the spoke's standing edge 1 — nobody re-runs anybody's numbers — applies here in the cleanest form it has taken: a public harness, no human labels, and a headline ratio the vendor concedes is the high end. What is new is not the speed claim but the category: a model whose API surface is a typed function signature, which is the structured-outputs argument carried to its end.
The generative-media cluster reaches four (2026-09-16)
meridian is a fourth non-Google image/video source and a third page on the minimax-h3 base. It adds a layer the cluster did not have: not a model, not a style adapter, but a pipeline that puts an external geometry estimator in front of the diffusion transformer so the camera can move through a clip that was filmed from one place. The licensing is the finding for this spoke. The weights are downloadable and the code is Apache, yet the base licence excludes the EU, UK, South Korea and the US, and the geometry model is non-commercial — so "open-weight" here describes a file, not a right to use it, in most of the markets this spoke's readers sit in. The spin-out trigger (≥3 non-Google gen-media sources) fired on 2026-09-10 and stands; the count is now four, across four layers (model, adapter, base, pipeline). Moving pages is the curator's call and is flagged again.
The typed-decision model gets a distributor, and a caveat (2026-09-19)
jev-ai-sdk-guide is the second source on Jev in four days, and the first not written by
typesafe-ai. Vercel now resells it through AI Gateway as typesafe-ai/jev, which
ends the waitlist and closes one of the three items system-one-models-and-jev left open: the
$0.042/1M input with free output survived the move out of early access. A launch price that holds
through general availability is worth one line in a spoke where most of them don't.
A reseller is not an independent check, and this one still adds something. Vercel repeats
TypeSafe's price and runs no benchmark, so edge 1 is untouched — nobody has re-run the 67.8%. What it
supplies instead is the product's actual surface: a 64,000-token request with 32,000 for the state,
choice questions up to 255 options, score rubrics of 2 to 10 levels, Zero Data Retention per request,
and a confidence statistic — distribution concentration, 0 to 1, absent for booleans — that the
launch post never mentioned.
The sentence the vendor didn't write. This spoke read "can't hallucinate" as true about a narrow object: no prose, so no fabricated text. Vercel states the complement:
"Your schema constrains those answers, but doesn't guarantee they're correct."
and, on the calibration promise, that calibration describes agreement between predicted probabilities and observed outcomes across many examples and "doesn't guarantee an individual answer is correct." Neither contradicts anything TypeSafe published. Both name the trade the category makes: a typed decision model swaps invented text for a confidently wrong typed value, and the second failure is harder to see because it arrives already parsed. The distributor said it, four days after the lab didn't.
A category interface, not a driver. The guide treats the probability distribution as optional —
other evaluation models "may omit them" — so experimental_evaluate is written for a class of models
with one member. Whether a second System One model appears to fill it is the thing to watch, and it is
the same question inception-labs poses from the other non-autoregressive direction: one provider,
one architecture, no field yet.
Where the routing decision sits. The source is a Vercel how-to, and the SDK is
../agentic-tooling-wiki's subject while ../cloud-wiki owns vercel as a host. The substance this
spoke took is the model, its access path and its price; the integration technique is noted on the page
and not paged here. Runner-up spoke logged at the hub.
A vendor concedes the margin, and sells the middle setting (2026-09-23)
claude-opus-5-5-announcement is Anthropic's own launch post for Opus 5.5. Two things in it matter more than its table.
The vendor discounts its own benchmarks. Opus 5.5 leads Fable 5.1 on every row where both appear, by up to 10.6 points on Terminal-Bench 4.0. The post then says the real-use gap "is narrower than these scores suggest" and that benchmark margins have become "a less reliable guide to real-world differences". This spoke's standing complaint about vendor numbers (llm-benchmarks, growth edge 1) now comes from a vendor, in its own launch post. It does not close growth edge 1. Every number in the post is still Anthropic's or chosen by Anthropic.
The pitch moved from the top setting to the default. The argument is cost per task at medium effort, not the max-effort score. On FrontierCode, medium scores 54.6% and max 54.4%, so max buys nothing there. Quoted customers say the same with other workloads: Deloitte's low-effort bug catch (72%) beats Opus 5 at high (56%), and Rogo's low beats Opus 5's high with about 60% fewer output tokens. That is a second source where more effort does not buy more quality, after coderabbit-fable-5-1-review. It is weaker than the first. The FrontierCode gap is inside any plausible error bar, and the customer figures compare against the older model, not against Opus 5.5 at a higher setting. Still, the vendor now sells the middle of its own dial, and that fits the CodeRabbit result better than it fits the tier ladder's assumption that effort buys quality.
The 40% saving is mostly tokens, not price. The list price fell 20%; the other half of the claimed 40% comes from using fewer tokens per task. This matches the token-efficiency read in the thesis: a sticker price alone no longer tells you what a model costs to run.
A benchmark for models nobody else here tracks (2026-09-27)
tiny-theory-of-mind, via Telegram: axiomic-labs's synthetic theory-of-mind benchmark, scored
by base-model log-likelihood rather than instruction-following. It sits outside every axis
llm-benchmarks tracks — its 36 baselines are all sub-150M-parameter checkpoints, and no model
this wiki otherwise pages (Claude, GPT, Gemini, Llama, Qwen) appears on its table. So it does not
advance any open question here; it is filed because the routing runner-up was
../machine-learning-wiki and the dominant substance is a model+provider landscape entry (a
lab, its checkpoints, its own benchmark), not a training-method question. Worth a second look only
if a later ingest runs a chat-tuned model against it, which would connect it to the tier ladder for
the first time.
The first long-horizon evidence, and it arrives vendor-shaped (2026-09-27)
claude-nine-loop-amplitude-von-hippel closes part of the gap claude-fable-5-1 flagged on 2026-09-01 — nothing here covered the Fable tier's agentic/long-horizon behaviour, only single-turn benchmark scores. Inside Anthropic's Claude Science harness, Fable 5.1 ran largely unsupervised for hours-to-days, writing its own Python/SymPy from scratch, and reached a nine-loop planar N=4 super-Yang-Mills amplitude by two independent methods — one loop past the best published human result (Dixon & Liu, 2023).
The evidence is a new kind for this spoke (sustained autonomy on a checkable, non-fuzzy problem, not a leaderboard score) and weak provenance by this spoke's own tier rules: Anthropic chose the problem, ran the harness, paid the writer, and paid the one outside validator in its own product's credits. Dixon's two-week independent re-derivation stands on his own methods, not Claude's — closer to a real check than a self-report, though still not a disinterested benchmark. A concurrent human-led effort (Song He's group, CAS, with GPT-6 assistance) reaching most of the same answer around the same time is the closest thing to an outside check this source has. File it as one vendor-adjacent data point on autonomy; watch for a second, non-Anthropic-adjacent instance before treating long-horizon agentic capability as measured here at all.
Contradictions / tensions
None internal yet. Cross-source tension to watch: leaderboards crown proprietary reasoning while the open-weight roundup argues practical fit beats rank — a framing disagreement, not a fact conflict. Fable-5-is-expensive, now on two reads (2026-07-08): Njenga's T4 test put Fable 5 at ~3.2× Sonnet 5 on a trivial prompt; The Decoder's rate card (grok-4-5-price-vs-benchmarks, T3) independently lists Fable 5 at $10/$50 ≈ 3.3× Sonnet's $3/$15. Two non-Anthropic sources agree it's the dear model — corroboration, not proof. Odd for a model pitched as the fast pick; likely a premium tier. Still pending a T1 Anthropic price sheet before recording as fact.
Efficiency is now the shared pitch — and tiering goes intra-family
openai-gpt56-grok45-clash shows OpenAI and xAI timing rival launches hours apart, both leading with token efficiency. Two structural reads land on the thesis. (1) Tiering moved inside the family: OpenAI's GPT-5.6 ships as Sol / Terra / Luna (flagship / everyday / speed-&-affordability) — the capability×price split the market already had across labs is now explicit within one lineup, with Luna as the cheap-fast tier. (2) Cost-per-task is the industry frame, not one vendor's spin: Musk pitches Grok 4.5 as "Opus-class but faster, more token-efficient and lower cost" — the same cost-per-task argument, in the maker's own words, as buyers watch token spend. Gemini 3.5 Pro is expected the same month. So the price-floor pressure the thesis pins on open weights now has a second driver: efficiency competition among the closed frontier labs themselves.
A new availability axis — export controls. The same source reports the Trump administration
export-banned Anthropic's Fable and Mythos models (cyberattack-misuse risk); Anthropic suspended them and
redeployed Fable 5 last week. For the first time in this spoke a model's availability
turned on government policy, not price or licensing — a governance variable sitting above the market map
(cross-spoke: ../ai-governance-wiki).
A second pricing shape — the speed provider. The market's price story so far is a per-token rate
card (the ~600× spread, output 2–6× input, cost-per-task as the hidden multiplier). Cerebras
breaks the shape: a wafer-scale inference provider (cerebras-inference) reselling open models on
speed, it publishes no per-token price (corrected 2026-09-22 — it now publishes a two-model
rate card, GPT OSS 120B $0.35/$0.75 and Qwen 3.8 27B $0.99/$1.49 per M tokens) and sells daily-token subscription buckets as well
(Cerebras Code Pro $50/mo→24M tok/day, Max $200/mo→120M tok/day; $5 free credit; Developer from $10). Both
coding tiers were sold out (mid-2026, still so on 2026-09-22) — capacity is rationed, so what's scarce and priced here is
throughput, not model quality. This adds an axis the rate-card view misses: a provider can compete on
how fast and how much per day rather than how much per token. It also sharpens the boundary with
../llm-inference-wiki — Cerebras the mechanism/company lives there (cerebras-inference, cerebras-systems);
what lives here is its place in the provider market and its unusual price structure.
A third shape — speed as a paid mode on one model (2026-07-24). Opus 5 sells a fast mode at 2× the base rate for ~2.5× the default speed (claude-opus-5-announcement). Cerebras prices speed by building different hardware; OpenAI's Luna tier prices it by shipping a different model. Anthropic prices it as a runtime toggle on identical weights, which puts latency alongside effort as a per-request dial the buyer pays for directly. Three ways to sell speed now coexist — separate silicon, separate model, same model different meter — and only the third leaves the capability question untouched. Whether the 2× premium prices real serving cost or just willingness to pay is not answerable from the announcement.
The first independent capability read, and why it doesn't settle much
Almost every capability claim in this spoke is the lab's own. opus-5-arc-agi-3 is the exception: ARC Prize scores Opus 5 at 30.2% on ARC-AGI-3 against a 7.8% prior record (GPT-5.6 Sol Max), with "Fable-class" at ~20%, plus 90.4% / 97.5% on ARC-AGI-2 and -1. Three things it changes and one it doesn't.
A benchmark nobody has saturated ranks differently from the composites. The indices in llm-benchmarks score what the vendor ships and crowd into a narrow band at the top; ARC-AGI-3 scores the model without a harness on tasks it has never seen, and the field is spread from 7.8% to 30.2%. It also inverts the family ordering Anthropic sells: Fable 5 is the premium tier at 2× the price, and here the cheaper flagship beats it.
A vendor ratio that doesn't reconcile. The launch post claims "3× the next-best model on ARC-AGI 3" (claude-opus-5-announcement). Against the 7.8% record that's ~3.9×; against ARC Prize's ~20% Fable-class figure it's ~1.5×. Both claims can't describe the same comparison. Recorded as a tension, not resolved — this is the same shape as the Fable-5 pricing case, where third-party numbers arrived before the vendor's own.
Novelty benchmarks decay once labs aim at them. Opus 5 postdates ARC-AGI-3's public format, and the jump does not reproduce on Guanghan Ning's private Witness benchmark, where Opus 5 (43.4) ties Fable 5 and kimi-k3 and falls below Opus 4.8 on the one unfamiliar rule combination. ARC Prize's Greg Kamradt argues that isn't disqualifying. Either way the useful read is structural: an evaluation whose value is novelty has a shelf life measured from the day its format goes public, so private and rotating benchmarks buy resistance to targeting at the cost of reproducibility — the axis the artificial-analysis disclosure story sits at the other end of.
What it doesn't change: the open question below about the frontier premium. A 30.2% that may be partly benchmark-targeted, on a test the vendor's own harness would score higher on, is not evidence about capability-per-dollar in production.
"Model" is becoming a product boundary, not a technical one
Sakana Fugu is a multi-agent system sold as a model: OpenAI-compatible endpoint, a model string, a reasoning-effort dial, and — in the docs' own first sentence — an agent system underneath that routes across all supported providers by default, with the pool narrowed per API key rather than per request fugu-get-started. Three of this spoke's working assumptions break at once.
You can't say which model answered, so a capability benchmark measures a routing policy on the day it ran. You can't state a per-token price for a named model, because the composition is the product. And the reseller/lab distinction collapses: Sakana presents as a lab with its own model family while being, underneath, a composer of other labs' models — llm-provider's "frontier lab" and "cloud reseller" categories arriving at one endpoint.
Read it beside claude-opus-5's fast mode (a runtime toggle on identical weights, 2× price for ~2.5× speed) and the trend is the same from both directions: the SKU has stopped corresponding to a set of weights. One vendor sells two products off one model; another sells one product over many models. In both cases what the buyer purchases is a configuration, and the rate-card view this spoke was built on describes less of the market each month. The ai-gateway page carries the mechanism; the honest consequence for the map is that capability and price claims now need to name what they measured, not just which model string was passed.
Two smaller markers from the same source. Cyber is now its own SKU across three labs —
Anthropic's Mythos (claude-opus-5), Google's Gemini 3.5 Flash Cyber
(alphabet-q2-2026-earnings) and now fugu-cyber — with none of them publishing what makes a
model a cyber model, against a backdrop where Anthropic's cyber-capable line drew an export ban
(claude-fable-5). Domain specialization has quietly become a product axis beside size, speed
and price, and the security one is the axis regulators already watch. And the effort dial starts at
high: no low, no medium, with a Codex integration that raises the stream idle timeout to two
hours. A model whose cheapest setting is "high" and whose turns run for hours is not competing in
the same market as a chat completion.
The architecture has stopped corresponding to a lab
neutrino-1 states an architecture matching qwen's published Qwen3-8B/config.json on every
field — 36 layers, 4,096 hidden, 32 query over 8 KV heads, 12,288 feed-forward, 151,936 vocabulary,
40,960 positions, untied embeddings, and a matching parameter count — and its release post never
mentions Qwen. The 0.6B matches Qwen3-0.6B the same way.
Nothing improper follows. Configurations are not proprietary, Qwen3 is Apache-2.0, and holding the geometry fixed while changing the weight format is the right experiment when the format is what you are testing. The point for this map is different: Qwen's contribution to the open ecosystem is now a default shape as much as a set of checkpoints, and a shape leaves no attribution trail. The 200,000+ Hugging Face derivatives are countable; adopted geometries are not.
This is the erosion logged in "Model is becoming a product boundary", one layer down. There, a model string stopped identifying a set of weights. Here, a set of weights stops identifying a design lineage. The spoke holds four positions on that gradient now: agents-a1 discloses its Qwen3 lineage, readyart publishes openly-labelled derivatives of someone else's checkpoints, sakana-fugu presents other labs' models as a family of its own, and neutrino-1 sits at a fourth point — plausibly original weights on a borrowed skeleton, with the borrowing unstated.
interfaze-1-lite (2026-10-06) is a fifth point, and a literal one: an Apache-2.0 release whose reasoning core is Qwen-based and whose "model" is a bundle of other open projects (Chandra OCR, Whisper, SAM 2.1, TimesFM, Llama Guard) called as tools. Its GPQA Diamond 85.9 and olmOCR-Bench 83.8 are self-reported and describe the bundle, not any one weight set.
The practical consequence is a caveat on footprint claims, which are always comparative. "An 8B at 2.56 GB" means something different if the 8B in question is a known-good geometry someone else validated. This wiki records the match, not a verdict, and needs a second Fermion release or an independent evaluation to say more.
Whose price is on the sticker?
An open-weight model doesn't have a price — it has a vendor rate and a set of independent hosts serving the same weights, and the corpus now holds two sources that disagree about which is which. glm-52 (T2, simon-willison) puts $1.40 / $4.40 per 1M at OpenRouter hosts; deepseek-glm-qwen-price-gap (T4) calls those figures Z.ai's list price and reports resale separately at ~$0.55 / $1.85. Neither is first-party, and the T4 article's headline claim — a 10x gap to DeepSeek V4 Flash at $0.14 input — only holds on its own reading.
Left open, because the underlying point is more interesting than the arithmetic: open weights turn a model's price into a market rather than a number. Anyone can serve them, so "what does GLM-5.2 cost" has no single answer, and comparisons against closed models (one vendor, one rate) are not like-for-like. That belongs alongside the tokens-per-task multiplier in llm-api-pricing — two different ways a headline per-token rate fails to predict a bill.
Method note worth keeping: this conflict surfaced because a T4 aggregator was ingested into a spoke already holding T1 and T2 on the same subjects. Its spec sheet checked out against both, its GLM release date was three days off, and its pricing framing broke exactly where the headline lived. Weak sources are cheap to ingest and worth grading against strong ones already in the corpus.
Safety alignment is a build-time setting on open weights
The spoke has argued that a permissive licence is permission to rewrite a model, not just to run it (open-weight-models, gemma-4-31b-it-scotoma). The 2026-08-22 ingest of heretic moves that from an observation about one derivative to a fact about the tier.
Three things now sit on the table together. The mechanism is published and simple:
Arditi et al. 2024 find refusal in a one-dimensional subspace across
13 open chat models, removable by orthogonalizing two matrices per layer against a direction you
get from a difference of means. The tooling is finished: pip install heretic-llm, one
command, 20–30 minutes on a 4B model on a consumer GPU, explicitly pitched at users with no
knowledge of transformer internals. The volume is there: well over 5,000 tagged models on
Hugging Face, and readyart — this spoke's first derivative publisher — turns out to be a
downstream user of that tool rather than an independent practitioner.
The consequence for how this wiki reads a model release: for an open-weight model, the refusal behaviour reported in a launch post or a system card describes the checkpoint the lab published, not the artifact users run. A closed model's safety posture is a property of the product; an open model's is a default that ships with an uninstaller. That is a real difference between the two tiers, and none of the licence axes on open-weight-models captures it — Apache-2.0, MIT, the Llama MAU clause and the Kimi K3 revenue threshold all say who may serve the weights, and nothing about who may change what they refuse.
What is still missing is the cost side. heretic's own table quantifies the trade for the first time in this corpus — same 3/100 refusals as hand-made abliterations at 0.16 KL divergence against 1.04 and 0.45 — but KL divergence is a distance between output distributions, not a capability score, and the wiki holds no independent MMLU/GSM8K read on any abliterated model. So the honest statement is: removing refusals is cheap and easy, and how much intelligence it costs is still self-reported by the people doing the removing.
The downstream half arrives, and it is weakly sourced (2026-09-04). Everything above is about supply: the mechanism, the tool, the volume, the publisher. uncensored-ai-rekhi is the first source here that asks who runs the output — a T3 Medium essay that relays security-industry reporting the wiki has not read. It describes a demand side with two shapes. A rental tier: three-plus vendors selling hosted uncensored inference at $30–$200/month on models over 80B, with maybe a thousand customers, now paged as dark-llm-services. And a squatted tier: a 293-day SentinelOne/Censys sweep finding hundreds of exposed open-source deployments with guardrails explicitly removed. The llm-provider typology has no slot for either; both are providers by every functional test and train nothing.
That completes an argument the spoke had been making one-sided. The licence axes on open-weight-models all constrain serving by an identifiable party; the essay's structural point is that publication is irreversible, so none of them reaches a copy already downloaded, and safety work that binds is safety work done before release. Note what the price says: $30/month is not competing with llm-api-pricing on capability, because the product is the absence of a refusal — supply-side free, and priced on convenience.
Two cautions, and they pull opposite ways. The numbers are third-hand from vendors whose business is the size of the threat, and none is verified here. But the essay also conflates weight editing, safety-breaking fine-tuning and prompt jailbreaking under the word "abliteration" — and only the first two need open weights at all. Its most alarming evidence (a 97% jailbreak rate, GPT-5 broken in a day) comes from the third category, against hosted frontier models. So the popular argument that open weights are the problem draws much of its force from evidence about closed ones, which is a reason to be more careful with the framing rather than less, in both directions. The correction is recorded on abliteration with the three-way table.
And the popular account has dropped the cost entirely — abliteration as a clean subtraction, "a model that simply doesn't have the machinery for refusal anymore." The corpus's own position is the paragraph above this one: the trade is real, it is measured only by the people making the edit, and nobody neutral has run a capability eval. The version of this story circulating outside the field asserts an answer the field has not produced.
The open tier is now previewing architectures, not just chasing them
The story this wiki has told about open weights is a chase: capable models arriving a few months behind the frontier at a fraction of the price. qwen38-flash-next does not fit that shape. Qwen released it as an explicit early preview of the architecture behind Qwen4, exactly as Qwen3-Next previewed the design that then ran through Qwen3.5, 3.6, 3.7 and 3.8 — the next generation's geometry, open, a family early.
Two consequences for the map. Openness is being used as a design-review channel: the weights go out so the community can examine an architecture before the flagship is built on it, a different motive from distribution or ecosystem share, and no closed lab in this corpus does it or can. And it sharpens "the architecture has stopped corresponding to a lab" above — if the shape travels faster than the checkpoints do, then publishing the shape first is not a side effect of open weights, it is the point. The 200,000+ derivatives count checkpoints; this is Qwen putting the skeleton on the table a generation ahead.
The counterweight is that nothing here is independently checked. Every capability, throughput and cost figure is Qwen's own, two headline benchmarks are its in-house suites, the launch post states no licence at all, and the only outside contact the corpus holds is simon-willison running 1–2 bit community quantizations and liking a pelican (qwen38-flash-next-willison). A lab that publishes its next architecture early also gets to frame, first, what that architecture is good at.
What this spoke's T4 count means, and what it doesn't (2026-08-30)
The 2026-08-30 tier decision requires a spoke to say beside its histogram what a low floor is measuring. This spoke's floor is not low — T4 3 of 51 tiered pages — and the reason is worth stating, because the contrast with search-marketing-wiki is the useful part.
Search marketing's T4 share is the highest in the corpus and it is a fact about the field: the industry publishes argument from practice and there is no body of evidence being ignored. Here the opposite holds. Model providers publish constantly — rate cards, system cards, model documentation, benchmark tables — so a primary source exists for almost every claim this spoke needs, and the T1 count (18) reflects that. The three T4 pages are therefore a fact about those three sources, not about the industry:
- deepseek-glm-qwen-price-gap — a referral-monetised comparison template, the filler kind of unevidenced. Kept because a T1-rich corpus can mark it, and marking it caught the "10× price gap" resting on a reseller price mislabelled as a vendor price.
- fable5-gpt56-kimi-k3-creators — a creator's personal essay, the practitioner kind. Scored against the kimi-k3 release it yielded a rule this spoke reuses: specs propagate accurately through a weak source, comparative rankings do not.
- fable-5-vs-sonnet-5-token-cost — the one that does not fit the tier at all; see that page. The author ran a measurement, which the ladder sends to T2, and the grade was given for the measurement being thin rather than absent. Left as found and raised with the curator.
The discipline that follows is the reverse of search-marketing's. There, T4 is unavoidable and the work is to say so. Here a T4 ingest should be rare and should carry a reason for existing — usually that a primary source is missing on that specific point, as with sakana-fugu's undisclosed routing pool, or that marking a weak claim against held primaries is itself informative.
Nobody wins on both axes, and the effort dial went backwards (2026-09-01)
coderabbit-fable-5-1-review is the first source here that scores a job rather than a capability: 45 code-review tasks against 105 catalogued defects, with recall, precision, comment volume and latency all reported. It changes two things.
A capability index has to choose an error to care about, and usually hides the choice. Ranked by recall the order is GPT-5.6 Sol (69.7%) → Fable 5.1 (61.0%) → Opus 5 (55.2%); ranked by precision it inverts almost exactly (39.3% → 37.3% → 31.6%). No model is best at both, and every composite in llm-benchmarks would have to pick a weighting to produce a winner — the same editorial choice that page already flags in the Artificial Analysis Index, now visible as a straight reversal rather than a rounding difference. The floor is also lower than any index suggests: precision runs 31.6%–39.3% across all four models, and no capability benchmark in this spoke reports what share of a model's output was wrong.
And raising effort made the model worse. Fable 5.1 at high reasoning took 21:36 against 18:38 and scored 57.1% recall against 61.0%. Everything this spoke records about effort — the tier ladder, the price-for-capability argument on claude-fable-5, Anthropic's own positioning of Opus 5 as "close to Fable 5 at half the price" — assumes more compute buys more quality, monotonically. One vendor harness on one task family is not a refutation, and it is the first counter-instance in the corpus. Watch for a second before treating it as anything more. 2026-09-23: a weak second arrived. claude-opus-5-5-announcement reports medium effort at or above max on FrontierCode, and sells medium as the default. See "A vendor concedes the margin" above.
The 5.1-over-5 upgrade fits the same shape: 34% fewer comments, 70% fewer nitpicks, 49% more latency, recall unchanged. Priced identically to its predecessor, the newer model in this test bought restraint rather than reach — which is a product decision, not a capability gain, and it is invisible to any score that counts only what was found.
Cross-spoke adjacency
../research-wiki— owns anthropic & claude-opus-4-8 as the model substrate under the tools-for-thought ecosystem (capability+cost lens). Here they're entries in the broader market. It also owns diffusion of innovation and technology adoption, which is the frame for research-access-programs: subsidizing a screened population of early adopters is an adoption mechanism before it is a pricing one. The market consequences stay here; the diffusion theory is there.../llm-inference-wiki— how these models run (MoE efficiency, kv-cache, serving). This spoke is who makes them and what they cost.../agentic-tooling-wiki— consumes providers (model selection, "Sonnet+harness > raw Opus"); the cost/capability frontier here sets the harness economics there. Claude Science, the long-autonomous-run harness behind claude-nine-loop-amplitude-von-hippel and named without a page on anthropic-scientist-access-expansion, is that spoke's subject if it earns one — routed here because the dominant substance is what the model did, not the harness.- No physics spoke exists for the actual object claude-nine-loop-amplitude-von-hippel computes
(a nine-loop amplitude in planar N=4 super-Yang-Mills);
../mathematics-wikiwas the runner-up and is noted, not used, since the source's load-bearing claim is about model capability, not the physics result itself. ../machine-learning-wiki— post-training model adaptation and the toolchains that run it (fine-tuning, PEFT, RL). heretic is one of those toolchains and was the routing runner-up for that source; it landed here because the abliteration cluster and the open-weight argument are here. Its TPE/Optuna hyperparameter search is likewise../optimization-algorithms-wikimaterial.../ai-governance-wiki— AI export controls / regulation (the Fable/Mythos export ban openai-gpt56-grok45-clash) govern which models are available at all; this spoke owns the market those rules constrain. The adjacency got sharper with heretic: an openly published, 28k-star tool that removes safety alignment in one command is a governance object, and the source makes no governance claim about itself. Sharper again with uncensored-ai-rekhi (2026-09-04), which is three-quarters a governance argument — irreversibility of publication, jailbreak research, incident counts — routed here because its load-bearing subject is what open weights are and what a licence does not cover. The policy question it raises is that spoke's; the market tier it describes (dark-llm-services) is this one's.../defensive-security-wiki— the blue-team consumer of the same facts. uncensored-ai-rekhi names WormGPT/FraudGPT/GhostGPT, the Arup deepfake fraud and the SentinelOne/Censys exposure sweep; those are that spoke's subject as practice and detection, and the primary reports behind them are worth hunting there rather than here. This spoke owns the supply side — who publishes editable weights, who edits them, and who rents the result.
Index — LLM Providers Wiki
Catalog of every page, grouped by schema.org
@type. Spine: synthesis (thesis),log.md(history), this file (catalog). Some wiki-links resolve cross-wiki (../research-wiki,../llm-inference-wiki) — intentional bridge links. Pricing/ranking facts are dated snapshots.
DefinedTerm (concepts)
- abliteration — weight-editing away a model's refusal direction; only possible on open weights; the coherence-cost trade, now quantified as KL divergence by heretic · mechanism
- dark-llm-services — rented uncensored inference sold as a subscription (WormGPT/FraudGPT/GhostGPT): 3+ vendors, models over 80B, $30–$200/month, ~1,000 customers. A provider by every functional test that trains nothing — the slot the llm-provider typology lacks. Every figure third-hand via one T3 essay · market segment
- ai-gateway — the one-endpoint layer over many providers: managed resellers vs self-hosted routers; fallback, cost and token-volume policy · concept
- arc-agi — the novelty benchmark: unseen tasks, ARC-AGI-3's interactive-game format, the model-alone (no-harness) rule, and the contamination problem a novelty test can't escape · benchmark
- gemma-variants — the 16 first-party domain forks carrying the Gemma name (MedGemma, TxGemma, PaliGemma 2, VaultGemma …); three live generations at once; the open track's shape, distinct from gemma-4 the lineup
- llm-api-pricing — per-token pricing tiers, the ~600× spread, caching/batch/routing levers · concept
- research-access-programs — access handed to a class of user rather than sold by the token: free/discounted seats and grant credits, gated by identity and by research field · concept · one provider only
- llm-benchmarks — composite multi-axis leaderboards (capability × speed × price × context) · concept
- coderabbit — vendor of AI code review; publishes per-model recall/precision/latency evaluations as new models land. Useful because it measures a job rather than a capability, and interested because its own 31.6–39.3% precision figures are the argument for the filter it sells · Organization
- llm-provider — umbrella: the kinds of providers (frontier labs, open-weight labs, cloud resellers) and their axes · domain
- open-weight-models — the open-weight wave: MoE, Apache-2.0/MIT licensing, local deploy · concept
- quantization — int4/2-bit precision as a footprint lever; QAT vs PTQ, plus native-format training as a third case; sub-1GB open models · mechanism
- ternary-weights — minus/zero/plus at ~1/8 the bytes of fp16; trained in, not quantized into; the format as market lever · mechanism
Organization (providers)
- viggle-ai — video-generation company behind meridian · thin node
- liquid-ai — MIT CSAIL spinout behind the LFM small-model line and the
lfm1.0licence; first-party account now in via lfm2-technical-report (350M–8.3B params, hybrid conv/attention architecture, 10–12T training tokens) - typesafe-ai — lab behind system-one-models-and-jev; typed probabilistic decisions instead of text, founder Diogo Almeida; thin node
- deepseek — Chinese lab; low-cost OpenAI-compatible API + strong open weights; the seed subject
- google — dual-track: proprietary Gemini frontier + open-weight Gemma family
- openai — frontier incumbent; proprietary GPT/o-series; its API is the de-facto compatibility standard ·
source - inception-labs — the Mercury diffusion-LLM lab; the spoke's first commercial provider selling a non-autoregressive text model. Latency-first pitch aimed at inline code completion and realtime voice; no benchmark result anywhere in this corpus · provider
- mistral-ai — Europe's leading lab; Apache-2.0 open weights (Mixtral MoE) + proprietary API; 2026-07 pivot to a sovereign full-stack platform ·
source - qwen — Alibaba; the leading Chinese open-first family (Apache-2.0; deepest ladder; 200k+ HF derivatives) ·
source - xai-grok — Elon Musk's xAI; proprietary frontier; 2M-token context; open→closed arc (Grok-1 was Apache-2.0) ·
source - amazon-bedrock — AWS reseller/aggregator: many providers' models behind one API (the cloud-reseller axis) ·
source - sakana-ai — Tokyo lab behind sakana-fugu; this spoke's first Japanese entry, and a composer of other providers' models presenting as a lab with its own family; sells into Codex/Claude Code rather than a chat app
- cohere — Canadian enterprise/sovereign-AI lab; Command + North model families; no consumer product
- z-ai — Chinese open-weight lab (formerly Zhipu AI) behind the GLM family; text-only flagship + separate vision models
- internscience — open-weight, agentic, science-leaning lab behind agents-a1 (built on Qwen3 lineage)
- thinking-machines-lab — US open-weight startup behind inkling + tinker; concedes the frontier, sells the fine-tuning
- arc-prize — runs the arc-agi benchmark + leaderboard; scores the model alone, no harness; the spoke's nearest thing to an independent referee
- fermion-research — ships models, not an API: three Apache-2.0 ternary models + engine, no waitlist; publishes measurement depth while keeping format and training method closed. No founders, funding or independent eval known
- readyart — HF org publishing weight-edited derivatives (gemma-4-31b-it-scotoma); trains nothing, ships modified checkpoints — the spoke's first derivative publisher
- axiomic-labs — small HF org ("Small Logic Engines"); publishes sub-150M-parameter base checkpoints (
GPT-S/GPT-X) and its own eval datasets, incl. tiny-theory-of-mind · thin node
SoftwareApplication (models)
- claude-opus-5-5 — Anthropic's Opus after Opus 5 (2026-09-22): $4/$20, a 20% cut; cache hits 0.05× input; launch post claims near-Fable-5.1 work at 40% less than Opus 5; one hands-on report (max thinking failed a drawing task at ~$2.56/try)
- gpt-6 — OpenAI's GPT-6 Sol ($2/$10) and Luna ($0.10/$0.50), 2026-09-22; each half its GPT-5.6 predecessor; Astra has its own page
- meridian — viggle-ai, via Telegram: re-render a clip from a new camera (orbit/zoom/pan, time handled separately) on the minimax-h3 transformer + VAE with Meta's VGGT-Omega estimating depth/poses; 33B, 24 fps 1344×768, 3–10 s; 2.5 GiB adapter or 61.7 GiB checkpoint; 243 frames need 113 GiB on a B200. Weights under the H3 licence (no EU/UK/KR/US), geometry non-commercial. Fourth non-Google gen-media source — spin-out trigger already fired ·
source· T3 · huggingface.co - studio-1939-lora — STUDIO 1939: a third-party style LoRA (r16 painterly / r64 full cel) making minimax-h3 generate 1930s hand-painted animation, trained on one public-domain 1939 feature and served on fal's standard LoRA endpoints. The generative-media cluster's third layer — not a hosted tier, not a lab's weights, but somebody's adapter over somebody else's model. Carries the sub-theme's first workflow numbers (261 shots in 28 min) and a consistency trick: freeze the character description, repeat it verbatim ·
source· T3 · huggingface.co - minimax-h3 — MiniMax's text/image-to-video model; supports served LoRA adapters, MiniMax Community License. Thin — reached only through an adapter's card, no capability or price read here
- gemma-4 — Google's open-weight family, 2.3B–31B (E4B / 12B / 26B-A4B / 31B-it); Apache-2.0; encoder-free multimodal 12B; thinking mode
- gemma-4-31b-it-scotoma — ReadyArt's abliteration of Gemma 4 31B-it; Apache-2.0 33B BF16, Jacobian-lens projection keeping ~22% of the edit re-applied at 1.5× over layers 7–41; no evals, and its own card says it "refuses basically as much as its base model" ·
source· T3 · huggingface.co - gemini — Google's closed-weight frontier family (Gemini 3.5 agents/coding, Omni video, for Science)
- llama — Meta's open-weight family (Llama 1→4); catalyzed the open wave; custom (non-OSI) license ·
source - cohere-north-mini-code — Cohere's first agentic coding model; Apache-2.0 open-weight 30B MoE (3B active), single-H100, 256K ctx; SWE-Bench 83.2% ·
source· T3 · cohere.com - kimi-k3 — Moonshot's open-weight multimodal agentic flagship, released 2026-07-28: 2.8T total / 104B active (16 of 896 experts), 1M ctx, native MXFP4 QAT, MoonViT-V2 vision; splits decisions with the closed frontier (GPQA 93.5, SWE-Marathon 42.0 ahead; DeepSWE 67.5 behind Fable 5's 70.0) on a table that documents its own confounds; bespoke licence with a $20M MaaS revenue threshold · T1 · github.com/MoonshotAI
- deepseek-glm-qwen-price-gap — Tech Insider: DeepSeek V4 / GLM-5.2 / Qwen3.6 open-weight price comparison; T4 SEO+affiliate template ("X vs Y vs Z: $N Price Gap [2026]"), specs corroborate against glm-52/deepseek-api-docs but the headline 10x rests on calling $1.40/$4.40 GLM's vendor list where this wiki has it as reseller — conflict flagged ·
source· T4 · tech-insider.org - glm-52 — Z.ai's text-only open-weight flagship; MIT, 753B-A40B MoE, 1M ctx; #1 open-weight on Artificial Analysis (v4.1), #2 Code Arena WebDev ·
source· T2 · simonwillison.net - claude-sonnet-5 — Anthropic's agentic mid-tier (
claude-sonnet-5, 2026-06-30); pitched near Opus 4.8 at Sonnet price ($3/$15 std, $2/$10 intro); SWE-bench Verified 85.2%, HLE 57.4% w-tools, OSWorld 81.2%, 1M ctx ·source· T1 · anthropic.com - mage-flow-turbo — Microsoft's open-weight text-to-image model; MIT, 4B NR-MMDiT, rectified flow matching + 4-step distillation, native 512–2048px; claims 0.59 s/1024² on one A100 and parity-or-better vs Qwen-Image 20B / FLUX.2 32B (GenEval 0.88, self-reported); 2nd generative-media source, 1st non-Google ·
source· T3 · huggingface.co - agents-a1 — InternScience's open-weight agentic model; Apache-2.0, 35B MoE (Qwen3 lineage), 262K ctx; claims trillion-param-class agentic perf by distillation not scale (GAIA 96.0, IFEval 94.8, self-reported) ·
source· T3 · github.com - claude-fable-5 — Anthropic's
claude-fable-5, Claude 5-family fast/coding-strong model; $10/$50 published by Anthropic at launch (found 2026-08-03 in../research-wiki's announcement page; three third-party reads had independently corroborated it) + pay-per-use after 2026-07-12; Anthropic's own Opus 5 post places it above Opus 5 on intelligence at 2× the price - claude-fable-5-1 — Anthropic's
claude-fable-5-1(Sept 2026), successor to Fable 5 in the same tier at the same $10/$50; 1M context, 128K output, cache reads $0.25/MTok; thinking always on (depth viaoutput_config.effort, low→max), forcedtool_choiceremoved, no Priority Tier, ZDR refused. One third-party read so far: middle of the pack on both axes of a code-review harness, and high reasoning scored worse than low - claude-opus-5 — Anthropic's
claude-opus-5(2026-07-24); near-frontier flagship at $5/$25, same as Opus 4.8, pitched as "close to Fable 5 at half the price"; fast mode 2×price/~2.5×speed; ratio-only vendor benchmarks; context window unstated ·source· T1 · anthropic.com - sakana-fugu — a multi-agent system sold as a model: OpenAI-compatible endpoint,
fugu/fugu-ultra-v1.1/fugu-cyber, effort high/xhigh/max (no low or medium), routes across all providers by default with the pool set per API key; the ai-gateway that calls itself a model · T1 · fugu.sakana.ai - neutrino-1 — Fermion Research's Apache-2.0 ternary family (8B / 0.6B / 0.6B-Chat, 2026-07-27): an 8B-class model in a 2.56 GB download, weights trained in ternary rather than quantized; MMLU 72.1 beats fp16 8Bs at 1/6 the bytes, but loses IFEval and BFCL, ships a 40,960 context (smallest in its own table), and every number is first-party. Architecture matches Qwen3-8B field for field, unmentioned ·
source· T1 · fermionresearch.com - astra — OpenAI's "next major model", named 2026-08-01 in a mathematics paper rather than a model launch: an internal version produced ten results in maths/TCS and wrote their Lean proofs; search cost ~$2,000 of tokens priced at Sol rates (a volume proxy, written when Astra had no price card). On the API since 2026-09-04 at $10/$50 per million — so that run is $3,300–$4,000 at its own rates. Reasoning levels low→max, no
reasoning=none. Still no params, context, benchmarks or system card, and the only outside contact is astra-pelican-grid · T1 · openai.com - qwen38-flash-next — Qwen's open-weight multimodal MoE (2026-08-26), released as an explicit early preview of the Qwen4 architecture: 125B total / 6B active + 51B N-gram embedding params held in host memory, GDN+QSA sparse attention, Gated Residual, Muon; 262K ctx → 1M with YaRN; served as
qwen3.8-flashat $0.15/$0.47 per 1M; beats Claude Opus 4.6 on SWE-bench Pro (62.5 vs 53.4) on Qwen's own table, and no licence is stated in the post ·source· T1 · qwen.ai - interfaze-1-lite —
interfaze-ai's Apache-2.0 "mixture-of-architectures" model: a Qwen-based reasoning core calling Chandra OCR, Whisper+pyannote, SAM 2.1, TimesFM, Llama Guard and PaddleOCR as tools; GPQA Diamond 85.9, olmOCR-Bench 83.8 (self-reported); one 80GB GPU, offline ·source· T3 · huggingface.co - inkling — Thinking Machines Lab's open-weights base (2026-07-15); Apache-2.0, 975B-A41B multimodal MoE, 45T tokens, 1M ctx; self-declared not the strongest — a base to fine-tune; needs 2TB+ VRAM (600GB NVFP4)
- tinker — Thinking Machines' fine-tuning platform + OpenAI-compatible API for inkling; the business model behind the free weights
TechArticle / BlogPosting / Article / Dataset (sources)
-
claude-opus-5-5-announcement — Anthropic's launch post, 2026-09-22: 40% cheaper than Opus 5 on typical work, leads its own table except two rows Astra wins, concedes the margin over Fable 5.1 is smaller in real use; fallback safeguards, no thinking-off ·
source· T1 -
opus-and-sol-and-luna-willison — Willison, 2026-09-22: Opus 5.5, GPT-6 Sol and Luna in one day; price table, pelican tests, Luna in production; two side remarks corrected against OpenAI's page ·
source· T2 -
openai-api-pricing-docs — OpenAI's own price list, read 2026-09-23: GPT-6 and GPT-5.6, short/long context; GPT-5.6 Sol $4/$20 is promotional, "at least through November 21, 2026" ·
source· T1 -
system-one-models-and-jev — TypeSafe AI launch post (Diogo Almeida, 2026-09-15), via Telegram: "System One models" return typed values with probabilities (yes/no, choice ≤255, score) from a parallel sampler trained by "RLCD"; first model Jev in early access. Vendor numbers: 70–500 ms vs 3–329 s, $0.042/MTok input, output free, "193.6× faster, 444.6× cheaper" on four self-written workflows where accuracy is 67.8% agreement with an Astra + Fable 5.1 average, not ground truth. Nearest neighbour inception-platform-docs: the second non-autoregressive latency pitch here, this one with a self-graded eval ·
source· T3 · typesafe.ai -
inception-platform-docs — Inception Platform docs: Mercury 2.5 / Mercury 2 / Mercury Edit 2, diffusion LLMs behind an OpenAI-compatible API. List $0.20/$0.75 per 1M with an 80%-off promotion to $0.04/$0.15, cached input at a flat 10× discount, 260K context, 65k max output; block-wise streaming and an optional "diffusing" mode that streams intermediate noisy states; four
reasoning_effortlevels; FIM and Next-Edit endpoints for code; text only, no vision. No benchmark, no latency figure, no date ·source· T1 · docs.inceptionlabs.ai -
coderabbit-fable-5-1-review — CodeRabbit (1 Sep 2026): 45 code-review tasks / 105 known issues, Fable 5.1 vs Fable 5 vs Opus 5 vs GPT-5.6 Sol. Nobody wins on both axes (recall 55.2–69.7%, precision 31.6–39.3%), the 5.1 upgrade bought quiet not sight (−70% nitpicks, −34% comments, +49% latency, recall flat), and high reasoning scored worse than low. Task set and rubric unpublished ·
source· T2 · coderabbit.ai -
anthropic-model-docs — Anthropic's platform docs (models overview + effort reference): the operational T1 against the launch posts' promotional T1. Supplies what the Opus 5 announcement omitted — 1M context, 128k/300k output, May 2026 knowledge cutoff (four months newer than Fable 5's), Bedrock/AWS/Google/Foundry availability — and corrects the effort ladder from four levels to five: the launch post drops
medium, the level the docs tell developers to use "liberally" as the primary cost control ·source· T1 · platform.claude.com -
anthropic-scientist-access-expansion — Anthropic (2026-08-27): 10,000 subsidized seats for scientists (standard free, premium $15/mo at 5× limits, one year), AI for Science credits widened past biology at up to $50,000/project — and the gate that matters here, biology and chemistry researchers capped at Opus-class models with Mythos-class access running through a US-government-partnered program now enrolling its first participants ·
source· T1 · anthropic.com -
claude-nine-loop-amplitude-von-hippel — Anthropic guest post (von Hippel, 2026-09-25, paid; addendum by Lance Dixon): Fable 5.1 in the Claude Science harness computes a nine-loop planar N=4 super-Yang-Mills amplitude two independent ways, past the 2023 eight-loop human record; ~$1–2K/approach, bootstrap ~$100 compute; validator paid in Claude credits; concurrent human-led match by a CAS group using GPT-6 ·
source· T3 · anthropic.com -
deepseek-api-docs — DeepSeek's API reference (V4 Flash/Pro, thinking mode, context caching) ·
source· api-docs.deepseek.com -
fable5-gpt56-kimi-k3-creators — Medium (Christie C.): creator-opinion Fable 5 vs GPT-5.6 vs Kimi K3; benchmark-vs-real-utility thesis; sole source for the kimi-k3 claim ·
source· T4 · medium.com -
alphabet-q2-2026-earnings — Google (Pichai Q2 2026 CEO message): Gemini lineup spread — 3.6 Flash / 3.5 Flash-Lite / 3.5 Flash Cyber (domain-specialized) / 3.5 Pro testing / Gemini 4 pre-training; scale = ~22B tokens/min, 950M Gemini-app MAU, ~900M Gemma downloads; cloud/search/ADK facets cross-linked ·
source· T1 · blog.google -
open-source-llms-2026 — Hugging Face: the 2026 open-weight roundup (Llama 4, Qwen3, Gemma 4, Kimi, …) ·
source· huggingface.co -
gemma-4-12b-announcement — Google: Gemma 4 12B, encoder-free multimodal (vision+audio), 16GB local ·
source· blog.google -
google-ai-updates-may-2026 — Google: May 2026 AI roundup (Gemini 3.5, Omni, for Science; + out-of-scope products) ·
source· blog.google -
gemma-4-qat — Google: Gemma 4 quantization-aware-training checkpoints (Q4_0 + 2-bit mobile; sub-1GB E2B) ·
source· blog.google -
gemma-4-technical-report — Gemma Team: the Gemma 4 report (arXiv 2607.02770) — suite 2.3B–31B, dense + MoE, encoder-free only on the 12B, thinking mode; confirms the 31B the wiki had flagged as unconfirmed; its own benchmark claims stay flagged ·
source· T1 · arxiv.org -
awesome-gemma — curated Gemma directory: 16 first-party variants, 14 hosted resellers, orbital deployments; explicitly not an official Google product despite the
google-gemmaorg ·source· T3 · github.com -
llm-api-pricing-comparison — CloudZero: every major model ranked by cost; the ~600× spread ·
source· cloudzero.com -
llm-leaderboard-stats — llm-stats.com: 300+ models by composite intelligence/speed/price ·
source· llm-stats.com -
artificial-analysis — independent, methodology-disclosed benchmark (Intelligence Index v4.1: 9 evals, four weighted categories Agents 34% / Coding 24% / SciReasoning 24% / General 18%; blended price 7:2:1, TTFT) ·
source· T2 · artificialanalysis.ai -
astra-pelican-grid — Willison, 4 Sep 2026: the first non-first-party contact with astra and the first source anywhere to state its price — $10/$50 per million against Sol's $5/$30. SVG pelicans across four models (Astra, GPT-5.6 Sol/Terra/Luna) × five reasoning levels = 20 cells. Astra low beats every Sol level at any level, for 9.55 cents; Astra below max "doesn't reliably get the pelican legs on both sides of the frame"; he prefers Sol xhigh to Sol max. Astra uses fewer tokens per level, so the rate card overstates the gap. Astra and Luna both consume 16 input tokens where Sol and Terra use 26 — he asks whether the two are more related than OpenAI said; recorded as his question, not as a finding. One prompt, one sample per cell, no rubric, judged by eye — T2 for what it does have: four models the author didn't build, costs published per cell, failures shown ·
source· T2 · simonwillison.net -
qwen38-flash-next-willison — Willison link post: Unsloth GGUF quants of qwen38-flash-next (72.5 GB UD-IQ1_S / 78.9 GB UD-Q2_K_XL) running on a DGX Spark the day after release, pelican-SVG test at
xhigheffort; slim but the corpus's only non-first-party contact with the model (and it mis-states 125B params as "tokens") ·source· T2 · simonwillison.net -
moe-architecture — Wikipedia: Mixture-of-Experts definition (gating/router, top-k experts, total-vs-active params, shared experts) ·
source· T2 · en.wikipedia.org -
hf-quantization-concepts — Hugging Face Transformers: quantization concepts (int8 ~4× / int4 packing & bandwidth, FP8 E4M3/E5M2, affine, PTQ vs QAT) ·
source· T1 · huggingface.co -
claude-refusals-and-fallback — Anthropic API: the
refusalstop_reason + model-fallback (server-side/SDK/manual), fallback-credit billing, sticky routing ·source· platform.claude.com -
claude-api-rate-limits — Anthropic API: usage tiers, spend caps, RPM/ITPM/OTPM, token-bucket pacing, and cache-aware ITPM (cached input doesn't count) ·
source· T1 · platform.claude.com -
claude-message-batches-api — Anthropic API: the Message Batches API — 50% off all usage for asynchronous work, 100k-request / 256 MB batches, a 24-hour ceiling past which requests expire unbilled, 29-day result retention, and separate rate limits that don't spend the Messages-API budget. Caching inside a batch is best-effort only, so the cost levers don't simply add ·
source· T1 · platform.claude.com -
gemini-omni-flash-nano-banana-2-lite — Google: two Gemini generative-media models — Nano Banana 2 Lite (text-to-image, $0.034/1k, 4s) + Omni Flash (video, $0.10/sec, 10s) ·
source· T3 · blog.google -
prompting-claude-sonnet-5 — Anthropic docs: prompting/migration guide for Sonnet 5 — effort param (medium S5 ≈ high S4.6), adaptive thinking default, no sampling params (400), new tokenizer (~30% more tokens), literal instruction-following ·
source· T1 · platform.claude.com -
claude-sonnet-5-system-card — Anthropic: 145-page pre-deployment report for Sonnet 5 — full benchmark table (vs GPT-5.5 / Gemini 3.5 Flash), 1M/10M context, RSP determination, alignment & welfare; reveals a Mythos class above Opus ·
source· T1 · anthropic.com -
claude-opus-5-system-card — Anthropic: 194-page pre-deployment report for Opus 5 — says outright it is not more capable overall than Fable 5, very-low alignment risk, same ASL-3 protections as Opus 4.8; hallucinates 6% more than Opus 4.8 while 11% more accurate, but saturates the overconfidence and lazy-investigation evals ·
source· T1 · anthropic.com -
fable-5-vs-sonnet-5-token-cost — Njenga (Medium, member-only): Fable 5 vs Sonnet 5 cost in Claude Code — a
"Hello"cost $0.4745 on Fable vs ~3.2× less on Sonnet; Sonnet caches more (24.8k vs 15.6k) so bills less ·source· T4 · medium.com -
grok-4-5-price-vs-benchmarks — The Decoder: Grok 4.5 at $2/$6 undercuts Opus 4.8/GPT-5.5/Fable 5 ($10/$50); trails on coding benchmarks but xAI argues cost-per-task (4.2× fewer tokens) wins — the China price-play from a US lab ·
source· T3 · the-decoder.com -
openai-gpt56-grok45-clash — Business Insider: OpenAI GPT-5.6 (Sol/Terra/Luna) rolls out Thu (staggered per Trump admin) vs Musk's "Opus-class" Grok 4.5 days later; both pitch token efficiency; Fable/Mythos export-ban backdrop ·
source· T3 · businessinsider.com -
dont-use-fable-5-hassid — Ruben Hassid ("How to AI"): buyer's guide to Fable 5 — 3rd read of $10/$50 + pay-per-use after 2026-07-12, per-turn cost blowup (≈$14/40 turns), and a Fable-for-hard-goals / Opus-4.8-as-workhorse ladder ·
source· T3 · ruben.substack.com -
inkling-willison-review — Simon Willison on Inkling: the release facts, thin training-data docs, the US open-weights bench (Inkling + Nemotron + Gemma 4), and a pelican the model called a stork ·
source· T2 · simonwillison.net -
inkling-announcement — Thinking Machines Lab: the Inkling announcement + model card — 66-layer MoE (256+2 experts, 6 active), 1M ctx, benchmark table, VRAM needs ·
source· T1 · thinkingmachines.ai -
mistral-platform — Mistral's own site (2026-07): the model lab now a sovereign EU-hosted full-stack platform — agents (Vibe / Vibe for Code), Studio, Forge, Compute; Medium 3.5 / Small 4 / OCR 4 / Voxtral TTS named ·
source· T2 · mistral.ai -
claude-opus-5-announcement — Anthropic's Opus 5 launch post: $5/$25 (flat vs 4.8), paid fast mode (2× price / ~2.5× speed), effort low→max, six cost-per-task benchmark ratios with no absolute scores, and Mythos 5 named as a cyber/biology specialist rather than the ceiling ·
source· T1 · anthropic.com -
omniroute — MIT self-hosted ai-gateway (v3.8.49, ~30K stars): one local endpoint over a claimed 290+ providers / 500+ models, 4-tier cascade fallback, 19 routing strategies, 12-engine prompt compression (15–95%), ~1.53B free tokens/month pooled from 43 tiers — all self-reported ·
source· T3 · github.com -
opus-5-arc-agi-3 — The Decoder: ARC Prize scores Opus 5 30.2% on ARC-AGI-3 vs a 7.8% record (Fable-class ~20%), 90.4%/97.5% on -2/-1; carries its own counter-evidence — the gain shrinks to a 3-way tie on the private Witness benchmark, and Opus 5 postdates the benchmark's public format ·
source· T3 · the-decoder.com -
fugu-get-started — Sakana's Fugu onboarding docs: endpoint/keys/effort levels, per-key provider pools, Codex + Claude Code install; ships agent-conduct guards in
base_instructionsand a 2-hour stream idle timeout (vs Codex's ~5-min default); no pricing, no benchmark, no context window ·source· T1 · fugu.sakana.ai -
heretic — p-e-w's AGPL tool that automates abliteration: directional ablation with a TPE/Optuna search co-minimizing refusals and KL divergence; 28.0k stars, one pip command, 20–30 min on a 4B, 5,000+ tagged models on HF; the primary source the abliteration page was missing ·
source· T1 (benchmark table T3) · github.com -
arditi-refusal-direction — Arditi et al. 2024 (arXiv 2406.11717): refusal is mediated by a single direction across 13 open chat models — erase it and refusal stops, add it and the model refuses harmless prompts; the paper every abliteration tool cites ·
source· T1 · arxiv.org -
cerebras-pricing — Cerebras' pricing page: a speed-priced inference provider with no per-token rate card — daily-token subscription buckets (Code Pro $50/24M-day, Max $200/120M-day, both sold out), $5 free credit, Developer from $10 ·
source· T2 · cerebras.ai -
uncensored-ai-rekhi — Rekhi on Medium (2026-02-17, 8 min, 1.7K claps): the first source here on what happens downstream of abliteration — a rental tier at $30–$200/mo (dark-llm-services), hundreds of exposed guardrail-stripped deployments over a 293-day SentinelOne/Censys sweep, and the structural point that published weights cannot be recalled. Also conflates weight editing with fine-tuning and prompt jailbreaking, contra heretic's "no training at all", and drops the capability cost entirely. Every number is quoted from a report the wiki has not read ·
source· T3 · medium.com -
jev-ai-sdk-guide — Vercel KB (Ben Sabic, 2026-09-19): the second source on typesafe-ai's Jev and the first not by the vendor. Early access is over —
typesafe-ai/jevon AI Gateway, $0.042/1M input with free output held through GA. Documents the surface the launch post didn't: 64k context / 32k state, choice ≤255 options, score rubrics of 2–10 levels, ZDR per request, and aconfidencestatistic (distribution concentration 0–1, absent for booleans). And it states the trade the vendor's "can't hallucinate" elides — "your schema constrains those answers, but doesn't guarantee they're correct" ·source· T2 · vercel.com -
tiny-theory-of-mind — axiomic-labs's synthetic theory-of-mind benchmark (2,000 items, 40 constructs), via Telegram: scored by base-model log-likelihood rather than instruction-following, the only benchmark here built for sub-150M-parameter checkpoints; 36 self-published baselines, none of them a model this wiki otherwise tracks ·
source· T1 · huggingface.co -
lfm2-technical-report — liquid-ai's own writeup of LFM2 (arXiv 2511.23404, 31 authors): hybrid conv/GQA architecture via hardware-in-the-loop search, 350M–8.3B params, 10–12T training tokens, up to 2x faster CPU prefill/decode; self-reported IFEval 79.56% / GSM8K 82.41% on the 2.6B ·
source· T1 · arxiv.org
Person
- simon-willison — independent dev/writer; the methodology-transparent practitioner voice behind the GLM-5.2 read (and recurring cross-wiki)
- joe-njenga — Medium AI-tooling writer; practitioner "I tested X" anecdotes (source of the Fable 5 vs Sonnet 5 cost test) · T4
- ruben-hassid — "How to AI" Substack; non-technical AI consultant translating docs into buyer's-guide advice (Fable 5 usage/pricing) · T3
- diego-souza — GitHub
diegosouzapw; owner/maintainer of omniroute, the spoke's first self-hosted gateway - philipp-emanuel-weidmann — GitHub
p-e-w; author of heretic; a desktop/terminal-software developer, not an ML researcher — the packaging is the contribution - maxime-labonne —
mlabonne; wrote the write-up that popularized abliteration, and supplies heretic's weakest measured baseline (v2, 1.04 KL for the same 3/100 refusals Heretic reaches at 0.16). Deliberately thin — two sources name him in passing - matt-von-hippel — ex-theoretical physicist turned science writer (4gravitons.com); paid by Anthropic to write claude-nine-loop-amplitude-von-hippel · T3 source
- lance-dixon — SLAC/Stanford physicist; held the prior eight-loop amplitude record, independently validated Claude's nine-loop result for pay in Claude credits
- ramin-hasani — co-founder/CEO of liquid-ai; MIT CSAIL research affiliate; first author on lfm2-technical-report
- daniela-rus — co-founder of liquid-ai; director of MIT CSAIL; co-author on lfm2-technical-report
Synthesis
- synthesis — the thesis: collapsing price floor vs. premium frontier, open weights as the wedge
Bridge nodes (live in sibling wikis, linked cross-wiki)
anthropic · claude-opus-4-8 (../research-wiki) · llm-inference · kv-cache · cerebras-inference · cerebras-systems (../llm-inference-wiki)