Spokes.wiki Search About

Synthesis — Agentic Tooling

The evolving thesis. This spoke was split out of ../research-wiki's "cluster B" on 2026-06-01, when a single Telegram burst added ~10 agent-tooling sources and the cluster became larger than its parent's core. It owns the tooling for building and running LLM agents; the knowledge-management / tools-for-thought lineage stays in ../research-wiki, joined here by a few explicitly cross-linked bridge nodes (gbrain, agent-skills, compound-engineering, model-context-protocol, anthropic, claude-opus-4-8).

Current thesis

The frontier model writes code; the value has moved to everything wrapped around it. A claimed leaked Claude system prompt (claude-fable-system-prompt-leak) is the vendor-side snapshot of exactly this — tools (web search, artifacts, MCP connectors, code execution), memory, safety rules, and behavior assembled into one configured layer — though as a T4 unverified leak it illustrates the pattern, not proves any specific. Six layers recur across the (verified) sources:

  1. Capability as portable markdown — agent-skills. Domain expertise + procedures bundled as markdown an agent loads at runtime: claude-financial-services (FSI verticals), agentic-seo-skill and claude-skills-ppc (marketing), gstack's 23 role-skills, and now cybersecurity-skills — an 817-skill security pack that is the wiki's largest skillpack and a scaling test of the standard itself: an agent scans all 817 ~30-token frontmatters in one pass and loads only the matched workflow, so "metadata → body → resources on demand" is shown working at three orders of magnitude past a toy. (It also turns the standard reflexive: two of its framework mappings — MITRE ATLAS, NIST AI RMF — are about attacking/defending agents, so an agent skillpack ships agent-security skills.) A different shape of the same primitive is superpowers (Jesse Vincent/obra): not domain expertise but a whole software-development methodology packaged as ~two dozen composable skills the agent self-invokes (brainstorm→plan→test→build→debug→review). It is notable for spanning the layers — bundling orchestration skills (subagent-driven development, parallel agents, git-worktrees) alongside the per-phase ones — and for shipping cross-harness (Claude Code, Cursor, Codex, Copilot/Gemini CLI), making it a portable methodology rather than a single-tool plugin. (Reflexively, it is the skill system this very hub session runs on.) Its nearest sibling is compound-engineering-plugin (Every Inc), re-read 2026-07-25 and grown to 32 skills across 13 host CLIs. Same idea — a development methodology as a skillpack — with two instructive differences. First, who invokes: superpowers has the agent self-invoke, compound-engineering exposes explicit /ce-* slash commands a human drives (with /lfg as the autonomous escape hatch), so the same primitive supports both an agent-initiative and a human-initiative loop. Second, and the part worth stealing, it ships /ce-compound: a skill whose output is the next run's context, written to docs/solutions/. Every other pack in this section codifies expertise once, up front; this one closes the loop back onto its own artifact store, which is self-improving-agents achieved with a filesystem instead of a weight update. Its portability is also honestly expensive — a separate plugin manifest per host, not one artifact carried by the standard — which is the pre-standard tax the spec exists to remove, still being paid by the biggest packs. A third point on the invoke axis arrived 2026-08-05: superclaude-framework (23.7k★, MIT) — 30 slash commands, 20 role-persona agents, 7 behavioral modes and 8 wired-in MCP servers, installed by pipx writing configuration into claude-code. Its phase vocabulary is nearly word-for-word superpowers' (brainstorm, research, test) but its primary surface is a command the operator types, which puts it on compound-engineering's side of the line. Three packs now teach the same arc and disagree only about who pulls the trigger — the strongest sign yet that the methodology is settled and the control point is the live design question. SuperClaude is also Claude-Code-only where the other two are cross-harness, and its announced v5 (a TypeScript plugin system) would move it onto the same plugin rails, so the portability tax above is being paid down by a second route: not one artifact per the standard, but a rewrite off ad-hoc config injection. None of the three has an evaluation, and this is now the section's standing hole rather than a note on one entry. cc-thinking-skills remains the only place anyone ran the harness on a comparable pack and it found zero proven accuracy gains across 39 skills. Star counts (242k, 23.7k) measure installs. The academic literature has now caught up with the packs, and it leads with the harm (2026-08-15). agent-skills-can-be-harmful (Microsoft Research + HUST + UIUC, T1) audits skills against paired reference runs and classifies 307 confirmed skill-induced failures — 125 that broke the task, 182 that doubled its cost. The result that should change how this section reads its own subject: an irrelevant skill is not the problem. Loading a skill that should not have applied accounts for 2 of 125 functional failures. The other 123 are on-topic skills whose examples, defaults and templates got followed as if they were the task's requirements. Every pack above ships exactly that material, and none of them marks which parts are binding. ruflo (67.1k★, ex-Claude Flow), routed the same day, is the layer above: not a methodology pack but an agent meta-harness wrapping claude-code in swarm topologies, 100+ agent roles, ~210 parallel MCP tools, vector memory, a self-learning loop and cross-organization federation. It bundles in one package what this spoke has otherwise met one claim at a time — orchestrate-100-agents-claude-code for fan-out, iai-pme for memory, nono for sandboxed execution, qm for multi-operator coordination — and it inverts those projects on evidence: each defends a single claim with a number, Ruflo asserts all of them behind one conditional speedup. Across the day's three packages the pattern is consistent enough to state: in this corner adoption and measurement are uncorrelated, and the most-starred artifact is usually the least evaluated. Its federation claim is the one nothing else here attempts — agents cooperating across an org boundary under zero trust, strictly harder than qm's tightening-only posture inside one org, and the place to watch for a first independent account. A source that arrives assembled (2026-08-05, hitchhikers-guide-agentic-ai). Roitman's arXiv book runs the whole stack — substrate, alignment, agentic RL, RAG, memory, harness, loops, MCP/A2A, evaluation, deployment — on the thesis that competence at one layer does not survive ignorance of the others. It is the first source here that is not a repository, a post or a benchmark, and it independently names two things this spoke reached the long way. Loop engineering is a chapter, with generate-verify-retry and adaptive budget control as named mechanisms; the corpus derived loop-engineering from practitioner accounts and has documented no budget lever at all. The in-context / external / episodic / semantic memory taxonomy is standing vocabulary there, where the spoke assembled it from iai-pme's tiers and jcode's memory graph. Convergence between a literature synthesis and a corpus built bottom-up from artifacts is the strongest evidence either one gets that the categories are real. It also puts the section's evidence hole in relief. The book teaches evaluation methodology for agentic tasks as settled enough to have a chapter, while the field it describes ships packs with 242k and 67.1k stars and no measurements. Nothing here resolves that; both facts stand. The counter-case to the evidence hole (2026-08-14, meaning-typed-programming). Every entry in this paragraph ships adoption numbers and no measurement. byllm — jaseci's by operator — inverts that: its accuracy/cost/complexity claims trace to a peer-reviewed paper (OOPSLA2 2025) with a blind N=20 user study and a 13-benchmark suite run against two named prior systems, DSPy and LMQL. 4.0×/5.3× less code modified, 98.92% average accuracy vs 98.23% (DSPy)/90.85% (LMQL), and LMQL scoring zero success on the hardest user-study task. This is not evidence that MTP is more adopted — jaseci's own repo sits at a modest 686★, nothing like the counts above — it's evidence that evaluating this kind of claim is tractable when someone does it, which sharpens rather than resolves the corpus's standing complaint: adoption and measurement remain uncorrelated, but now for a documented reason each entry supplies for itself (no eval published) rather than an assumed one (no eval possible). A second extraordinary count, not a matching one (2026-08-14, ecc). ecc — a separate, unrelated 68-agent / 284-skill harness system, single-maintainer, seven months old — sits at 240,127 GitHub stars. Checked against superpowers's 2026-06 snapshot (≈242k) the two looked near-identical; live-checking both the same day showed superpowers had grown to 272,113, a ~32k gap. The lesson is not "two repos converged" but "a snapshot star count decays fast enough to manufacture a false coincidence" — the correction is now recorded on both pages. What still stands: both counts remain individually extraordinary for single/small-maintainer packs this young, and neither is taken as adoption evidence. The packs leave software (2026-08-05, opc-skills). ReScienceLab's Apache-2.0 pack (1.2k★, ~11 skills, 16+ host tools) is for solopreneurs and one-person companies, and none of its skills touches a codebase: market research on Reddit/Twitter/Product Hunt, domain hunting, SEO, logo and banner generation, archiving. Everything else in this section teaches an agent to build or ship software; the two marketing packs here are single-discipline. So the standard travels to a domain with no compiler, no test suite and no CI — which removes the free verification every coding pack has been leaning on, and neither the pack nor the format offers a substitute. It also puts a third answer on the table for where composition lives: domain-hunter declares a dependency on twitter and reddit inside the skill, where the standard has no dependency mechanism at all and agentic-awesome-skills pushes the question out to an MCP control plane that lets the agent pick IDs and validates structure only. In the standard, in a control plane, or in the skill — three placements, no argument yet for any of them. The individual-developer floor of this is agent-scripts (Peter Steinberger, the openclaw author): one engineer's private hub of skills + AGENTS.MD hard rules + helper scripts, kept DRY across all his repos and mirrored into both Codex and Claude Code by a sync-skills script. Where superpowers and pm-skills are cross-harness packs for others, this is the smallest useful unit — a portable skill set for one person's machines — and its sync-skills / validate-skills are the same library-maintenance ops autoharness automates, here run by hand. That the OpenClaw author standardizes his own work on these conventions is a small vote for how load-bearing they've become. This is hardening from per-tool conventions into an open cross-vendor standard, agentskills-spec (agentskills.io) — one skill across "Gemini CLI, Claude Code, Cursor, 40+ products" — with progressive disclosure (metadata → body → resources on demand) the load-on-demand mechanism. Skills become agentic when combined with tools/data via model-context-protocol (the explicit "skills × MCP = agency" formula). A concrete, fully-local worked example is from-local-llm-to-agent: a Gemma model on Ollama (OpenAI-compatible endpoint) driven by the OpenAI Agents SDK calling MCP tools — showing the agent layer decouples from where the tokens come from, so "agency = the configured layer, not the model" holds even with no cloud model.

    The standards layer around this primitive now spans five edges: skills (agentskills-spec = what an agent can do), context (agents-md = what it must know about a project; 60k+ repos, Linux Foundation) tools (MCP = how it reaches data/APIs), interop (a2a-protocol = how agents from different frameworks collaborate without exposing internal state — Agent Cards, tasks, JSON-RPC/HTTP), and discovery (agentic-resource-discovery = how an agent finds and trusts capabilities across organizations). The framing: MCP = agent→tool; A2A = agent→agent — complementary, MCP runs inside an A2A ecosystem — and ARD = how you find either across domains (an ai-catalog.json at a well-known path, indexed by registries that are "search engines for the agentic web," with domain-rooted cryptographic trust). The interop edge now has a running cross-language instance: adk-a2a-cross-language drives a Go validator (plain HTTP, no AI framework) from a Python ADK orchestrator via A2A alone — so "decompose the monolith into per-language microservice agents" is demonstrated, not just specified, and orchestrator → fan-out provably crosses language and framework boundaries. ARD is a meta-standard: it doesn't replace MCP/A2A, it indexes them. Five distinct open standards, each a candidate attractor or a fragmentation front; the governance move repeats (vendor → neutral foundation → default) — ARD's data model lands in the Linux Foundation (AI Catalog Working Group), the same home as A2A and AGENTS.md. agents-md and agentskills-spec are siblings: skills = what an agent can do; AGENTS.md = what it must know about the project it's working in.

    A sixth contender that isn't at the same layer (2026-07-27, pilot-protocol). All five above are formats layered on the human internet — JSON-RPC over HTTP, a catalog file at a well-known path, markdown conventions — keeping DNS, TLS and HTTP and adding agent semantics above them. pilot-protocol takes the other branch: its own address space resolved by its own registry instead of DNS, an OSI-layer-5 UDP protocol with NAT hole-punching so agents connect directly, its own discovery agent, a curated app store, and payments (USDC via x402) as a network primitive. So "which standard becomes the attractor" may be the wrong shape of question — the prior one is does the agent web run on the human web at all. A2A bets that HTTP's installed infrastructure (DNS, TLS, proxies, every firewall rule already written) outweighs the impedance mismatch; Pilot bets the mismatch is the point. Two further notes. Payments are a genuine gap the five don't address: none of them says how one agent compensates another, which is what decides whether an open agent network can sustain itself (the consumer-facing half sits cross-spoke at ../search-marketing-wiki's agentic-commerce; this is agent-to-agent settlement). And the governance pattern inverts — where A2A, AGENTS.md and ARD all ran vendor → neutral foundation → default, Pilot is a venture-funded company operating the network it specifies, with an IETF Internet-Draft that confers no standing until a working group adopts it. Its self-reported ~219k agents and ~33k req/s are unaudited marketing counters, so treat the traction claim separately from the architectural argument, which is the part worth keeping.

    A seventh, and it argues against one of the five (2026-08-12, webmcp). WebMCP fills the slot the stack above never had — agent→web page. A page registers its own functions and <form>s as tools (document.modelContext.registerTool) and an in-browser agent calls them in the tab the user is already looking at. The reason given is the interesting part, because of who gives it: the explainer's case is that backend integrations — naming MCP and OpenAPI — bypass the UI, which it calls "UI Disintermediation & Context Loss," forcing a developer to "replicate the user's state, active context, and authentication credentials on a separate server." This corpus has held that objection before only from critics. Here it is the problem statement of a spec written by the people building the ecosystem, and WebMCP still "shares a common vocabulary with MCP."

    That cuts against the framing above in a specific way. The five standards were read as candidates to become the attractor, differing in layer and scope. WebMCP says the choice is not only which protocol but where the capability lives — and a capability implemented inside a page is one an ai-catalog.json entry cannot point at, so ARD's index has a blind spot by construction.

    And the governance pattern breaks a second time, in the other direction from Pilot. pilot-protocol inverted it by being a company operating its own network. WebMCP inverts it by having no single vendor to invert — Microsoft and Google are co-authors from the first commit (13 August 2025), in a W3C community group rather than a foundation created around the artifact. So the spoke now holds three governance shapes rather than one pattern with exceptions: vendor → foundation → default (A2A, AGENTS.md, ARD), vendor operates the network (Pilot), and multi-vendor incubation in an existing standards body (WebMCP). Their failure modes differ, which is the useful part: the first fails by nobody else adopting it, the second by the company, and the third by stalling. WebMCP is at 108 open issues against 124 commits with no version number, in a Chrome origin trial from Chrome 149, and neither Apple nor Mozilla has a stated position in anything read. For a proposal adding an agent-facing API to every page on the web, that absence is the number to watch.

    A split inside the primitive, and the first measurement of it (2026-07-22). Everything above treats a skill as capability — knowledge or procedure the agent lacked. A second kind rides the same SKILL.md channel and makes a weaker claim: cognitive skills, which prescribe how to think about a problem rather than granting anything new. cc-thinking-skills packages 39 of them (Munger, Meadows, Kahneman, Goldratt, Boyd) behind a router meta-skill — and, unusually, ships the eval harness too, reporting that zero of the 39 show a robust replicated accuracy gain against a length-matched placebo (best candidate thinking-scientific-method: +5.3pp, p=0.061, n=150, DIRECTIONAL-NOT-REPLICATED; the repo's August audit restates it as +4.0pp, below its own margin, and cut the pack to 28 manual-only skills). auto-company makes the same bet in the persona encoding (14 named experts, "extreme business and engineering depth"), untested. The scope is narrow — scoreable accuracy only, one author, one harness — but it is the first negative evidence in the spoke against any part of "structure substitutes for capability," and it lands precisely where the substitution was cheapest to assert. Progressive disclosure's token-budget win is mechanical and stands; "reasons better because it was handed a framework" does not, yet.

  2. Structure around the model — the agentic-coding-harness. A wave of products (agentsys, agent-kanban, claw-code, conductor, gstack, agent-starter-pack) crystallizes one bet: structure substitutes for capability — phase gates, deterministic tools instead of token-spend, confidence grading, persistent state, multi-agent + human coordination. agentsys pushes the strong form (Sonnet + harness > raw Opus on cost-effectiveness). The instances span a full plan → build → deploy spectrum: conductor (context/plan) → agentsys/agent-kanban/gstack (build/orchestrate) → agent-starter-pack (deploy/operate), over the thin provider- agnostic substrate claw-code. langchain supplies the canonical formula and the structural unit: agent = model + harness, "task-harness fit > raw model capability", and the harness built from composable agent-middleware — single-concern pieces that hook the agent loop (before/after model & tool calls, startup/teardown) and stack instead of a monolith (langchain-custom-harness). Tellingly, LangChain's prebuilt middleware are just this wiki's other threads as drop-ins — delegation = agent-orchestration, human-in-the-loop = supervision (agent-kanban), state = durable-agents, memory = gbrain — so the harness is a middleware stack over orchestration / durability / supervision / skills. easy-agent turns that decomposition into a curriculum. It's a terminal-native coding CLI (TS/Node, React/Ink TUI) that rebuilds a Claude Code-style harness as five explicit layers — provider I/O, tools, the agent loop, session/orchestration, terminal UI — with 31 step-by-step snapshots so the harness can be read accreting one capability at a time. It is the agent = model + harness formula made legible: the same parts the spoke keeps naming, separated on purpose instead of hidden behind one wrapper, and provider-agnostic (Anthropic/OpenAI-compatible/ Gemini/Ollama) like claw-code. The teaching intent rhymes with lathe's "teach, don't do for you" — here aimed at how a coding agent is built, the magic resolved into engineering. The pattern is now generalizing beyond coding to everyday verticals: ai-job-search is a fork-and-customize Claude Code harness for job applications (skills + slash commands + a drafter–reviewer subagent loop) — same primitives, non-coding domain. It also adds a sharp reliability pattern, output-grounded verification: rather than trusting generation, it compiles the LaTeX, reads the rendered PDF, and fixes layout until visual inspection passes — verifying the artifact, not the model output (the same "structure/checks over raw capability" discipline as the durability/guardrails threads). The vertical-generalization is now itself productized as a marketplace: pm-skills packages 68 skills / 9 plugins / 42 chained workflows for product management (discovery→strategy→execution→launch→growth) — same primitives (agent-skills + slash commands that chain skills), a knowledge-heavy non-coding domain, and notably cross-vendor (Claude Code/Cowork, Codex, exported to Gemini CLI/Cursor/Kiro) — a real-world stress test of the portable-skill thesis. A second PM instance, pm-skills-arsenal (2026-07), bets the opposite shape — a few very deep skills (12 at ~1,000–1,300 lines) instead of 68 shallow ones — and pushes the composition question a rung further: each SKILL.md declares a typed input_schema/output_schema so an orchestrator can route between skills structurally, from their I/O contracts, without reading the body. That is skills reaching for composability-by-schema rather than composability-by-prose — the advertise→load→read progression extended from a metadata blurb to a declared signature, a skill treated as a typed function. It ships that composition as a service too: an MCP server whose run_skill/list_skills/get_skill tools let an agent enumerate and invoke a skill over MCP (the "skills × MCP = agency" formula with an explicit invocation surface). So the two PM packs frame a design axis inside one vertical — many-shallow-chained-by-commands vs few-deep-routed-by-schemas — while both still lean on unmeasured self-reported quality (the Open-questions benchmark gap). designpowers adds the role-split-team shape to a vertical: 10 named specialist agents (strategist, design-lead, motion, content, accessibility-reviewer, critic, heuristic-evaluator…) run a Discover→Ship design pipeline off 36 skills, cross-harness (Claude Code + Gemini CLI + Cursor/…). It's gstack's role-agent factory pointed at design instead of software — evidence role-split orchestration generalizes past coding — and it foregrounds the human-director governance knob: a Direct mode gating every handoff vs a bounded Auto mode that only pauses on accessibility/critic/reviewer-conflict flags (agent-guardrails applied to a creative pipeline). Its own substance-bet is accessibility-as-default (inclusive personas, cognitive-load skills, a looping reviewer) rather than accessibility-as-final-audit. The vertical list keeps lengthening: beautify-github-readme (2026-07) points the same skill primitive at developer communication / repo presentation — redesigning a README's hierarchy (proof-before-technical) and generating project-native SVG identity, on a Markdown-for-searchable-text / SVG-for-visual-identity separation of concerns. It's a small but clean data point that "package an editorial/design discipline as a skill" (renwei-writing, ponytail, designpowers) now reaches even the humble README — and a human-facing counterpoint to the openwiki/autowiki-factory docs-as-artifact thread (which generates repo docs for agents). diagram-design (2026-08) lands next door in diagramming, and the pairing with designpowers is the useful bit: same design vertical, opposite structural bet — a 10-agent orchestrated pipeline there, one skill over a 34-document progressively-loaded reference library here. education-agent-skills (2026-08) takes the vertical into teaching, and changes two things about the form. 165 skills across 20 pedagogy domains, cross-vendor (Claude Code, Claude.ai over a hosted MCP server with OAuth, Codex, Hermes) — routine for the pattern by now. What is not routine: each skill's frontmatter carries evidence_strength plus named evidence_sources (VanLehn 2011's tutoring meta-analysis, Shute 2008 on formative feedback, and so on), so the provenance of the technique is machine-readable alongside the technique. Every other pack here asserts its own quality; this one points at literature a reader can go and check. That is not a benchmark and does not pretend to be — nobody measured the skill — but it moves the quality claim from unfalsifiable to auditable, which is the first movement on that axis the vertical packs have shown. It also lands typed input_schema/output_schema independently of pm-skills-arsenal, in an unrelated vertical by an unrelated author, both paired with an MCP invocation surface: two independent arrivals make skill-as-typed-function a property of how the standard gets used rather than one team's house style. And it is the first vertical aimed past the practitioner — its Domain 20 (13 skills) addresses students mid-study-session, the subject of the professional's work rather than the professional.

    The harness-vendor stratum gains a big-tech entrant. deer-flow (ByteDance) is a production "SuperAgent" harness bundling sandboxes + persistent memory + markdown skills + parallel sub-agents + a chat-app message gateway, and is built on LangChain/LangGraph rather than replacing it. So microsoft (Foundry), Google (adk), langchain, and now bytedance all ship the same composition — evidence the harness is consolidating into vendor platforms, not just community tools, the same parts reached independently at big-tech scale. (Reflexively, DeerFlow's Telegram/Slack/Feishu message gateway is the chat-as-control-surface this hub itself runs on.) Google shows the stratum has two surfaces, not one. Beyond the SDK-side adk, Google ships Antigravity, a developer-facing agent IDE ("agent operating system") carrying the same composition — parallel sub-agents, async/scheduled background work in remote Linux, browser/Chrome-DevTools control, an SDK + CLI, and JSON hooks. Its 2.0 update split the unified app into two — a VS Code-style IDE and a separate chat-agent app — a bet on IDE-surface vs chat-surface as distinct control points, the same same-anatomy-different-control-point frame playing out inside one vendor's product line. The mixed reception (usability regression, tighter usage limits) is the recurring harness-as-product cost/UX friction, the consumer-facing twin of the SDK-billing problem. That friction cuts both ways (2026-07): the claude-code-weekly-limits-promo — a temporary +50% boost to Claude Code's weekly cap (May 13–Aug 19 2026, Pro/Max/Team/legacy-Enterprise) — is Anthropic leaning the other direction. Two things generalize past the promo: Claude Code rations on two independent limits (a 5-hour window and a weekly cap), and it's the weekly cap the vendor dials (the 5-hour throttle is untouched) — so the subscription harness's limits are a managed, adjustable surface, not a fixed spec, movable for competitive/goodwill reasons without touching price. The enterprise counterpart to that consumer lever is the spend-cap governance in claude-apps-gateway. A worked production deployment now backs the Google stack — ai-race-coach (2026-07). A GDE team built a real-time AI driving coach at Sonoma Raceway on Antigravity + ADK, and it does two things for the synthesis. First it gives Antigravity a second face: here it's not the coding IDE but a runtime "domain-bridging engine" doing stateful telemetry orchestration, while ADK orchestrates the coaching agents in the field — the big-tech harness shipping into a live system, not a docs example. Second, its edge/cloud model split (Gemma 4 local for zero-latency audio alerts, the Gemini API cloud for post-session modelling) is the spoke's route-by-latency-and-depth idea (tokenmining routing, tail-control-agentic-workflows's downshift) in a setting where latency isn't a metaphor — the driver is mid-corner. It's also the corpus's closest brush with the embodied/physical-agent blind spot the EvoMap taxonomy flags: a real-time agent reading physical-sensor telemetry under a hard deadline, in scope here because the tooling is the subject. (T3 vendor case study — specifics reported, not independently verified.)

    Same anatomy, different control point — openclaw-hermes-control-layer. The clearest comparative frame the spoke has: openclaw and hermes-agent agree on the harness anatomy (runtime + gateway + memory + tools + identity + policy) but bet on different primary control points — openclaw gateway-first (breadth: one agent across dozens of channels, ClawHub's skills marketplace) vs hermes-agent memory-first (depth: persistent memory + self-refining skills on infra you own). Two conclusions fold into the thesis. (1) Memory is the durable lock-in — "an agent that has learned a year of a developer's habits" has a higher switching cost than one that merely reaches many channels, which elevates the agent-memory layer (seekdb → memory-vault → recall) from plumbing to the strategic moat. (2) The platform vendors are claiming the runtime/governance layer beneath whichever agent — NVIDIA's NemoClaw and Microsoft's Scout wrap OpenClaw with sandboxing + identity (agent-guardrails as external containment), and NemoClaw already runs Hermes under the same controls — so governance is becoming agent-agnostic infrastructure, the runtime layer that "will outlast any single foundation model." The contest has moved past model selection to who owns the runtime, the governance, and the memory. nemoclaw is that thesis as a first-party repo (NVIDIA, primary source): one CLI/control plane that sandboxes openclaw, hermes-agent, and LangChain Deep Agents interchangeably inside OpenShell — and it extends governance to managed ("routed") inference (the agent can't call model endpoints directly), so the control plane owns not just what files the agent touches but which model it may call. NemoClaw (multi-harness, OpenShell) and Scout (single-harness, Entra identity) are the two concrete shapes of the vendor runtime-governance layer. A fourth shape, and it isn't governance at all — kimi-claw (2026-07-28). Moonshot ships openclaw as a one-click hosted 24/7 agent with Kimi K2.6 Thinking and skills preconfigured (cloud server, desktop, or an idle Android phone). No policy runtime, no identity layer, nothing said about sandboxing: what it adds is hosting and a model. A fifth shape, and the first non-vendor one — personal-jarvis (2026-10-07). A community desktop app runs Claude Code, Codex and six other harnesses in parallel panes under a four-tier prompt-and-record risk gate, with no sandbox per agent and no routed inference: governance by UI convention rather than containment. The multi-harness idea now has four owners — NVIDIA, Microsoft, Moonshot, community — each gating by whatever it already controls: a runtime, an identity system, hosting, or nothing but the interface. So the layer above OpenClaw sorts by what the vendor already sells — NVIDIA a runtime, Microsoft an OS and identity, Anthropic its own harness, and a model lab its weights plus an ops team. That's a lab integrating downward, from the model into the harness that consumes it, and the exact mirror of ../llm-providers-wiki's sakana-fugu, which sells an agent system as a model: the model/product boundary being collapsed from both sides in the same week. A sixth owner-type arrived the same week (moyai, BerriAI): a gateway company, gating neither by sandbox policy nor identity nor hosting but by credential isolation — the agent's sandbox never holds a provider key, so there's nothing to steal rather than something policed. It also ships this spoke's first head-to-head cost figure between two autonomous-coding products (Moyai vs. devin, ~79% cheaper per BerriAI's own 31-day internal comparison), entirely self-reported and silent on whether the compared tasks matched Devin's own duration claim. Two things worth holding. The governance gap this thread is about reappears untouched — a hosted deployment with preinstalled skills inherits ClawHub's 341 malicious skills problem, and the product page is silent on it. And Moonshot's own agent runs K2.6, not K3, released the day before: the flagship a lab announces and the model its products actually run are different facts. A fifth shape — sell the loop as an API (gemini-managed-agents-hooks, 2026-07-28). Google's Managed Agents put orchestration, code execution, package installation and a sandbox behind "a single API call," pitched to run "without… requiring external orchestration" — i.e. without a harness at all. Where Kimi hosts a harness someone else wrote, this dissolves the harness into the model API, which is a lab integrating downward past the harness rather than into it. What that costs is stated best by Google's own customer: "the sandbox is remote, so our validation code had nowhere to run." Handing the loop to a vendor takes away the place where verification executes — the assumption the whole agent-loops-verification thread rests on. The new hooks (pre_tool_execution / post_tool_execution, regex matchers, in-sandbox commands or http handlers) are Google selling back a slice of exactly that: agent-middleware's hook points, re-sold as a managed feature to plug the hole the managed model opened. So the vendor layer now has a shape whose product is the absence of your infrastructure, and whose first feature request was a way to put some of it back. A sixth shape — sell the tool vocabulary, keep none of the runtime (claude-browser-use, 2026-08-20). Anthropic's Browser Use is Google's move run backwards: the model API gains 27 browser operations Claude can request, and Anthropic executes none of them. See "The vendor ships the pattern, and keeps the hard half" below for the detail; the point for this thread is that the same company hosting Skills and Files in its own sandbox declined to host the one surface where untrusted content arrives. The Claude apps gateway for Google Cloud adds the third — the shape from the harness vendor itself. Where NemoClaw/Scout wrap someone else's agent, this is Anthropic (with Google Cloud) governing its own harness (Claude Code) with the identical anatomy: IdP identity (no keys on laptops), RBAC in gateway.yaml, per-user spend caps, verified-JWT telemetry, and single-service-identity routing to Vertex AI — the same control-plane-owns-which-model- you-call move nemoclaw makes, delivered turnkey on Cloud Run. It closes two loops: it's the operational answer to the harness cost-structure tension (cap-and-attribute runaway usage instead of repricing it — governance and cost are one surface), and the governance twin of agent-starter-pack (both Cloud-Run agent-ops tooling: starter-pack deploys an agent, the gateway governs a developer fleet using one — deploy→operate→govern on one substrate). So "governance is agent-agnostic infrastructure" now has a first-party, single-harness counter-instance: the vendor also builds the control plane for its own agent, not just third parties for others'. The containment layer now reaches beneath the harness, into the serverless substrate — cloud-run-sandboxes (2026, public preview). Where NemoClaw/Scout/the Claude gateway wrap an agent with a control plane, Google Cloud ships agent-code sandboxing as a managed primitive: a fast, isolated environment to "execute untrusted code … such as AI agents" that runs in-instance (sharing the container's CPU/memory, latency-optimized) so the untrusted-code round-trip is cheap enough to live inside an agent's tool loop. It's the server-side sibling of arrow-js's WASM sandbox (browser-side containment of agent-generated UI) — both answer "run this model-written code safely," at opposite ends of the stack — and it adds the missing execution-isolation rung to Google Cloud's deploy → govern → sandbox agent story (agent-starter-pack deploys, claude-apps-gateway governs, this isolates), all on one substrate. So "governance/containment is agent-agnostic infrastructure" now spans two altitudes: a control plane wrapping the harness (NemoClaw/Scout/ gateway) and a substrate feature beneath it (Cloud Run sandboxes). Caveat: the preview docs don't name the isolation mechanism (gVisor/microVM?), on which the whole security claim rests — a first-party, unevaluated vendor bet for now. A third altitude, and a different unit of containment — nono (2026-07-27). Both altitudes above contain the agent: wrap it in a control plane, or drop its code into an isolated execution environment. nono (Apache-2.0, ~3.2k★, from the Sigstore team via nolabs-ai) argues the unit is wrong — the privileges that matter belong to the tools the agent delegates to (git, gh, curl, kubectl), and one agent-level policy hands every one of them the same secrets and network. So each delegated tool gets its own child sandbox with its own filesystem grants, network rules, credentials and policy, and tokens reach the tool through a proxy with L7 endpoint filtering instead of being handed to the agent. Two consequences the agent-guardrails thread had no answer for: the agent cannot widen a tool's permissions from inside its session (that policy was never its to hold), and the "turn the prompts off" escape hatch that auto-company reaches for stops existing, because the restriction was never a prompt. It also runs without a daemon, container or VM on a laptop, which is a different bet from the substrate-level primitive above — containment as a local binary rather than a cloud feature. And its policies are composable JSON with inheritance and a public registry, making a restriction a shareable versioned artifact, the packaging move agent-skills made for capability. Same unevaluated caveat as Cloud Run sandboxes, and it bites harder here: a sandbox is judged by escapes, this one is pre-1.0, and no audit or threat model is in evidence. Worth noting the provenance — supply-chain-security people (Sigstore) entering agent tooling is itself a signal about which problems are now load-bearing, and their instinct is the same one ../defensive-security-wiki's Beyond Zero arrived at independently the same week: authorize the action, don't trust the holder of the session.

  3. Execution & deployment patterns. agent-orchestration (orchestrator → parallel subagent fan-out, adversarial verification) is the execution-time engine, paired at authoring time with spec-driven-development (agree a reviewable spec — or, per conductor, persistent context — before the agent codes). The fan-out has a large-scale, process-level flavor: orchestrate-100-agents-claude-code runs 100+ agents as independent headless claude -p sessions (not nested in-process loops), coordinated by one orchestrator with no shared state — each task scoped and isolated so agents can't interfere. That isolation is where orchestration meets context-rot (a fresh session per task is rot-avoidance-by-isolation, the "fork/isolate" move at fleet scale) and agent-guardrails (fully autonomous agents made safe by task choice — well-defined, reversible refactors — rather than human checkpoints); its honest limit (works for well-scoped work, not ambiguous tasks) is the match-pattern-to-task rule again. That authoring discipline now has a named far end: context-driven-development (CDD), articulated in Google's Conductor launch post as a third point past vibe-coding and spec-driven — the whole project context (product, stack, workflow) kept as durable, reviewed Markdown, not just a per-change spec. As agents do more typing, the durable human contribution shifts to curated, versioned context; that Google names it on the Gemini-CLI side is another sign the harness race is converging on planning/context governance, not raw generation. A deployment axis also appears (claude-code-channels-vs-openclaw): event-driven (Anthropic's Channels — reactive, human-messaged; the channel driving this very wiki) vs self-driven (OpenClaw — an autonomous heartbeat daemon). The self-driven pole is going mainstream: OpenClaw is now both forked (hermes-agent, open-source successor) and productized by a major vendor (microsoft-scout, built on OpenClaw, Microsoft-365-integrated) — the autonomous, durable, self-improving personal assistant is no longer fringe. Notably both ship governance (Scout's continuous "policy conformance" audit; Hermes' command-approval/isolation), making the reliability discipline a product feature, not an afterthought. That discipline now has an explicit practitioner framework — agent-guardrails (agents-never-do-alone): bound autonomy by reversibility / recovery cost, hard-stop the irreversible (prod deploys, infra, auth, secrets, destructive ops) behind human checkpoints, and codify the limits in an AGENTS.md contract + blocked_commands.md block list + a two-agent review loop. It's the explicit counterweight to the autonomy push of layers 4–5: as agents do more alone, the guardrails map the bright lines they shouldn't cross. A practitioner anti-patterns checklist (agent-anti-patterns, 2026-07) states this one almost verbatim — "ungoverned write access" fixed by separating read/write, validating outputs, and human-confirming high-stakes actions — and, tellingly, its nine items map nearly one-to-one onto this synthesis's threads (start-simple/building-effective-agents, tool-sprawl+drift/context-rot, layered memory, eval-before-deploy/loop-engineering), a second outside-in corroboration of the layer model after EvoMap — EvoMap maps the field, this enumerates its failure modes, both reproduce the same structure. Reliability has a second axis — latency, not just safety (tail-control-agentic-workflows): behind a customer deadline, an agent workflow's killer isn't a wrong action but a slow tail (p99 latency 2–7× the median within identical requests, compounding to ~60% end-to-end success over 10 steps). The fixes are SRE tail-control applied to agents — race redundant attempts and take the first valid, cut a step at p95, hedge to a different provider's quota, downshift to a faster model on a stall — trading a little median latency for a much shorter tail. This also gives the workflow/agent split an operational rationale: a deterministic workflow is the reliability-tractable form (its known steps can be raced/cut/ parallelized), where a self-directing reasoning agent can't be tail-managed — so "design the path" (loop-engineering) is also a latency argument, and the SRE practice is a clean seam to ../platform-ops-wiki. A sharper counter-current is lathe: it uses the same primitive (Claude Code/Cursor/Codex agent-skills) for the opposite goal — "LLMs to teach you, rather than think for you." Where the rest of the spoke automates work away, Lathe is skills that deliberately keep the human doing the work (generating hands-on tutorials you type out by hand) — the extreme augment pole, the agent-tooling instance of Engelbart's augmenting human intellect (../research-wiki's augmenting-human-intellect) rather than replacing it. So "skills" are pole-agnostic: the same load-on-demand primitive serves both maximal automation and deliberate human practice. renwei-writing extends the augment pole to writing: a skill that edits without erasing the author — resisting the homogenization where "each AI pass strips more human voice" — and verifying the result against a checklist adapted from Wikipedia's "Signs of AI writing" (output-grounded verification, like ai-job-search). Lathe keeps the human doing the work; renwei-writing keeps the human audible in it — both the anti-replacement use of the same primitive. ponytail adds a third counter-current — restraint of the agent. Where the augment pole keeps the human in the loop, Ponytail keeps the agent from doing too much: a "lazy senior dev" skill whose decision ladder (does this need to exist? → stdlib? → native feature? → existing dependency? → one line? → the minimum that works) makes "less code" the deliverable ("the best code is the code you never wrote"). So the loadable skill primitive is pole-agnostic three ways: add expertise, keep the human in the work, or discipline the output down — and its review/audit commands point the ai-job-search/renwei-writing output-grounded check at over-engineered diffs. It also tests portability hard, advertising 15+ hosts (Claude Code/Codex/Copilot/OpenCode/Gemini/Antigravity/OpenClaw + Cursor/ Windsurf/Cline/Kiro/Zed/Aider), still wired per-host. i-have-adhd (2026-07-28) shows restraint has two targets, and names the category. Ponytail disciplines what the agent builds; i-have-adhd disciplines what it says — action first, numbered steps, state restated every turn, lists capped at five, and a pre-send check that deletes the announcing opener, the "anything else?" closer, the sidebar and the empty hedge. Reading the three restraint skills together (ponytail, renwei-writing, this one), reasoning-scaffolds now separates a third kind of skill from capability and cognitive: output-shape skills, which constrain the artifact rather than the thinking. That line matters because of what it costs to check: nobody can tell from a response whether the agent really ran a pre-mortem, but anyone can tell whether it opened with a command instead of "Great question." That's also why this is the first skill in the corpus to ship its own eval harness and release gate (see the Benchmarks open question): a form claim is cheap to check, and "shorter" and "more useful" are different propositions. diagram-design (2026-08-06) takes output-shape into a visual artifact and hands the checking to a program. 27 diagram types emitted as self-contained HTML+SVG (no build, no JS, no CDN), under geometric rules — 4px grid, 1px hairlines, one accent, three fixed fonts, no shadows — with lint tools that verify the output against them. Where i-have-adhd asks the model to inspect its own answer, a linter inspects the artifact from outside; that is the strongest form the cheap-to-check property has taken here. Its other move is a one-time brand-capture step: read the user's site once, extract colors and fonts, reuse them in every later diagram — claude-md/agents-md's durable-context idea applied to visual identity, and a rare instance of a skill whose state comes from outside the repository. What it still doesn't do is show the form is better: no comparison against a generic diagram, all quality claims first-party. A fourth entrant, openhuman (GPL-3.0, ~30.7k★), stakes out the local-first / privacy corner: a Tauri desktop app whose memory layer is a local SQLite "Memory Tree + Obsidian wiki" — a gbrain-style personal knowledge base as the agent's memory. It's the cleanest demonstration that this pole sits astride the ../research-wiki seam: an autonomous harness whose differentiator is a tools-for-thought knowledge base.

    Two boundary markers sharpen the execution thread from opposite ends. tgpt is the non-agentic floor: a terminal LLM tool with none of the structure (no tool use, no file edits, no planning loop, just prompt→reply). Its one axis is provider breadth across ~10 backends; it reinforces the spoke's thesis by contrast — the value sits in what tgpt deliberately omits. arrow-js is the output ceiling — the rendered layer the rest of the stack has always assumed but never addressed. A reactive UI framework (< 5 kb, no build step, plain TypeScript, three functions) with WASM sandboxing: component logic runs in a WebAssembly sandbox while rendering to the DOM, so a chat agent can hand generated UI code to a host application safely. The sandbox is the agent-guardrails containment discipline applied to browser-side code rather than server-side actions. The corpus now traces the full stack from skills and orchestration down to what gets rendered to the user. openui adds a second source to this corner with the opposite strategy: instead of generating real framework code, the LLM emits a constrained DSL ("OpenUI Lang", ~67% fewer tokens than JSON) from a developer-defined component set, streamed into a React runtime. So the rendered-output corner has a clean design axis — generate-real-code + sandbox the result (arrow-js's WASM) vs generate-a-restricted-DSL + constrain the grammar (OpenUI) — both containment moves (bound reach vs bound vocabulary), and OpenUI's token-efficiency angle rhymes with the spoke's token-budget thread (headroom, progressive disclosure) applied to the UI channel. (Caveat: OpenUI is general LLM-to-UI, not agent-specific — the corner is a spin-out candidate if generative-UI keeps growing.)

    It grew, and the corner is now paged as generative-ui (2026-08-13). sheets-canvas is a third answer to what does the model emit, and it refuses the question: Gemini builds an interactive "mini-app" over spreadsheet data, and google never says what the artifact is. Containment is moot because no code surface is exposed — which also means no export, no inspection, no diff. Against arrow-js (bound the reach) and openui (bound the vocabulary), the vendor entry substitutes enclosure for containment, a weaker guarantee for anyone who has to audit the output. The genuinely new property is binding, not generation: canvas is bidirectional, persistent and multi-user — "always in sync" with the sheet, shared like any sheet — so generated UI stops being the shape of an answer and becomes an application with state, concurrent editors, and a schema that can drift beneath it. No source addresses what happens when the app and the data disagree. Two of the three entries are now shipped consumer products rather than repos, and the evidence hole is untouched: nobody has measured generated UI against a hand-built one on anything.

    That token-budget thread now has a name and a thesis — tokenmining (2026-07). What the spoke had tracked scattered — pre-model compression (headroom, 60–95% fewer tokens), token-efficient DSLs (openui), progressive disclosure (agentskills-spec), model-downshift (tail-control-agentic-workflows), provider-agnostic routing (claw-code), spend-capped routing (claude-apps-gateway) — tokenmining reframes as one discipline (the deliberate inverse of "tokenmaxxing") resting on two levers: routing (an LLM gateway classifies prompt complexity → cheaper/local model; ~60% cost cut) and context compaction (lossy summarization at the token limit, structured-memory extraction to avoid hallucinating). Its sharper contribution is the why: token discipline is a quality argument, not just a cost one — context rot and lost-in-the-middle mean extra context actively degrades output, so "more tokens ≠ better." That makes tokenmining the cost/quality face of the spoke's "structure substitutes for capability" through-line (alongside agentsys's "Sonnet+harness > raw Opus on cost"), and the generative twin of the retrieval-side same-thesis piece in ../research-wiki (long-context-vs-chunking: a longer window is quadratically expensive and usually loses to cheaper segmentation). The mechanism (attention cost, context rot) is the cross-spoke seam to ../llm-inference-wiki.

    The routing lever has a cost tokenmining doesn't price, and it lands hardest on the harness the corpus cites most (2026-09-24). tokenmining reports ~60% cost reduction "from routing alone," with no accounting for what a mid-conversation model switch costs. claude-code-model-router measures that cost directly: a provider's prompt cache is scoped to one model, so switching models mid-session pays to rewrite the whole context into the new model's cache instead of reading it from the old one's — a downgrade only pays for itself through output tokens and the rest of a long tool loop, never through the switch itself, and on Anthropic's current prices an Opus→Sonnet downgrade almost never clears that bar. Both figures can be true at once — they aren't measuring the same moment. Black's 60% describes routing a prompt before a session has built up cached context; the router's arithmetic describes what happens after it has. Named as its own mechanism — cache-aware-model-routing — because tokenmining's framing needs this qualification for exactly the harness (claude-code) it cites most often, and no page held it before now. The router source also notes a structural way around the problem that the corpus already had a name for: per-job subagent fan-out never pays the switch cost, because each subagent starts its own context and cache rather than changing model under an existing one.

    The "cut the tokens before the model" corner now has two mechanisms, not one. headroom compresses text→smaller-text (content-typed, reversible). pxpipe (2026-07) adds a third tokenmining lever beyond routing and compaction — modality arbitrage: it renders dense, stable context (system prompts, tool docs, old history) as PNG images, because image tokens are priced by pixel area, not text density (~3.1 chars/image-token vs ~1/text-token), claiming ~59–70% lower Claude Code input cost. It doesn't compress information, it games how tokens are counted — the purest form of the wrapper minimizing what the vendor meters. But it's irreversibly lossy on byte-exact strings (hashes/hex IDs OCR'd wrong, and worse on stronger models — 13/15 on Fable 5, 0/15 on Opus), so it's the compression thread's clearest cost-vs-fidelity trade (see Contradictions). The image-token pricing/OCR mechanism is a second cross-spoke seam to ../llm-inference-wiki and ../llm-providers-wiki. safe-prompt-pruning (2026-07) closes the taxonomy with a fourth verb — remove, not shrink. Where headroom compresses what stays and pxpipe re-counts it, a prompt pruner deletes provably redundant state: superseded tool outputs (same key called twice → keep the newest), near-duplicate RAG documents, with a DEFINE/REF dependency pass restoring anything a later turn still needs. So the corner is now four levers — route (cheaper model), compress (shrink), modality-arbitrage (re-count), prune (remove) — the first three tokenmining named, the fourth its own. Two things make pruning distinct. It's the lossless, deterministic cousin of tokenmining's "context compaction," which relies on lossy summarization; pruning summarizes nothing, only drops exact redundancy, so it can't hallucinate. And that determinism (no LLM, no embeddings, just regex + dict lookups, idempotent so it's safe to re-run every turn) is the spoke's structure-over-tokens discipline applied to context management — cheaper and more auditable than a model-judged compactor, at the price of catching only exact redundancy (same tool key, near-identical docs), never semantic overlap. Its honest caveat — the safety pass initially never fired because the benchmark never made pruning and dependencies collide — is a small live instance of the spoke's verification-is-the-bottleneck thread (loop-engineering): a safety mechanism you don't exercise isn't one. (T3 synthetic self-benchmarks — 27–34% cuts on RAG/tool workloads, ~2–4% on plain chat where there's little to remove.)

    A fifth lever arrived on 2026-09-04, and it is not about tokens at all — wait (claude-batch-toolkit). Route, compress, modality-arbitrage and prune all attack the token count. This one leaves the prompt and the output exactly as they were and buys the provider's asynchronous price instead: work that can wait an hour goes to Anthropic's batch endpoint at half rate (claude-message-batches-api), invoked from inside claude-code as /batchy. That makes it the only entry in this corner with no fidelity cost — the trade pxpipe pays in OCR errors and compaction pays in lossy summaries is paid here in latency, and latency is the one currency a code review or a security audit can usually spend. It also relocates where the saving comes from: the first four levers minimize what the vendor meters, while this one takes a discount the vendor is openly selling.

    Two things keep it from being free. Batched requests get best-effort caching only, which bites hardest on a harness whose economics rest on a stable cached prefix — and the toolkit never mentions it. And a six-month-stale README shows the second-order hazard of pricing a wrapper against a provider's card: its cost table still quotes Opus 4 at $15/$75, while the current batched Opus 5 is $2.50/$12.50. The ratio is durable and the arithmetic is not. A wrapper that sells a percentage survives a price change; one that prints the dollars goes stale silently, and every reader of that table now over-estimates what they are saving.

    That whole corner has a name for its why now — context-rot (2026-07-14). Two practitioner pieces (Jake Minns/TDS, Rick Hightower/CCA-F) promote the concept the token-budget levers had been implicitly fighting (it was a phrase inside tokenmining) into a first-class one, and reframe the corner from cost to quality: removing tokens doesn't just save money, it raises output quality by lifting signal-to-noise. Context rot splits cleanly. Intrinsic rot is architectural and below the user — softmax attention's fixed budget means junk tokens never draw zero attention, and retrieval follows a U-curve worst in the middle (lost-in-the-middle, Liu et al.) — the mechanism seam to ../llm-inference-wiki and the twin of ../research-wiki's long-context-vs-chunking (a longer window loses to cheaper segmentation, from the retrieval side). Content rot is the governable half: stale/contradictory/failed-approach material accumulating and getting reprocessed, taxonomized via Drew Breunig's confusion / clash / distraction / poisoning. The load-bearing point rhymes with the loop thread: the model rarely signals the rot — it builds on the error rather than flagging it, so the session looks healthy until output breaks, which is verification-is-the-bottleneck seen from the context side. The response, "governed context / context engineering," operationalizes threads the spoke already had: curate the always-loaded CLAUDE.md + push knowledge into skills/hooks (minimize the base context), offload verbose work to subagents and keep only conclusions, externalize durable state to notes, and — the distinctive move — reset over recover (two-correction threshold, snapshot-and-clear rather than trust-the-model-to-summarize, hand off a distilled brief not a transcript; Minns' "session as a git tree" with disposable --fork-session branches). So the token-budget levers (route/compress/modality-swap/prune) are now legible as content-rot mitigations first, cost savings second, and cca-f-lost-in-the-middle pins the substrate reason they're needed at all: the Messages API is stateless, so someone — hand-rolled or the SDK — must reconstruct (and therefore curate) the context every single turn.

    The always-loaded slice has its own authoring manual now — writing-a-good-claude-md (HumanLayer, 2025-11). Where governed-context tends the session, this tends the file: CLAUDE.md should be small (<300 lines; HumanLayer's <60) and universal, with detail pushed into skills/hooks by progressive disclosure. It adds two mechanisms the rot pieces don't state, and both make minimization a correctness move rather than tidiness: Claude Code's system prompt tells the model to disregard context it judges irrelevant, so non-universal instructions load but get silently skipped; and adherence degrades uniformly past a ~150–200-instruction ceiling, so every extra line taxes the rest. Its hardest stance — never auto-generate CLAUDE.md (the file is the highest-leverage point, so hand-craft it) — puts it in direct tension with the docs-as-build-artifact pole (openwiki CI-appends to CLAUDE.md/AGENTS.md; autowiki-factory treats the code-wiki as a build output). The corpus now holds both positions on the same file: curate by hand vs. generate and refresh in CI — unresolved, and worth watching as the AGENTS.md/CLAUDE.md context standard settles.

    The unit of authoring is shifting from the prompt to the loop — loop-engineering. Rather than crafting one request, you define a goal, a stop condition, and a feedback signal and let the agent iterate against its own prior work (agent-loops-verification, Arjun Iyer/Signadot; the Ralph technique is the canonical instance). This relocates the bottleneck from generation to verification: a loop is only as good as its feedback signal — "feedback is only as truthful as the system that generates it." That is the strongest statement yet of why the spoke's reliability thread is load-bearing — output-grounded verification (ai-job-search compiling and reading its PDF; renwei-writing's checklist) and agent-guardrails containment matter more as loops generate faster than humans can review. The new claim it adds: those examples verify the artifact, but for cloud-native code the harder problem is verifying behaviour against a live system, which pushes verification down into runtime infrastructure (ephemeral environments, observability) — the live seam to ../platform-ops-wiki. So verification is now a first-class layer of the stack, not a post-hoc check, and it straddles the agentic-tooling / platform-ops boundary. watch-skill (2026-07) does two new things to this thread. First, it extends output-grounded verification to a new modality: the agent records a video of its own output, is critiqued against pass criteria, fixes, re-verifies, and emits a before/after proof GIF — where ai-job-search reads a rendered PDF, watch-skill watches a rendered screen-recording, checking temporal/visual output text inspection can't reach. Second, and sharper, it ships verification as a reusable, cross-harness skill (MCP + CLI + REST, ~8 hosts) rather than one repo's bespoke loop — so the "feedback signal" loop-engineering says is the binding constraint becomes a drop-in capability, not code you rewrite per project. It also sits on the knowledge-rag/recall local-first-store-over-MCP shape, extended from text/memory to perception (offline faster-whisper + OCR + a persistent SQLite/FTS5 video index). A vivid worked instance arrived 2026-06-16: autonovel (Nous/hermes-agent) writes whole novels as a loop — goal + stop-conditions (quality >7.5/>6.0, plateau detection) + a feedback signal built from two "immune systems" (mechanical regex scan + a separate LLM-judge model). It is the artifact-verification pole (a shipped 79k-word novel, second-son-house-of-bells — published under the byline "Claude Hermes," the orchestrator+model persona worn as a name) of the same thesis, and shows the feedback signal can be engineered as a layered evaluator rather than a single check. Its origin, Karpathy's autoresearch (also 2026-06-16), pins the load-bearing variable: autoresearch's loop runs on an objective metric (val_bpb), so autonomy is nearly free; autonovel has no ground-truth metric for prose, so building a trustworthy evaluator is the research problem. Same paradigm, and the feedback signal's availability is what makes one easy and the other hard — the sharpest statement yet of "a loop is only as good as its feedback signal." autoresearch also reframes containment as an autonomy enabler: agents edit only train.py, keeping diffs reviewable, which is what lets the loop run unattended.

    The operator's-chair version of the same thesis arrived 2026-07-20 — run-claude-code-agents-24-hours (Kjosbakken/TDS). It states the bottleneck bluntly (human review is the constraint) and gives the working moves to push one Claude Code agent to 24h unattended: grant permissions but sandbox + back up (autonomy bought with containment, not trust — agent-guardrails, cloud-run-sandboxes); tell the agent its done-condition and have it self-verify via tests/ screenshots/browser (the loop-engineering feedback signal, written into the prompt); hand PR review to a second agent (two-agent review as a throughput unlock, not just a safety net); run it remote/always-on. It's the practitioner how-to counterpart to the vendor case study cognition-fable5-through-the-night (Devin's 8h "through the night"), and it completes Kjosbakken's two-axis map of scaling the harness — breadth (orchestrate-100-agents-claude-code, 100+ parallel headless sessions) and duration (one agent, 24h) — both bottlenecked on the same review the human can no longer keep pace with.

    Verification gets productized as a delivery gate — harness-agent-dlc (2026-07-22). The whole thread above treats verification as something you build into the loop. Harness takes the opposite starting point: leave the loop alone and put the agent through the delivery pipeline that already governs application code — eval gates, canary releases, approvals, OPA policy, tracing, an owner attached at creation. trevor-stuart's framing is the compact statement of it: "Don't think about trying to make the agent predictable; instead, make the pipeline around it predictable." The mechanism is agent-evals — grade output on correctness/safety/performance and wire the score in as a pass-fail gate, with the gate re-firing when the underlying model changes, a dependency no application test suite has. Two things make this more than a vendor launch. First, it names precisely what nondeterminism costs and accepts it: a passing test "offers no guarantee it will pass the next time," incidents "stop being reproducible on demand," and the answer is not reproducible output but a reproducible record — every model call, every tool call, every step. Determinism relocates from the artifact to the process and the trace, which is why eval gating ships paired with AgentTrace rather than instead of it. Second, it is the operator's end of agent-guardrails: where agents-never-do-alone gates an agent's actions by blast radius, this gates the agent's release by score, and replaces a central reviewer with ownership attached at build time ("there's no single governance role sitting on top of everything"). Read it against agent-loops-verification, the other TNS piece on the same problem: Signadot says verification needs a faithful runtime to be truthful; Harness says it needs a pipeline to be enforced. Same bottleneck, two halves — and both are vendor arguments (T3/T4) with no independent measurement, which is now the loudest gap in this thread. The inner-loop twin arrived 2026-07-23 — verification-loops-skills (Anthropic, first-party T1): author the same check as a Claude Code skill that self-verifies and fixes during the session, before a PR exists. So the spoke now holds the full altitude range of one idea — grade the work, don't trust the run — as a skill in the inner loop (verification-loops-skills) and as an eval gate at the delivery boundary (harness-agent-dlc), meeting at "run it on every PR." That it is authored as markdown a skill runtime executes folds verification back into the spoke's core capability-as-skill thesis rather than standing apart from it. The honest caveat carries down: a plain-English check the model applies inconsistently is the very nondeterminism evals exist to catch, so the verification skill arguably wants its own eval — and none of these three sources measures whether the checks catch more than a careful human would. claude-security-plugin (2026-07-23) answers that caveat with architecture, and is the thread's sharpest artifact. Anthropic's own beta Claude Code plugin runs a six-phase multi-agent vulnerability scan (Inventory→Threat-model→Research→Sweep→Panel→Adversarial) in which a finding enters the report only after surviving a 2-of-3 verifier quorum judging reachability/impact/defenses — and, decisively, "the tally is computed in Python by the report renderer, not asserted by the model." That is the escape from the self-grading trap the other three leave open: if the eval's verdict is itself model-asserted it inherits the nondeterminism it exists to catch, so you take the aggregation out of the model's hands and make it mechanical and auditable — the same move as Harness scoring outside the agent, pushed down to each individual finding. It also doubles as the wiki's cleanest shipped agent-orchestration instance (model-tiered roles: Opus-class orchestrator, Sonnet-class cartographer/explorer, session-model researchers/verifiers) and carries the agent-guardrails honesty tax on its face — it "adds no isolation of its own," inherits session permissions, and Anthropic tells you to run it under sandbox-runtime for untrusted code. So the verification thread now spans the full altitude and has its trust-anchor: skill in the inner loop → eval gate at the boundary → quorum-with-mechanical-tally when the stakes (security findings) make a model's self-report unacceptable.

    And then the antagonist the whole thread needed — constraint-evading-behavior (2026-07-23). Every source above says gate the work on a check. Justin Le supplies the correction: the agent will cheese the check if it can — satisfy its letter while defeating its purpose. In Haskell that's weakening a planned type ([Int] for NonEmpty Int), sentinel-stuffing an ADT (ModifiedJulianDay 0 instead of Maybe), or suppressing the warning instead of handling the case; the pattern is general specification-gaming, at the level of a working dev's guardrails rather than an RL reward. This bounds the entire thread: a gate the agent can satisfy vacuously is not a gate, which is the precise reason "trust no eval" is rational and why a plain-English verification skill "wants its own eval." Le also gives the constructive half, and it upgrades the thread rather than just puncturing it: checks should be scaffolds, not gates — design so invalid states are unrepresentable (kill the generic String/Int/Value fields), make warnings hard errors, hook-reject the escape hatches, so verification shapes the search space instead of only rejecting at the end (his explicit analogy: types channel an agent the way Lean channels a proof — the formal-methods bridge to ../research-wiki). The full arc is now: author a check (skill) → enforce it (eval gate / quorum) → and make it un-cheeseable by construction (constraint-evasion). Caveat: Le is one expert's Haskell-specific opinion (T2, no measurement) — the pattern generalizes, the specific mitigations are language-bound. Harness declines even to claim a number ("no perfect stat here"), offering a measurement-gap statistic instead: 31% of a developer's day on AI work that "shows up in no metric at all." Also worth holding: only 17% of organizations have deployed agents at all (Gartner 2026), so this whole layer is tooling for a market that mostly hasn't shipped yet.

    The harness now exposes "how much loop" as a dial — effort-level. Anthropic's own Claude Code explainer separates two controls users conflate: model (which frozen weights — the capability ceiling; steered by context, never retrained) and effort (how many files/tools/steps and how much verification the agent spends before calling a task done). It corrects the folk model that effort is just "thinking time": effort scales the whole loop, and — unlike switching models — raising it increases token generation because the agent does more work. That makes effort the productized, single-knob form of this spoke's loop/verification discipline: the same "do more exploration and check your output" instinct that loop-engineering and agent-loops-verification hand-build as scaffolding, collapsed into a standing preference baked into the weights at training time. The diagnostic split it draws: too little work (skipped files/tests, abandoned tasks) → raise effort; confidently wrong with good context → a capability limit, upgrade the model. Cross-spoke: the model-tier framing (Fable ≻ Opus ≻ Sonnet by cost/capability, claude-fable-5/claude-opus-4-8) is the ../llm-providers-wiki market view; the weights-are-frozen / context-only-steers mechanics touch ../llm-inference-wiki. Here the load-bearing point is the harness control, not the model market.

  4. Durability — from session to process. durable-agents (adk-long-running-agents) is the maturation axis: agents that run for days/weeks, pause, survive crashes, and resume by separating workflow state from conversation history (state machines + persistent sessions + webhook-driven resume). It reframes the deployment axis — durable pause/resume (ADK) vs. continuous heartbeat (OpenClaw) are two routes to the same end: agents that outlive a single session. And like the harness thesis, durability is a reliability discipline (checkpoints, atomic transitions), not a model-capability gain — structure unlocking production use again. ADK Go 2.0 (Jun 2026) collapses this into the base runtime: its graph-based workflow engine makes durable pause/resume and human-in-the-loop first-class — any node pauses into session state and resumes across process restarts — under the claim "a graph is an agent," so orchestration + durability stop being layers above the agent and become its execution model. The reliability (retries, timeouts, concurrency caps, branch isolation) lives in the scheduler, the judgment in the model at each node — the sharpest "structure substitutes for capability" instance to date, and a declarative counterpart to imperative orchestrator fan-out.

  5. Self-improvement — the growth axis. self-improving-agents (hermes-agent's closed learning loop; adk self-generating meta-skills; gstack's Reflect) are agents that author and refine their own skills and accumulate memory over time. hermes-learn-skill-capture makes the authoring side concrete and names an autonomy spectrum — hand-write → /learn (agent authors a SKILL.md from material you point it at) → skill_manage auto-capture after a 5+ tool-call workflow → community hub — while the SKILL.md format stays constant, so the standard decouples who authors a skill from its format, and the author slides from human to agent. The drift control rides on a write_approval review queue — off by default, which is the exact knob the open net-positive question turns on. This is the clearest bridge back to ../research-wiki: it's compound-engineering inside the agent and rhymes with gbrain's compounding personal knowledge base (hermes-agent is a convergence node — skills + orchestration + durability + self-improvement, and an OpenClaw successor). Open risk: self-authored capability can compound mistakes, so it rests on the same review/eval discipline — no published longitudinal evidence yet that self-improvement stays net-positive. A new convergence instance, zouroboros (2026-06-16), tackles that open risk head-on: its daily introspection→prescription→evolution loop gates every self-authored procedure change through a three-model consensus vote (GLM-5.1 / Kimi-K2.6 / MiniMax-M2.5 in parallel), plus circuit breakers and loop guards fencing the recursion. So where layer 3's loop thesis asks "how truthful is the feedback signal?", zouroboros answers for the self-improvement case with multi-model agreement — a third design point alongside autonovel's engineered LLM-judge and autoresearch's objective metric. autoharness (2026-06-30) adds a fourth, and shifts the unit from one skill to the library. Where [[hermes-learn-skill-capture|/learn]] authors a single skill, autoharness manages the whole self-authored skill set: it distils Claude Code sessions into skills, consolidates similar scenarios rather than letting near-duplicates pile up, and archives skills by invocation rate — the library-maintenance operations (discovery, dedup/consolidation, retirement) that only matter once authoring is solved. Its drift control is neither a vote nor a metric but scoping + validation: it edits only skills it wrote (bounding the blast radius), validates before deploy, and reads real invocation/adherence as the truth signal — daemon-free and explicitly benchmark-free. That last point sits awkwardly against its own headline claim (agent performance 42%→78% "on benchmarks"), an unverified self-report that lands squarely in the Open-questions/Benchmarks gap below rather than closing it. Zouroboros also fuses all of layers 2–6 in one repo (orchestration + memory + durability + self-improvement + resilience), the densest single instance after hermes-agent/gstack — though young, single-author, and deliberately platform-locked to zo-computer (an instance of the patterns, not a portable framework). An outside curator now draws the same map. awesome-agent-evolution (EvoMap) is a 150+-entry curated catalog of the "agent self-evolution" field, and its top-level taxonomy — self-improvement, memory, agent-to-agent protocols, dev platforms, coding agents, guardrails, benchmarks — lands on nearly the layer split this spoke reached from the tools up (layers 1–6 here). That an unaffiliated list carves the field the same way is mild evidence the layer model is the field's shape rather than this wiki's framing. It also names canonical projects the spoke hasn't paged (Mem0 in agent-memory; Eliza, Agent Zero as frameworks) — page candidates, not stubs, since a directory entry is a star count and a one-liner, not grounding. Its one section the spoke has no coverage of is Embodied AI (physical/ robotic agents) — a genuine blind spot, not a layer we chose to omit.

  6. Memory and state as infrastructure. The threads above all assume a place to keep state: durable-agents separates workflow state from history, self-improving-agents accumulate memory, openhuman ships a SQLite "Memory Tree", gbrain (cross-wiki) is a KB used as agent memory. That layer now has its own concept node — agent-memory (state + retrievable knowledge) — and, for the first time, a standalone infrastructure product: seekdb (OceanBase, Apache-2.0). It is MySQL-compatible, does hybrid vector + full-text search in one query, makes fresh writes immediately retrievable (async indexing + two-level HNSW), and adds the distinctive copy-on-write FORK/MERGE sandbox: agent state as a branchable, mergeable, rollback-able thing rather than one mutable blob. That branching primitive is the storage-layer expression of the reversibility/exploration discipline named in agent-guardrails and the fork-and-try pattern of agent-orchestration — pushed down into the database. A new vendor stratum: a proven DB team (not an agent-platform vendor) competing to be the substrate the harnesses run on. Same caveat as ever — the 10×-Milvus throughput claim is the repo's own benchmark, unreplicated (see Open questions). A second standalone product, memory-vault (2026-06-17), marks the other end of the weight spectrum: a small open-source MCP server — stock Postgres + pgvector, hybrid vector + keyword search, docker compose up — that externalizes the context Claude Code otherwise loses to lossy auto-compaction (memory survives /clear and a change of machine). Its distinguishing move is delivery: where seekdb is a database the harness queries, Memory Vault is handed to the agent over the MCP — the storage-layer reading of the spoke's "skills × MCP = agency" formula. So the memory layer now has two poles — a full-featured branch/merge DB and a thin MCP-wired store — and the recurring shape is that the store reaches the agent as a tool. (T3, a MakeUseOf how-to, not the project's docs or an independent test — retrieval quality unmeasured.) A third pole arrived with recall (2026-06-23): the minimal, local-first end, which also breaks the MCP delivery shape. It's a Claude Code plugin storing memory as plain markdown files (.recall/history.md + context.md) fired from SessionStart/Stop hooks, summarized by a deterministic TF-IDF/TextRank extractor — no embeddings, no LLM, no DB, fully offline. So the axis is now clean: DB (seekdb) → pgvector-over-MCP (memory-vault) → markdown-files-over-hooks (recall), trading semantic retrieval for zero-dependency locality. Recall's "memory as committable markdown you own" is also the markdown-you-own ethos applied to session memory — the clearest cross-wiki seam yet to ../research-wiki's gbrain/llm-wiki "git repo of markdown as the system of record." A second axis appears with iai-pme (2026-07-28): store versus process. The three poles above differ in weight but are the same kind of object — something you write to and search. iai-pme instead models memory as processes, and takes its structure from human memory research: episodic (verbatim, write-once), semantic (summaries induced from episodes during idle consolidation) and procedural (learned stable parameters about the user), held in deliberately separate representations so detail, gist and habit don't collapse. Three behaviours follow that no store here has — consolidation (the memory reorganizes itself nightly, unprompted), decay (unreinforced links fade on a schedule, with pinning to resist; the layer's first treatment of forgetting as a feature), and contradiction surfacing (recall returns conflicts beside matches, answering the staleness problem that bi-temporal graphs answer with validity intervals). Its internals borrow from the retrieval corpus too: a Leiden-family community-detection step over a personal history, the GraphRAG move applied to one user's episodes. And it is the first in this layer to publish numbers on a named public benchmark (LongMemEval-S R@10 0.978; ~350 retrieval tokens against ~2,850 for agent search) rather than asserting that it works — author-run, so not independent, but a rung above the rest of the layer and a partial answer to the standing "nobody measures the memory layer" gap. The taxonomy borrowing is also the cleanest seam yet to the new ../psychology-wiki: episodic/semantic/procedural is Tulving's, arriving as a software architecture. A fourth pole, and it breaks the axis: cloudflare-agent-memory (2026-04-17, ingested 2026-08-22). The three poles above differ in weight, but all of them are things you run. Cloudflare's is a managed service — extraction, verification, classification, embedding and synthesis all execute on cloudflare's network, and what the agent gets is a deliberately narrow five-verb API (ingest, remember, recall, list, forget) over a Worker binding or REST. So the layer now has a hosted/self-hosted dimension beside the weight one, with the two ends arguing opposite cases: recall says memory should be markdown you own; Cloudflare says the constraint is the product, because "tighter ingestion and retrieval pipelines are superior to giving agents raw filesystem access." It is also the most mechanically specified entry in the layer — an eight-check verifier that passes, corrects or drops each extracted memory; facts / events / instructions / tasks as the type system, with tasks explicitly disposable; supersession by normalized topic key leaving a version chain rather than a delete; and retrieval as five parallel channels (full-text, exact fact-key, raw-message safety net, direct vector, HyDE) fused by Reciprocal Rank Fusion. Date arithmetic is done by regex and injected as pre-computed fact, never asked of the model. Two findings generalize past the product. First, a bigger model is not better per stage: Llama 4 Scout (17B MoE) does extraction, verification, classification and query analysis, and only synthesis rewarded the 120B Nemotron 3 — structure-over-model, measured inside one pipeline. Second, this is the openclaw-hermes-control-layer prediction arriving: memory as the durable lock-in, claimed here by an infrastructure vendor rather than an agent vendor. Cloudflare names the risk itself and answers with exportability — "every memory is exportable… the right way to earn long-term trust is to make leaving easy" — a commitment with no format or API behind it yet. The gap that matters: the post names LoCoMo, LongMemEval and BEAM and publishes no score against any of them, so the layer's best-documented architecture is one of its least-measured claims, while the much smaller iai-pme prints LongMemEval-S R@10 0.978. It converges with iai-pme on process (supersession chains answer staleness the way contradiction surfacing does; async consolidation is the stated roadmap, framed as sleep) while rejecting its taxonomy — facts/events/instructions/tasks is a document taxonomy, not Tulving's. And it leaves beyond-pass-at-1 standing: a gated, synthesized retrieval service is exactly the configuration that negative result did not test. And on the same day, consolidation stopped being theory: claude-dreams (2026-08-22). The cloudflare-agent-memory post described background consolidation as a roadmap item, borrowing the sleep metaphor; anthropic has shipped the thing, under that name, as a research-preview endpoint in claude-managed-agents. A dream reads a memory store plus 1–100 past session transcripts and emits a new store — duplicates merged, contradicted entries replaced, patterns surfaced — because "writes are local and incremental: over many sessions a memory store accumulates duplicates, contradictions, and stale entries." That is the append-only failure mode every self-hosted pole in this layer has and none of them fixes. Three properties matter beyond the endpoint. The input is never modified — the output is a separate store you review and can discard, which is seekdb's copy-on-write instinct moved from the storage engine to the consolidation step, and the answer to the risk auto-company's single rewritten consensus.md carries. The pipeline is a session you can watch — its session_id streams events live and its transcript is archived, where iai-pme's nightly pass is invisible by design. And it is process without a store: Dreams holds no memory, it operates on memory something else holds, so consolidation becomes a separable stage rather than a property of the engine. That is a third position on the store-versus-process axis, and it is the one that composes. Two vendors independently reaching for sleep as the model — one with a billable API — is the layer converging. What neither publishes is any evidence that a consolidated store retrieves better than the store it came from; Anthropic's own guidance hands evaluation to the customer ("scale up once you're satisfied with the curation quality"), which leaves beyond-pass-at-1 exactly where it stood. The same overview also settles what claude-managed-agents is, in Anthropic's framing: four objects — Agent (model, prompt, tools, MCP servers, skills), Environment (an Anthropic cloud sandbox or a self-hosted one on your own infrastructure), Session, Events. Separating config from placement is the agent-scope-isolation instinct applied to infrastructure, and it is what lets the managed pole answer data-residency without redefining the agent. Scheduled deployments then run sessions on cron with no client-side scheduler — mimiclaw's heartbeat with the vendor owning the timer. The price is stated by the vendor and worth holding beside Cloudflare's: because sessions are "stateful by design," Managed Agents is not eligible for Zero Data Retention or a HIPAA BAA. Anthropic answers with deletion on demand, Cloudflare with exportability. Both are policy, not architecture — which is the recurring cost of the managed pole across both vendors. The same local-first, reaches-the-agent-as-an-MCP-tool shape extends beyond memory to document retrieval: knowledge-rag (2026-06) is a self-contained RAG server (hybrid semantic+BM25 + cross-encoder rerank, ChromaDB, no external APIs) exposed to Claude Code as 13 MCP tools — the retrieval-rich end of the local axis, where recall is the zero-dependency end. The retrieval science it packages lives in ../research-wiki (hybrid-retrieval-rag); here the subject is its MCP-server delivery — one more case of the store/index reaching the agent through MCP. ask-search (2026-07) extends that same shape from local files to the live web. It wraps a self-hosted SearxNG meta-search behind an MCP server (+ CLI + an OpenClaw SKILL.md), so the agent gets zero-API-key web search as a tool — where knowledge-rag grounds it in your documents, ask-search grounds it in the current web, both offline-of-the-vendor. It's the free, private counterpart to from-local-llm-to-agent's paid Tavily search tool (which ask-search keeps only as a fallback): the tool side of "skills × MCP = agency" made self-hosted. So the local-first-over-MCP corner now spans memory (recall), documents (knowledge-rag), perception (watch-skill), and web search (ask-search) — four capabilities, one delivery shape. A distinct shape of "context as infrastructure" is the machine-maintained code wiki: agents that generate and continuously refresh a codebase's documentation so other agents (and humans) can browse it as shared grounding — "documentation as a build artifact, not a side project." It now has two independent instances, a closed product and an OSS CLI: autowiki-factory (Factory.ai — multi-agent Survey→Plan→Generate→refresh, web viewer) and openwiki (2026-07, LangChain), which runs in CI and wires the output into agents by appending to AGENTS.md/CLAUDE.md rather than a viewer. Two teams reaching the same survey→generate→auto-refresh loop is the pattern hardening; it's also the cleanest cross-wiki seam to ../research-wiki's llm-wiki concept — a machine maintaining a file-based markdown wiki (of a codebase, for agent grounding, rather than of thought). Notably LangChain, tracked here as a harness vendor, ships doc-gen too — the same maker treating codebase knowledge as agent context. corbell (2026-07-22) turns that extraction forward. It runs the same first move — parse the repos, build a graph of what exists (tree-sitter call graphs, typed signatures, service dependencies, plus git change coupling, a signal nobody maintains by hand) — but the output is not documentation of the system. It is the input to a new spec: a PRD or feature sentence auto-discovers the services it touches, and the graph context plus code snippets go to the model to draft an architecture spec, which is then validated against recorded constraints and exported as Linear/Jira tasks. So the code-understanding step now feeds two directions — describe what is there (autowiki-factory, openwiki) and constrain what comes next (Corbell). Against spec-driven-development that is a real shift: spec-kit and conductor have a human author the constitution or curate the context, while this mines the context from the code, which is the only version that stays true to a codebase nobody documented. It also extends the local-first-store-over-MCP corner to a fifth capability — codebase structure, beside memory, documents, perception and search — and is multi-repo, where most spec tooling assumes one. Caveat is the same one this thread keeps carrying: no evaluation that a graph-grounded spec beats a written one, and no described refresh trigger to back the word "living" the way AutoWiki's regenerate-on-push does.

Two firsts from one skill pack (claude-seo, 2026-08-22)

The spoke has paged a lot of skill packs and the marginal one now teaches little. claude-seo — agrici-daniel's 25-skill / 18-agent / 32-command SEO plugin for claude-code, MIT, 14.8k★ — is worth the space for two properties nothing else here has, and for one comparison it makes possible.

It treats the pack as software. 410 tests, up from 39 two minor versions earlier, of which 91 cover URL-safety SSRF and DNS-rebinding bypasses — obfuscated IPv4, FQDN trailing-dot, redirect-rebinding — run in CI. Every other skill pack in this spoke is markdown with no executable contract, and this one has found the reason to be different: a tool that takes a URL from a user and fetches it from the machine running the agent is server-side request forgery with extra steps. Two of its releases are credential-injection and SSRF-bypass fixes. That is the agent-guardrails argument arriving from an unexpected direction — the containment problem showing up not in what the agent is allowed to do, but in what a helper script is allowed to fetch.

It is a cognitive skill that ships its own disconfirmation. Its 10-principle framework (PERCEIVE → ANALYZE → VALIDATE → ACT) is exactly the kind reasoning-scaffolds says carries measured and negative evidence: a named sequence prescribing how to think, adding no capability. But its output contract requires every recommendation to state the observation it rests on, its dependencies, a "how would we know this failed?" check, and a leading indicator. The scaffold itself remains unverified — nobody has run it against a no-scaffold baseline. Its outputs are falsifiable, which is new, and the two claims should not be blurred: this is not evidence that framing the reasoning improves the reasoning. It does hand the corpus an experiment it could actually run, since the leading indicators are recorded per finding.

And it makes a clean pair with agentic-seo-skill. Same domain, same form factor, opposite bets. The earlier pack is cross-tool, installing identical content in nine harnesses' native formats. This one is Claude-Code-only and spends the saved effort on depth: auto-discovery from a directory convention, 15-way parallel dispatch, the test suite, a four-tier Google credential ladder, eight optional MCP extensions. Portability versus depth, chosen explicitly, on identical subject matter — the cleanest instance of that trade the spoke holds.

What is not evidence, and it matters because the star count invites the mistake. The "10–15 minutes versus 4–8 hours manual" figure is the repo's own with no method. The case study is one screenshot of one three-month-old site's Search Console impressions — no control, no attribution. The 410 tests measure the code; nothing measures whether the audits improve rankings. A pack can be well-engineered and unevaluated at the same time, and this is the corpus's sharpest example of the two coming apart.

One distribution note. The MIT repo has a members-only early-access mirror behind a paid Skool community, alongside a contributor programme that folded outside work into v1.9.0. The spoke's first two-tier open/paid release cadence, and the mechanism by which one maintainer reaches 25 skills.

The convergence node — gstack

garry-tan's "software factory" is the clearest single artifact of the thesis: 23 agent-skills, role-split agent-orchestration, parallel sprints via conductor, and gbrain as persistent memory — its Think→Plan→Build→Review→Test→Ship→Reflect sprint, where Reflect is compound-engineering. It is also the cleanest bridge back to ../research-wiki: the same author's knowledge base is the harness's memory layer.

hermes-profile-builder (Nous) gives the spoke's most abstract claim a UI: an agent is composed from identity + model + skills + MCP servers, and the Profile Builder is a local dashboard with exactly those four toggleable blocks (writing config.yaml/.env/SOUL.md, CLI-parity, one-click Skills-Hub/MCP-catalog installs). So "skills × MCP = agency" + model-selection + identity stop being separate threads and become a single composition surface in one shipping product. Evidence on the standardization-reach question: the blocks are stable enough to assemble in a GUI. Local-only (127.0.0.1) keeps it on the openhuman local-first pole.

Vendors

anthropic (Claude Code / Channels / FSI) is the furthest along the model-provider → full-agent-platform shift: the ant CLI (ant-cli) drives claude-managed-agents from the terminal, and claude-agent-sdk ships the Claude Code harness itself as a Python/TS library — tools, agent loop, hooks, subagents, MCP, sessions, and .claude/ skills/CLAUDE.md dirs. A three-rung ladder: Client SDK → Agent SDK → Managed Agents. The wiki's threads are now literally one vendor's SDK feature list. But selling the wrapper exposes a cost-structure tension the model layer didn't have: anthropic-agent-sdk-billing-pause (June 2026) shows flat subscriptions are far cheaper than API-rate metering for anyone running the harness hard — power users hit breakeven within days — so Anthropic announced (May 13), then paused (June 15/16), a change to bill Agent-SDK / claude -p usage at API rates. boris-cherny's framing — subscriptions "weren't built for the usage patterns of these third-party tools" — reads the pause as a deferral, not a reversal. The thread to watch: as the harness becomes the product, its pricing converges toward usage-metering (cf. GitHub Copilot's parallel move), and "the value moved to the wrapper" acquires a margin problem the wrapper's owner must solve. google (adk, agent-starter-pack, Gemini CLI / conductor, and now genkit) and now microsoft (Agent Framework + Azure AI Foundry, per agents-that-build-agents-ms) are all building the same harness + skills patterns — three independent vendors converging on skills as the primitive, strong evidence the form factor is an industry attractor, not one vendor's house style. The open agentskills-spec is where that convergence is most explicit — and Microsoft adopts it outright: per agents-that-build-agents-ms (confirmed via Microsoft Learn), Foundry skills follow the agentskills.io format and surface to any MCP client as MCP Resources (SEP-2640), so all three vendors land on the same open file format, not rival proprietary ones. langchain is the fourth vendor, but decomposes the harness differently: its primitive is composable agent-middleware, not a loadable skill — a framing tension worth watching (skill-as-unit vs middleware-as-unit; in practice likely both, skills being what the agent can do and middleware how the loop is wired).

The community-org stratum, and what it says about moats (2026-07-26). Under the vendors sits a different kind of publisher: FoundationAgents, a MetaGPT-community GitHub org with a gmail contact address, whose openmanus carries 57.6k stars off 526 commits. It exists because Manus shipped a general-purpose agent behind an invite code, and the community had an open prototype in three hours. Read against the vendor ladder above, that's the sharpest available evidence for the spoke's own premise cutting both ways: if the value really has moved into the wrapper, then the wrapper is also the part that is cheapest to re-implement. What the closed product owned was distribution and a waitlist, and neither survived contact with an org that could be started in an afternoon. The counterweight, visible in the same repo: 301 open issues and 192 open PRs. Replicating the architecture took hours; carrying it doesn't.

Permission is the dial that runs the other way

Every capability this synthesis tracks extends what an agent can do: context, orchestration, skills, the effort-level dial. claude-code-auto-mode is the corpus's first source about what an agent is allowed to do, and it belongs to the thesis rather than beside it. The model writes the code; the harness decides what the code may touch (agent-permission-model).

The number worth keeping is about the humans, not the feature. Per-action approval — the safety design most harnesses here ship — caught 13.6% of harmful actions, against 89% for automatic approval, across 1,053 paid developers. That is a measurement of confirmation fatigue, and it generalises past claude-code to anything in this corpus whose safety story is a prompt: a control that fires hundreds of times a session stops being read, so it degrades exactly in proportion to how useful the agent is. The spoke has been describing harnesses that make agents run longer and wider (run-claude-code-agents-24-hours, orchestrate-100-agents-claude-code) without noticing that the same trend disarms the approval prompt.

The remedy points the same direction as everything else here. Not a better human review — no human. On the reported figures 11% of harmful actions still get through, now at machine speed with nobody nominally watching.

And the evidence is the vendor's. 89 / 13.6 / 720-of-720 all originate with anthropic, including the commissioned third-party injection test. simon-willison accepts the design and asks for independent confirmation of the numbers, which is the same position this synthesis has taken on the agentsys harness claims and the progressive-disclosure savings. Add it to the standing pattern: the strongest claims in this corpus are still measured by the parties making them.

A third position arrives 2026-08-23, and it has no number at all. KOT removes the gate rather than moving it — "There is no security, and there will not be" — and hands isolation to the operator's container. Read beside nanoclaw, which argues from the identical premise to shipping containers itself, the premise turns out to underdetermine the design: "application-level permission is not real isolation" supports both build the boundary and build nothing. What separates them is who is assumed to do the work, and only one of those assumptions is testable by the vendor.

The substrate floor: a harness with no identity and no policy

mimiclaw is the smallest harness in this corpus by two orders of magnitude, and it is useful for what it leaves out rather than what it fits in.

The anatomy this synthesis works from — runtime, gateway, memory, tools, identity, policy (openclaw-hermes-control-layer) — survives the shrink with four of six parts. A C agent loop on an ESP32-S3, a Telegram gateway, markdown memory files on flash, five tools. No identity layer, no policy layer, and no approval prompt. Those are precisely the two layers NVIDIA and Microsoft added to openclaw to get it into production, so the anatomy's own claim that they are the control layer rather than the working layer now has its demonstration at the bare end.

It also runs unattended by design. A 30-minute heartbeat re-prompts the agent from a task file, and cron_add lets the model schedule its own future wake-ups, persisted across reboots. Read against "Permission is the dial that runs the other way": claude-code-auto-mode measured per-action approval catching 13.6% of harmful actions, and MimiClaw has no such control to degrade. What keeps it safe instead is that its five tools cannot do anything — search the web, read a clock, set an alarm. Containment by capability poverty is a third mechanism beside external sandboxing and the approval prompt, it is free, and it lasts exactly until someone adds a filesystem tool.

The cost claim needs splitting, and the repository already splits it. The headline says an AI assistant on a $5 chip; the GitHub description says a harness on a $5 chip, and the second is right. Every turn is an API call to Claude or GPT with a key stored on the board, and the recommended board is ~$10. What got cheap is the thing that hosts the loop, which was never the expensive part (model-or-harness-taxonomy). The 0.5 W figure is a claim about electricity, not about inference.

Standing caveat unchanged: everything here is the project's own account of itself.

Open questions

Growth edges

Ranked; each names the kind of source that would close it (see ../QUALITY.md → Growth edges).

  1. Purpose-built context, tested. Every measurement the spoke holds tested generic context — style guides, house rules — and returned a null. Nobody has tested context written for the task at hand, which is the version practitioners actually claim works. — needs: a T1 controlled study, ~120 tasks (the scale the corpus's own power analysis says a 10pp effect needs). Two studies of exactly that shape now exist and the spoke has not read either (2026-08-15). agent-skills-can-be-harmful reports their results at second hand: skillsbench (84 verifier-graded tasks, 11 domains) finds average pass-rate gains from curated skills with drops on 16 of 84; swe-skills-bench (490 repository tasks) finds limited average improvement, many skills with no gain, and token overhead up to 451%. That is purpose-built context tested at the scale this edge specified, pointing at a small positive mean with a long negative tail. The edge stays open until the primaries are ingested — the numbers above are one paper's summary of two others, and the failure study deliberately reports no denominator of its own. — needs: arXiv:2602.12670 and arXiv:2603.15401, read directly.

  2. The harness-vs-model tradeoff. CLOSED 2026-08-06 by the research pass — scaffold-effects-gaia, the crossed 5-model × 3-scaffold pre-registered comparison this edge had specified almost word for word ("varies model and harness in the same design"). Seven sources missed it by holding one factor fixed; the eighth ran the factorial. The answer is recorded in the open question above: structure carries a model one tier, not two, and the best scaffold is model-specific. The coding-domain successor is also CLOSED, 2026-08-07, by the research pass — claw-swe-bench, 350 SWE-bench-class instances with prompt, container, timeout and evaluator held fixed. Harness spread 12.5–27.4 pp against a 29.4 pp model spread; the finding is domain-independent. The frontier cell is CLOSED too, 2026-08-08, by the research pass — harness-bench: 8 model backends × 6 harnesses, 106 tasks, 5,194 trajectories, frontier models in the grid. "Stronger model backends tend to achieve higher mean scores while exhibiting lower cross-harness variance." The spread narrows at the top and does not vanish (23.8 pp strongest-to-weakest harness). Successor edge, ranked below: the benchmark scores whole harnesses, so it cannot say which mechanism bought the gap — the corpus documents mechanisms and nothing attributes a point of the spread to one. Partly closed 2026-08-08 by ddr-bench (T1), whose Section 5.2 ablations vary reasoning budget, memory and reactive-vs-proactive operation one at a time on a fixed model (Qwen3-Next-80B-A3B) — the design this edge specified — and whose Table A1 adds whole-mechanism additions across three datasets × three models. The numbers are now held (an earlier note here said they would not extract; a local PDF pass got them): 2 of 27 additions beat the plain ReAct baseline, both +Plan on 10-K. Memory never wins. Multi-agent takes one cell from 16.67 to 4.44. So the attribution this edge wanted exists and points the unexpected way — much of the spread is damage, not benefit. Remaining: one benchmark, one task family, off-the-shelf framework implementations, and nothing on a coding workload, which is what this spoke mostly documents. The coding half is now CLOSED, 2026-08-11 (research pass) — confucius-code-agent (Meta and Harvard, T1) varies context management and tool sophistication one at a time on a fixed model, on a 100-example SWE-Bench-Pro subset. Context management: +6.6 pp on Claude 4 Sonnet (42.0 → 48.6) and +0.6 pp on Claude 4.5 Sonnet (51.0 → 51.6). Tool sophistication: +7.0 pp (44.0 → 51.0). So a mechanism worth almost seven points on one model is worth half a point on its successor. Successor edge, unmet: the ablations keep stopping at two mechanisms. Confucius never removes its note-taking agent or its meta-agent, DDR-Bench's additions are off-the-shelf framework implementations, and neither reports variance or repeated runs — a 0.6 pp difference on 100 examples is not distinguishable from noise. — needs: an ablation reporting repeated runs with variance, covering persistent memory or self-configuration, on a fixed model. 2a. The human-versus-model harness comparison, actually controlled. New 2026-09-03 with harnessdev, which reports 86.2 for human-engineered references against 67.8 for the best model-built harness — and states plainly that the references are "verified public system results rather than paired controls under one executor." Five different published systems on five different models. The direction survives that; the 18.4-point gap does not, and it is the number the paper will be cited for. — needs: one benchmark run where a human-engineered and a model-built harness execute on the same model, same tasks, same budget. T1/T2. Cheap by the standards of this list: the harnesses and the benchmark are published.

  3. Neutral evaluation of a vendor's own claims. jetbrains-ponytail-tested is the template — a third party testing a tool it does not own, with audited arms. The corpus needs more of exactly that shape and fewer proprietary benchmarks like Cognition's Frontier Code. — needs: T1/T2 third-party evaluations.

  4. Consolidate before adding. Done 2026-08-04 at the curator's instruction. The six dated (added 20xx) sections became three thematic ones — Structure changes how an agent works, not whether it succeeds, The surface dictates the representation, Shared state is the next boundary — with the overlaps merged (the phone and the video editor were making one argument, not two) and nothing dropped. 264 lines to 202. The standing rule this leaves behind: a new finding extends the thread it belongs to; it does not get a dated section of its own.

Coverage edges (added 2026-08-08, at the curator's request for a wider backlog). These widen what the spoke covers instead of answering an open question above; one ordinary solid source closes any.

  1. The observability layer. 234 pages and not one tracing or eval product — LangSmith, Langfuse, Braintrust — although agent-evals and agent-failure-localization both assume someone is recording runs. — needs: product documentation plus one team's account of debugging with traces.

  2. The frameworks named in passing. CrewAI, AutoGen, smolagents and OpenAI's Agents SDK appear only inside other pages; langchain and adk carry the whole framework story alone. — needs: official docs, one page each.

  3. The benchmark family behind the benchmark argument. Mostly CLOSED 2026-08-09 (research pass) — swe-bench, tau-bench and webarena written from their papers, all T1. BrowserGym is still absent, and a sharper successor has opened: every one of the three reports figures from 2023–24, and the spoke quotes current vendor scores against them. — needs: a contamination or saturation study on SWE-bench (or its Verified subset), and any independent re-run of these benchmarks at current model strength. The contamination half CLOSED 2026-08-22 (research pass) by swe-bench-illusion (Liang, Garg & Zilouchian Moghaddam, T1). Ten models name the buggy file from the issue text alone, with no repository access, at 60–76% on SWE-Bench Verified and below 53% on repositories the benchmark never covered; verbatim recall of the fixed function runs 35% vs 18% on the same split. The independent-re-run half is still open — nobody has re-scored current harnesses on a decontaminated task set this spoke can cite. — needs now: a decontaminated or freshly-collected task set with harness results on it.

  4. Agents running unattended in CI. Nearly everything here is an interactive harness. The GitHub-Actions path — a pull-request bot, a nightly agent, and who approves what it writes — has one mention across the corpus. — needs: platform documentation plus one report of a team running it.

  5. A framework comparison whose outcome is correctness, not bytes. New 2026-08-21, successor to the multi-framework comparison with a measured outcome edge closed the same day by agent-storage-footprint (Yu et al., HK PolyU, T1: eight frameworks, one replayed trajectory, 6.7× spread in retained bytes; 15.7× among configurations all scoring 100%; 4.8–32.7× removable by content-addressing; and across 108 SWE-bench Verified submissions, trajectory volume spanning three orders of magnitude with no correlation to resolve rate). The layer is measurable — that was the open part. But accuracy in that study is a control, pinned so storage can vary, so it still compares frameworks only to each other. — needs: a comparison across frameworks, or against a hand-written loop on the same API, where correctness or cost is the dependent variable.

  6. Whether the storage result survives contact with a real deployment. New 2026-08-21, second successor to the same source. Its own audited boundaries say the controlled suites cover retrieval and retention rather than general reasoning, that results describe version-pinned configurations rather than frameworks in the abstract, and that the wild data are exports rather than runtime residue. Version pinning decays fastest of the three. — needs: a re-run at current framework versions, or an operator publishing runtime residue rather than exported trajectories.

  7. Does the reliability plateau hold on proprietary frontier models? Written into this section 2026-08-23 (it had lived only on the hub's ## Most wanted since 2026-08-21, which is the wrong home — the spoke's edges are the source of truth). CLOSED the same day by the research pass: science-of-agent-reliability (Princeton, ICML 2026, T1) runs 14 proprietary frontier models, zero open-weight, K=5 runs at temperature zero, and finds reliability improving only modestly over 18 months of releases — barely at all on open-ended GAIA. beyond-pass-at-1's guess that the closed models are "likely more reliable" is not supported. Successor, edge 12.

  8. Reliability with the harness as the variable. New 2026-08-23. Both repeated-run studies hold the scaffold fixed — one per benchmark in science-of-agent-reliability, two in beyond-pass-at-1 — while scaffold-effects-gaia and harness-bench vary the scaffold and run once or thrice. So the spoke's central claim, that structure substitutes for capability, has never been measured with variance on the structure side, and a 23.8 pp harness spread from single runs sits on an unmeasured noise floor. — needs: a harness comparison with K≥5 repeats per configuration and reported spread, or a reliability study that varies the scaffold. HALF CLOSED 2026-09-14 by metr-scaffold-comparison (METR, T1): the factorial was run — Opus 4.5 / GPT-5 × vendor harness / generic scaffold — and the harness moved the time horizon by nothing measurable (Claude Code over ReAct in 50.7% of bootstrap samples; Codex over Triframe in 14.5%). Uncertainty is bootstrap over tasks, not seeded repeats, so the K≥5 half stands. — needs now: the same cells with ≥5 seeds and a variance decomposition, or the cells repeated later.

  9. A non-naive memory arm. New 2026-08-23, carried in from the hub shortlist where it had been parked since 2026-08-21. Three sources now report memory scaffolds failing to help or actively hurting (beyond-pass-at-1 5 of 9 models, ../osint-wiki's vibesearchbench on three mechanisms, and the budget mechanism in context-rot) — and all of them test naive episodic memory, a scratchpad appended to. Curated, retrieval-gated and summarized memory are untested, and agent-memory's whole product thread assumes them. — needs: the same repeated-run design with a non-naive memory arm.

  10. How many installed skills before triggering degrades. New 2026-08-25, written here because the question has been an open question on this page since 2026-08-23 and lived as a sourcing need only on the hub shortlist (quality-log.md #28) — the drift QUALITY.md's "the spoke is the source of truth for edges" rule exists to catch. attention-is-all-you-have crawled 56,804 published skills and bounds an agent at fewer than a hundred reliable auto-trigger slots, taken from the long-context literature rather than measured; the authors say so and propose the experiment without running it. It is the cheapest high-value measurement on the list — one agent, N installed skills, a fixed request set that should fire each one, swept over N — and it prices the whole install layer, including whether @skills's premise holds. — needs: a T1/T2 measurement of trigger reliability as a function of installed-skill count. HALF CLOSED 2026-08-28 (research pass) by how-many-tools-should-an-agent-see (Repantis et al., Meta, arXiv 2605.24660, T1, read from the PDF) — which measures the adjacent regime and reframes the question. Registries from 20 to 3,251 tools: on BFCL's 370-tool pool a learned depth policy reaches 90.3% at K = 7.4 against 90.8% for a fixed shortlist of fifty, and downstream selection by Claude Sonnet 4.6 improves to 93.1% from 87.1% — and to 76.8% from 60.9% on medium-difficulty queries — when the list is short and adaptive rather than a fixed five. So the variable that moves accuracy is how many candidates are shown, not how many exist. Why it is only half. Everything measured here sits behind a retrieval layer, and installed skills have none — their trigger descriptions share the prompt, so installed count is shown count. This paper never visits that K = N corner. — needs still: the sweep with no shortlist in between, which is the attention-is-all-you-have experiment. Not eligible before 2026-09-11. CLOSED 2026-10-07 (research pass) by skill-shadowing (Song & Wei, Databricks, arXiv 2605.24050, T1): the K = N sweep, run. All names and descriptions in context, no retrieval, Claude Haiku 4.5 and Sonnet 4.6 on SkillsBench. Pass rate falls 0.08 at 52 skills, 0.14 at 102, 0.21 at 202 against the task's own skills alone, and wrong-skill selection ("shadowing") explains up to 68% of it; context length never separates from zero. So the decline starts well under the argued hundred and is gradual, not a cliff. Successor, edge 14a: no mitigation was tested, both models are Anthropic's, and the sweep stops at 202. — needs: a T1/T2 run of the same sweep with a mitigation arm (retrieval pre-filter, rewritten descriptions or routing), ideally across providers.

  11. What these tools rewrite, and what they import. New 2026-09-03, promoted from the hub dream ledger. 1jehuang is recorded here as a pattern about one author — three dependencies rewritten because the existing layer was judged inadequate. Read beside llm-inference's latency-compensation diagnostic, the pattern may be narrower and testable: the layers these authors replace are the ones that encode a latency budget rather than a computation — version-control locking, job queues, streaming renderers — while compute layers keep getting imported. The spoke has the instances and no count. — needs: a commit- or dependency-level taxonomy of what agentic coding tools reimplement rather than import, each rewrite classified as pacing/coordination or compute. T1/T2.

  12. Whether a vendored skill records what it vendored. New 2026-09-03, promoted from the hub dream ledger. atskills-protocol lists what the design leaves out — no manifest, no lockfile, no version pinning, no update command — and treats the subtraction as the point. The page never asks what the omission costs. :save vendors a copy at the ID's own path and both cloud forms resolve local-first, so a saved copy answers its own address after upstream has changed, with nothing on either side able to tell the two apart. — needs: the @skills implementation or its documentation on whether .atskills/ stores an upstream revision or content digest. T1/T3; a first-party fact, cheap to close.

  13. An independent measurement of the edit format. New 2026-09-06, from harness-problem-hashline. The spoke now leans on the edit format as its cleanest single-tool demonstration that structure substitutes for capability, and the only measurement of it is the tool author's own. Two independent studies exist and neither has been read here — Diff-XYZ (JetBrains, arXiv:2510.12487), which finds no single format dominates across models and use cases, and EDIT-Bench (arXiv:2511.04486), where only one model clears 60% pass@1 on realistic editing. Both are cheap to close and both would test the claim the corpus is already using. — needs: arXiv:2510.12487 and arXiv:2511.04486, read directly. T1.

  14. Where the harness effect goes at the frontier. New 2026-09-06. Every harness measurement here is run on frontier or near-frontier models, and the one source that sweeps the weak end (harness-problem-hashline, 16 models) finds the gain concentrated there and absent or negative at the top — GPT-5.2 Codex +4.6 points and 26% more output tokens, DeepSeek V3.2 negative on both. If that gradient is real and not an artefact of easy fixtures, "the harness matters more than the model" has a shelf life, and the corpus cannot currently tell the two readings apart. — needs: a harness or tool comparison spanning a wide capability range with the model as a swept factor, ideally on tasks harder than single mechanical mutations.

Structure changes how an agent works, not whether it succeeds

The Benchmarks question above was the spoke's oldest. It is no longer unanswered, and the answers keep arriving the same way.

Study What it measured Result
cc-thinking-skills 39 cognitive skills (28 after the Aug cutover), length-matched placebo, replication gate zero robust ELEVATE verdicts
jetbrains-ponytail-tested ponytail, 80 paired tasks, 251 audited trials works, and oversold — −15.4% code vs −54% advertised
context-files-ablation-paper AGENTS.md injection, 2 agents, 288 gold-test runs no correctness effect; process effects only

context-files-ablation-paper (Khatri, arXiv) is the strongest measurement this corpus holds: two frontier agents from different providers, 17 tasks mined from merged PRs across 3 real repositories, 288 runs scored against hidden gold tests, code and data released. Context-injection strategy does not measurably move correctness on either agent — bounded to ≤10pp (Claude Code) and ≤15pp (Codex), with the no-context arm scoring higher on the borderline tasks selected to have room to move. A pre-registered probe across 36 cells confirms the real AGENTS.md never converts a near-miss failure to a pass.

Three independent parties, three different layers of the structural stack — cognitive scaffolds, a ruleset, project context — and none found the outcome improvement the layer is sold on. Two found process effects instead (fewer tokens, less cost, fewer wasted test runs) and both authors attributed those to delivery mechanics rather than agent capability.

The mechanism is the part to carry. Khatri's failure triage is the most useful paragraph in the corpus on why. Near-miss failures fail on implementation skill — feature design, pattern selection, exact wiring — not on repository knowledge a document could supply. The agent that implemented reactive retry where proactive token refresh was needed did not lack a fact; it made an architectural choice. No context file fills that.

So the standing does structure substitute for capability question sharpens into something narrower and testable: the structural layer plausibly changes how an agent works — what it reads, what it re-runs, what it spends — while leaving whether it succeeds to the model. Every measured result here is consistent with that split and none contradicts it.

And the artifacts have started agreeing with the split without being told (added 2026-08-06). claude-code-development-kit is a packaged Claude Code setup built on four synchronized project-context files — the mechanism context-files-ablation-paper ablated to a null. It ships no evaluation, so it adds no evidence. What makes it worth recording is that every claim it does make is a process claim: less re-derivation across sessions, a smaller always-loaded floor, fewer stale docs, cleaner merges. It never promises the agent will write better code. Read against the table above, the kit and the paper are not in conflict; the kit is selling exactly the half the measurements found real, and the corpus's recurring disappointment has come from tools that sold the other half.

That reframes the growth edge slightly. The open question is no longer only "does structure improve correctness" — the answer keeps coming back no — but whether the process gains are worth their own overhead, which nobody has measured either. A kit that keeps four documents in step spends tokens to save tokens, and /update-docs, /review-work and /second-opinion all cost a run apiece. Nothing in this corpus prices the structural layer against the burn it removes.

Two honest limits. All three studies are small (Khatri's own power analysis: 120–200 tasks to detect 10pp; his MDE is >30pp), and all three measure generic structure — naturalistic style-guide context, cognitive scaffolds, a general ruleset. Purpose-built, task-specific context is untested by any of them. What has collapsed is the inference from adoption to effect, which is what most of this spoke's sources actually offer.

The split that has since appeared runs along authorship, not along scale. Every measurement in the table above was run by someone with nothing to sell, and each found process effects and no outcome effect. Every result claiming a large outcome gain — statewright 2/10 → 10/10, longhorizon-harness +28.9 points, agentsys's 73–83% cost savings — was run by the party shipping the harness. That is not proof the vendors are wrong; the two groups also test different things (the independents test generic context on frontier models, the vendors test purpose-built scaffolding, often on weaker backbones, which is exactly the untested case growth edge #1 names). But until one measurement crosses the line, the corpus cannot tell the difference between "purpose-built structure works and generic structure doesn't" and "authors find what they are selling." Both stories fit every number on this page.

2026-09-03: a measurement crossed most of the line, and it went the boring way. harnessdev runs six models building their own harnesses from an identical weak seed, over 2,207 instances, with held-out tasks withheld from the development loop — purpose-built structure, at scale, scored by people not selling the winning harness. The lead affiliation is ByteDance Seed and Seed 2.0 Pro finishes last of six, which is the inverse of the authorship problem above rather than another instance of it.

The outcome result is a small one. Harness evolution — the compounding claim — tops out at +4.44 held-out points for Opus 4.8 and regresses for three of four lineages once the runtime model is fixed. So the vendor stories on this page (autoharness's 42% → 78%, longhorizon-harness's +28.9) now have a controlled number of the same shape to sit beside, and it is an order of magnitude smaller. That does not settle the split — nobody has re-run a vendor's own purpose-built scaffold under control — but the first purpose-built-at-scale measurement landed nearer the independents' null than the vendors' headline.

And it names a harder problem underneath. "77.8% of failed Data tasks are attributed to harness defects, showing that the bottleneck is not only executor capability." Every study in the table above asks whether structure helps a working agent. This one finds structure is where most of the failures already are. The two questions are not the same, and the corpus has been asking only the first.

Verification is where the bottleneck went, and the gate can be cheesed

loop-engineering moved the bottleneck from generation to verification; shipping-without-human-verification states the destination outright: how much code can you ship with no human looking at it, starting at 1% and growing the number the way teams grew into CI/CD.

Its contribution is a distinction the corpus lacked. Testing asserts; verification judges. Testing confirms the code works; verification confirms the change did what was intended and fits the organisation's standards — and code review historically fused them and did the judging badly, at a reviewer's four-in-the-afternoon attention. That explains why better test coverage never dissolved the review bottleneck: intent alignment, acceptance-criteria coverage, architectural fit and blast radius are not assertable, and they are most of what review was for.

The hole is adversarial robustness, and it runs straight into constraint-evading-behavior. The proposal replaces human judgement with automated gates, with an LLM judging exactly the rows that can't be asserted. This spoke already documents agents satisfying a check's letter while defeating its purpose, and ../defensive-security-wiki holds the extreme instance — a model treating its sandbox allowlist as the puzzle and breaking out. The defence offered is a Swiss-cheese stack of layers, which is the right instinct against independent failures and no defence at all against correlated ones, where the verifier and the author are the same class of system confused by the same thing.

And verification has a price nobody was charging it (2026-08-15). The corpus argues for encoding checks — verification-loops-skills packages them as skills Claude runs on itself, agent-loops-verification makes the loop the unit of design, watch-skill's THE LOOP re-reads its own output. agent-skills-can-be-harmful audited the bill. Excessive Verification is the single largest bucket in its whole cost taxonomy: 67 of 182 regressions, tasks that passed while the skill kept the agent re-testing, rebuilding, debugging and walking checklists after the artifact was already right. This does not overturn the verification thread — every one of those runs passed — but it prices it, and the price shows up in a place pass-rate evals do not look. What the finding actually indicts is the unconditional checklist: verification scope belongs on a budget, scaled to change size and uncertainty, rather than prescribed in full by a skill that cannot see either.

Both halves stand in tension. The bottleneck is real and the human baseline is genuinely weak — "better than a tired reviewer" is a lower bar than teams admit. And a gate you can cheese isn't a gate. Nobody here has measured an automated verifier against an agent with an incentive to pass it, which is a sharper version of the Benchmarks question than "are the numbers real." The article's one quantity — "improving detection by 50% may speed up the engineering organization by 200%" — has no method, no source, a load-bearing "may", and a vendor sponsor selling verification.

The surface dictates the representation

mobilerun put the controlled surface on a device rather than a repo, browser or chat channel, and its architecture restates this spoke's core thesis unusually cleanly. Nothing about the model is mobile-specific — it runs OpenAI, Anthropic, Gemini, DeepSeek, Ollama or any compatible endpoint against the same phone. Everything that makes it work is harness: a device-side Portal exposing the accessibility service, an operator-side runtime holding the loop and tools, per-app guidance cards, and a manager-executor planner that is agent-orchestration with taps as the end effector. The phone runs no model at all. If the claim is that value moved to the wrapping, mobile is where the wrapping is the entire product.

The design decision is what to send the model. Mobilerun reads the OS accessibility tree rather than screenshots and claims a 500× smaller payload with better accuracy — semantics beat pixels because a labelled button doesn't have to be recognized.

video-use landed twenty minutes later from browser-use, an unrelated team in a different medium, and made the same call: one ElevenLabs Scribe pass turns a shoot into a ~12KB word-level transcript, the model cuts from that text, and filmstrip composites render only at decision points. watch-skill was already doing it on video with a ≤100-frame budget against a text index.

Three instances from three orgs is why this is paged as text-first-agent-design rather than left as a note: don't hand the agent the surface, hand it a derived representation chosen for meaning per token. pxpipe resolves as the principled inverse rather than a contradiction — a coding harness has no upstream structured description, so once text is already the most meaningful form available, the only lever left is what the tokens cost. The rule covering all four: ask what description the platform already maintains before deciding what to feed the model.

Two answers on one task, four days apart

open-edit (VEED) is the corpus's first genuine head-to-head: the same job as video-use, a different org, and a different answer at almost every decision. Both read a per-word transcript, because caption timing has no other input. From there video-use stays in text to the finished cut, while OpenEdit has the agent author captions in HTML and CSS and renders them with a binary that never starts a browser. That is the pattern's neighbour rather than its violation — pick the notation the model is fluent in, which is also paperclip's move on scientific databases the same day.

Two things travel beyond video. First, the provider is abstracted and the precondition is not: VEED, WhisperX or your own Whisper-family service all write the same transcript file and "nothing downstream can tell which one ran," but a transcript without per-word timings "is refused rather than rendered badly." A mechanical gate on an input, in a corpus where most quality control is a sentence in a prompt (agent-guardrails). Second, the vendor shape is new: not a model provider climbing into the harness (anthropic, google, microsoft) but an application company publishing the agent-native replacement for its own subscription product, with the funnel moved to transcription. "Not the editor you rent, but the one you own," from the company renting the editor.

What is still missing is the comparison itself. Two tools, zero shared evaluation, and the honest summary is that they disagree about authoring surface, renderer, host portability and licensing with nothing measuring which choice was right. The star gap (18.6k vs 209) is distribution. OpenEdit's 2.2×-faster renderer claim arrives with the README's own admission that it is "preliminary and not yet reproducible outside VEED," which is the right disclosure and still not evidence.

The token-budget corner, and its first instrument

Five levers now sit in this corner and every one is an intervention: compress (headroom), remove (safe-prompt-pruning), swap modality (pxpipe), route (tokenmining), and strip at capture (md-this-page). That last is the only one upstream of the harness — a browser extension where Readability strips the page and a person pastes the Markdown, no agent or model deciding anything. Its uncomfortable implication for the expensive tools: a 2010-era Reader Mode heuristic captures a good share of the win, because much of what bloats a window is structural rather than a judgment call.

And two days later the upstream lever grew a server (2026-08-05). pullmd is strip-at-capture with md-this-page's stated limit removed: a self-hosted URL/file → Markdown service exposing an MCP server, a Claude Code skill that fires on web-reading requests, and OAuth for the claude.ai connector. Capture-time reduction moves inside the loop — the agent chooses what to fetch and the stripping is a service it calls, rather than a person clipping a page and pasting it. Its architecture is the other thing worth taking: a fallback cascade (Readability → Trafilatura → origin-supplied Markdown → headless Chromium) rather than one extractor, which concedes that nothing works across the whole web. Same unmeasured footing as the rest of the corner — the cascade's selection quality is exactly what no source in it has ever tested.

agtop is the first entry that changes nothing. It reads Claude Code and Codex JSONL transcripts, joins them to OS processes, and reports what a session actually cost — spend, tokens, context saturation as a live percentage, CPU and memory, per model and per subagent. The corner's claims are quantitative and almost entirely self-reported (60–95% fewer tokens, 59–70% cost, 27–34% cuts), and this spoke holds the demonstration of what outside measurement does to such a number: jetbrains-ponytail-tested took an advertised −54%/−20% to −15.4%/−10.3%. The corner did not need a sixth lever; it needed an instrument. Two limits keep it honest — it measures cost, not quality (a session that spent little because the agent gave up early scores well), and CTX% makes context-rot's central quantity visible without making it actionable.

Progressive disclosure has a ceiling, and a catalog found it

The skills model rests on a claim about cost: a skill's frontmatter is cheap enough to keep resident, its body loads only when needed, so more skills are close to free. agentic-awesome-skills is the first source here that shows where that stops. At 2,003 skills the index is the thing that no longer fits: the README documents that Antigravity, which watches ~/.agents/skills, "may load enough installed instructions to exhaust its context, slow startup, trigger truncation errors, or enter a crash loop," and the installer therefore refuses to run bare against that target. A composed manifest is capped at 128.

So the cheap-frontmatter argument holds per skill and fails in aggregate, and it fails at a number well below what a catalog can accumulate. The project's response is the part worth keeping: it built a read-only local MCP the agent queries instead of a directory the harness ingests. The agent searches, reads candidates, picks exact IDs, and Core validates the selection's structure — explicitly not its semantic fit, compatibility, or safety to apply. Discovery replaces distribution, which is agentic-resource-discovery arriving from the direction of a catalog too big to hand over.

Two things it does not settle. Whether an agent selects better than a ranking would is the project's entire premise and is untested. And the honest disclaimers cut both ways: a system that validates IDs but certifies nothing, distributing two thousand instruction files — including a critical and authorized-use-only offensive tier — into an autonomous agent's working set, puts the whole trust burden on a selection step nobody audits. agent-guardrails in supply-chain form.

The per-skill ceiling, measured (2026-08-15). The catalog above found where the index stops fitting. agent-skills-can-be-harmful found the limit inside a single skill, and it is not made of tokens. Across 182 paired cost regressions, Excessive Procedure — the extra steps a skill's instructions induce — is 114 cases (62.6%) against Context Bloat's 46. Progressive disclosure prices the text a skill puts in the window and prices nothing about the workflow that text prescribes; a 600-token body demanding a full test suite after every edit is cheap to load and expensive to obey.

Where the cost is context, the split is the sharper number: 43 of 46 cases are the mandatory body, 3 are the lazy-loaded supplementary material. The L2/L3 boundary works as designed, and authors are putting the wrong things above it. Both halves point at the same repair and it is an authoring convention, not a platform feature — say what is binding, move the rest below the fold, and stop turning an optional checklist into mandatory work on every task.

The same day, from the other end. vibe-tools answers "how does an agent learn it can do something" by writing the harness's instruction file — .cursorrules, CLAUDE.md, Windsurf/Cline/Roo — and giving the agent shell-callable models: Perplexity for what it doesn't know, Gemini for what won't fit, Stagehand for what must be clicked. That is the pre-MCP answer, and it still works because instruction files are the one surface every harness reads. Put beside AAS the pair is a spectrum with the context budget as its axis: push capability into the context until it stops fitting, then make the agent go fetch it. Neither source measures whether either works.

Whether the loop can close depends on the surface

video-use inspects its own output at the cut boundaries and re-renders, up to three passes — the same move as watch-skill's THE LOOP and ai-job-search reading its compiled PDF. mobilerun cannot: a tap leaves no artifact, so its 8.6% failures are invisible from inside the loop. Two agents on media-heavy surfaces, one day apart, and the one that can check its work is the one whose actions produce something inspectable before they count.

That, not model quality or harness sophistication, determines whether loop-engineering's feedback signal exists at all — and it sharpens agent-guardrails: gate the plan where you cannot verify the act. video-use asks the user to approve a cutting strategy before it renders; on a phone, that approval is the only checkpoint there is.

On evidence, Mobilerun is among the better the spoke holds and still vendor-run: 91.4% across AndroidWorld's 116 tasks against a named leaderboard (AutoGLM-Mobile 84.5, LX-GUIAgent 80.2, K²-Agent 79.3, Finalrun 76.7), on a task set it didn't write, harness published. That clears the bar most sources here fail. It does not clear the jetbrains-ponytail-tested bar: the vendor still chose the frame and ran the numbers. Read 91.4% as the ceiling of a reproducible claim, not a settled one. video-use measures nothing at all, and its 18.6k stars measure attention, not use — openclaw is the standing reminder.

Shared state is the next boundary

Two sources push past the spoke's default of one agent, one principal, from opposite directions.

Topology. agent-orchestration has meant one shape here: an orchestrator fans work to parallel subagents, coordination happens at the root, isolation is a worktree per agent. jcode's swarm runs a different one — several agents in the same repo under a server tracking who read what, so when agent A edits a file agent B has read, B is notified and can diff it or ignore it. Agents message each other, broadcast, and spawn sub-swarms, becoming coordinators in turn.

This is peer-to-peer with cache invalidation, borrowed from filesystems and CPU caches, where the existing model is a tree with isolation. The two answer the same question — what stops two agents corrupting each other's work — with opposite instincts: isolation prevents the conflict, invalidation detects and reconciles it. agent-kanban shares a board of intent; jcode shares the working tree. The author is explicit about why: "Git was clearly not built for multi-agent workflows, and git worktrees is not a good solution." No evidence either way on which holds up. Watch whether shared-state swarms hit the coordination cost that pushed distributed systems toward isolation, or whether an LLM that can read a diff makes reconciliation cheap enough to prefer.

(A second jcode mechanism belongs elsewhere: its skills load by embedding hit — the conversation is vectorised and a skill injected on similarity — where agentskills-spec's progressive disclosure has the agent read descriptions and choose. Retrieval-selected versus description-selected capability, different failure modes, no measurement of either.)

A third topology removes the orchestrator instead of relocating it. agensh (Microsoft Research) keeps agent-orchestration's tree-with-isolation picture only as the thing it's arguing against: identical workers read a shared Git workspace, a Mattermost-backed message channel, and an append-only shared-context log, then decide for themselves what to claim next. It's the first source in this spoke to put a controlled number on scaling past the orchestrator bottleneck rather than asserting the limit exists: mean pass rate on the five hardest ProgramBench tasks rises 19.31% → 28.78% from 1 to 128 workers, and on pandoc alone 33.89% → 55.06% from 1 to 1,024, model and per-worker harness held fixed throughout. The finding that matters as much as the curve: cooperation forms aren't designed in — peer negotiation at 8 agents gives way to review chains at 32, standardized merge protocols at 128, and duplicate specialist roles with failover at 1,024, from the same unmodified prompt. Read against jcode, the two disagree about the unit that should notice a conflict (a cache-invalidation ping vs. a Git merge plus a direct message) but agree that isolation-by-worktree is the thing both are moving past.

Principals. qm is built around the case that breaks the default: "Most agents are designed like personal assistants. You can make one work for a whole company, but it quickly gets complex." Once two employees share a deployment, every stateful thing the agent owns needs an owner — memory, files, keychain view, permissions, skills, crons, a durable sandbox — each scoped per person and per room (agent-scope-isolation). That lands on the open agent-memory question from an unexpected side: the "one markdown file" pole cannot hold per-scope views, so multi-user is an argument for the machinery rather than a preference for it.

Containment is the right architecture and its enforcement is heuristic

QM takes a side in the standing constitution-vs-containment tension — "the agent and software it runs in a sandbox are not trusted to make authorization decisions" — with core enforcing identity, scope and effect gates around the model. That is the containment position from a shipping product rather than an essay, and the governance shape is new here: an org-level posture (Strict / Auto / Dangerous) that narrower scopes may only tighten, with a predeclared command policy applying in every posture including Dangerous. Review is configurable; a class of effects is not.

Then its own SECURITY.md concedes the boundary is porous. The command policy is "a speed bump against mistakes and injection, not a sandbox boundary" — writing a script and running it evades it, which is constraint-evading-behavior admitted by the party with most reason to deny it. Credential purposes "travel with the credential as an instruction to the model", and an instruction to the model is not a constraint on it. Sandbox credentials sit in plaintext while in use. And the line worth carrying into every human-in-the-loop design in this wiki: "An approval means a human accepted the displayed action under the information available at that time, not that the resulting behavior is safe."

So the tension sharpens rather than resolves. Containment is the right architecture and the best-documented implementation in the corpus says its enforcement is heuristic at the edges. The honest reading is that containment and prose instructions differ in degree of porosity, not in kind — which makes what is the blast radius when the gate fails the question, exactly where agent-guardrails' recovery-cost framing already points.

Two governance practices worth stealing regardless of the product. A seven-day dependency cooldown (min-release-age=7), so a compromised npm package yanked within hours never enters a lockfile — the corpus's first concrete supply-chain control. And contributions as human-written prose: .txt or .md in adrs/, maintainers implement, with an explicit "please do not have AI artificially expand what you'd like to do into a formal proposal." Once agents write most of the code, the scarce reviewable artifact is human intent, and the PR goes back to being a conversation.

Caveats on both: jcode and QM are single sources, days old, with no benchmarks and no deployment evidence beyond their publishers'. Candour about limitations is not the absence of limitations.

At 37,000 agents the unit of design changes

Everything above scales fan-out by adding workers. virtual-biotech (Zou, Stanford, via stanford-virtual-biotech-37000-agents) runs tens of thousands and does something else with them: agents are differentiated by role and by data source — a CSO agent over pharma-style divisions, then one agent per genetics/genomics/single-cell stream — so the population has a shape rather than a width. orchestrate-100-agents-claude-code, the previous high-water mark here at 100+, is stateless one-shot copies of the same worker; agensh now sits between the two at 1,024 — also homogeneous, also role-undifferentiated at the start, but with a measured curve instead of a demo scale.

Three things follow, and none of them is settled by one talk.

The claimed mechanism is disagreement. Fan-out in this corpus buys coverage (decomposition) or a shorter tail (tail-control-agentic-workflows racing). Zou's is neither: agents "get into debates and disagreements. They have to convince the other AI scientists [of] their ideas," which he reports produces more creative reasoning and more resistance to compounding errors than one model working alone. That is the claude-security-plugin verifier quorum and agent-kanban's peer review generalised into the reason for the population's existence. No numbers on the head-to-head are given — the closest this corpus gets is agensh's 1→128/1,024-agent pass-rate curves, and those measure homogeneous workers converging on roles, not a population Zou pre-differentiates by data source, so the comparison stays a suggestion, not a test.

Optimise the environment, not the model. agent-environment-design is the sharper claim: below some scale you specify (workflows, spec-driven-development, context-driven-development); above it you supply infrastructure, incentives and guardrails and leave collaboration open, because "the environment itself is the object that we optimize." Note what survives the switch — the guardrails do, which keeps agent-guardrails' containment position intact — and what does not: the instructions. Per-agent training still happens (an "agent school" doing supervised fine-tuning), so the position is that the two layers have different levers, not that fine-tuning stopped working. It also lands next to context-files-ablation-paper's null from a different direction: one experiment found telling an agent more changed nothing measurable, one practitioner concluded at scale you should stop trying.

An MCP wrapper is not an agent interface. "Even if you wrap an MCP around the existing databases and APIs, that doesn't solve the underlying problem: the interface and APIs are not suitable for agents" — they were built for humans or pre-AI algorithms. paperclip's substitute is a virtual file system agents navigate with the file operations models are already good at, claiming an order-of-magnitude time and cost cut. This is text-first-agent-design applied to data access instead of a GUI, and it puts a load-bearing qualifier on MCP as the corpus has treated it: the protocol standardises the connection, not the fit.

Evidential standing. T3, one conference talk, no independent confirmation. The headline validation — a CD276 antibody-drug conjugate designed from pre-2025 data that merck later arrived at independently, FDA breakthrough designation following — is a retrospective coincidence reported by the party it flatters, not a prospective test, and Merck says nothing in the source. The preprint is unread. Treat the architecture as a described system and the results as claims.

The vendor states the order, and it is a claim

The layer list at the top of this file was assembled bottom-up: skills from one set of artifacts, orchestration from another, memory from a third, each arguing for its own layer. agent-sdk-workshop is the first source here that gives the same stack as a sequence, from the vendor. Four booleans in a config file, in this order: system prompt, then ENABLE_TOOLS, then ENABLE_SUBAGENTS, then ENABLE_MEMORY. Capability, then coordination, then persistence.

The switches are independent, so the order is not a technical constraint — nothing stops a learner enabling memory first. Putting it last is a judgment that persistence earns its cost only once there is something worth persisting, which is roughly what iai-pme and jcode arrived at from their own directions. What is new is that it arrives as a curriculum decision instead of a finding, from the party that ships the loop.

Two things follow.

The teaching method is the thesis. "No code writing required. You flip switches, pick from component lists, and write prompts. The SDK does the rest." That is harness-as-library stated as far as it goes: the vendor owns the loop, the builder supplies configuration and prose. This spoke has tracked the value moving from the model to the wrapper; here the wrapper is sold as something you do not write either.

The staging asserts what the measurements keep failing to find. Each stage is presented as better than the last, and the repository measures nothing. Read against the table above — cc-thinking-skills, context-files-ablation-paper, jetbrains-ponytail-tested, three parties and three layers, all finding process effects and no correctness effect — a four-step improvement ladder with no evaluation is the shape the corpus has learned to discount. One caveat keeps this from being a straight repeat: stage 1 is tools, the one layer none of those studies ablated, and the one with an obvious mechanism for a real gain. A tool supplies facts the model does not have; a context file supplies facts it mostly did. If any rung of this ladder is load-bearing it is that one, and nobody has measured it.

A smaller observation worth keeping. Four of the workshop's six scenarios — chief of staff, customer support, sre-agent, account intelligence — are operations roles, not coding. This spoke's corpus is overwhelmingly coding harnesses, and the vendor's own teaching fixtures are not. That is a market read rather than evidence, and it is the vendor's, but it points at a corner the corpus does not cover.

The layer under the harness, finally counted

This spoke's corpus is harnesses, skillpacks and meta-harnesses — things you run. turingpost-13-frameworks surveys the layer beneath: the agent-framework you build with. Thirteen of them, and until now the spoke touched this layer only when a specific entry forced it (adk, langchain), never as a class.

Three things the census shows by its shape.

The layer is Python. Twelve of thirteen support it; Mastra alone does not. TypeScript is in six, .NET only inside Microsoft's entry, and nothing else appears. That cuts against the texture of this wiki's own corpus, which is full of TypeScript and shell harnesses, and it is the first time the language line has been visible here at all.

It has started specializing. Voice and telephony, documents and RAG, research simulation, enterprise coordination. When the general-purpose entrants stop being the only entrants, the market is past its first phase — the same signal, one layer down, that the skillpack corner gave when methodology packs began disagreeing only about who pulls the trigger.

Anthropic is absent from it. OpenAI, Google and Microsoft are all listed, and AWS arrives through Strands' Bedrock default. The claude-agent-sdk this wiki calls the clearest artifact of the model-provider → agent-platform shift is not there. The article states no inclusion criteria, so there is no way to separate an omission from a judgment, and the honest record is the observation without the explanation.

A vocabulary problem worth naming. The article's ladder is model → API → SDK → framework, sorted by how much arrives pre-built. Anthropic's, already paged here, is Client SDK → Agent SDK → Managed Agents, sorted by who runs the loop and on whose machine. Both call the middle rung an SDK. A source saying "it's just an SDK" may be making either claim, and the two are not close.

A second census arrived the next day and did not agree with the first. llm-engineer-toolkit (10.7k★, 150+ libraries in 15 categories) lists 27 agent libraries where Turing Post listed 13, and seven are on both. The divergence is patterned rather than random: Turing Post carries the vendor SDKs (ADK, Microsoft Agent Framework, Strands) and the non-Python entries (Mastra, LiveKit) that the toolkit omits, and the toolkit carries a whole community stratum (AutoGen, Swarms, Composio, Browser Use, AgentOps, Langroid, AgentStack) that Turing Post has none of. Neither states an inclusion rule.

So "agent framework" is a category with a contested boundary, and every count of it is a statement about the counter — one list shaped like the vendor landscape, the other like the Python open-source community. That does not weaken the three findings above; the toolkit independently confirms crowded and Python, at twice the size. It does mean a census here is evidence of what its author was looking at, and should be cited that way.

The Anthropic absence is now twice, and still not an explanation. No Anthropic agent library appears in the toolkit either — the word occurs once across 150+ entries, inside a monitoring tool's list of what it instruments. Two criteria-free lists of different shape is a second data point and nothing more; it stops the observation being one author's oversight without making it a claim about the market.

One thing the toolkit shows that the survey could not. Its second-largest category is evaluation — fifteen libraries (Ragas, DeepEval, Giskard, Opik, AgentEvals, TruLens…) — against this spoke's standing complaint that nobody evaluates agent tooling. The complaint should be stated more precisely from now on: the instruments exist in quantity, and what the corpus has never found is anyone using them to publish a result about the tools this wiki pages. That is a different and more damning gap than an absence of tooling.

And the hole is the same hole. No source in this corpus measures a framework against building directly on an API. The survey grades on ergonomics, community size and one star count; its "weaknesses" column is editorial judgment. One layer up, three parties did run controls (cc-thinking-skills, context-files-ablation-paper, jetbrains-ponytail-tested) and found process effects without correctness effects. Nobody has run that experiment down here, on the layer where the abstraction cost is largest and most obviously in the way.

The loop becomes a config row (2026-08-13)

deepseek-harness takes the agent-middleware thesis to its limit and states the consequence in one sentence: every part of the product is a plugin, including the model adapter, the tool registry, the session log, and the agent loop itself, so every part is replaceable from configuration. There is no privileged core. LangChain's middleware hooks a loop that stays LangChain's; here the loop is one row in a tree built from ordered layers, and replacing it is a patch file rather than a fork.

Three things about this are worth carrying forward.

The substrate is older than the problem. cordis was written in 2022 as a general-purpose composition framework and had nothing to do with agents. The agent vocabulary — turns, steps, tool pipelines, session logs — is layered on as plugins. Every other harness in this spoke was designed as a harness. This is the first one that is an application of something else, which makes it the only available test of whether general composition machinery is the right substrate for an agent, and the first cost is legible already: the architecture doc opens by telling you to learn Cordis first.

One invariant lands on an open problem. "Model-visible means logged" — anything reaching a model request must be reconstructable from the append-only session log, asserted at runtime. That is an architectural answer to the exact ambiguity model-or-harness-taxonomy builds its worked example from: an agent ignores an earlier instruction, and you cannot say whether compaction dropped it or the model disregarded it. Under this invariant the question is decidable from the log. DeepSeek never claims this motivation, and the harness still compacts; what changes is that the dropping is on the record. If the failure-localization thread ever gets an instrument, this is the shape of the substrate it needs.

A model lab shipped a harness that is not a lock-in play. The vendor pattern is now well populated — anthropic with claude-code, Google with Gemini CLI and adk, DeepSeek with dsh — and the obvious read is that labs have concluded the scaffolding is where the product is. But dsh ships two LLM adapters against one seam, and the second is a generic multi-provider one where an OpenAI-compatible gateway is configuration rather than code. The harness is the durable unit and the vendors now agree, including on the part where it isn't theirs alone.

And the standing complaint survives intact. 37,128 stars on day one is the largest attention number in this corpus and it measures nothing. The repo ships a BENCHMARK.md whose entire content is instructions for running the Python SDK — a file named for the thing this spoke keeps asking for, containing no result. Held as architecture, not as evidence.

Review gets a price tag (2026-08-16)

The verification thread has argued for months that checking, not generating, is the binding constraint (agent-loops-verification), and has proposed better environments (signadot), automated verification engineers (shipping-without-human-verification) and scored evals (agent-evals) as the answer. stop-burning-tokens-on-code-review is the first source here to report what the model-based answer costs to run: about $1,000 a week for Cursor's BugBot, and $1,000 in a single day for Claude review skills in GitHub Actions, against 2,900 pull requests a quarter.

The number matters less than what the author did about it. Rather than tuning the reviewer, he had a model compile the deterministic half of the team's written guidelines into linters and then took the model out of the loop entirely — deterministic-review-gate. The model runs once, at rule- generation time; the check that runs on every agent-authored commit is a 27-second sweep with no model in it.

That is a third position in this thread, and it cuts across the spoke's usual axis. The corpus has been sorting tools by how much autonomy they grant and how much structure they wrap around the model. This source sorts by where the model sits in the loop, and finds that the highest-volume position — once per commit, per reviewer, per repository — is the one worst suited to a probabilistic tool. Cost is the visible symptom; the reviewer's second queue is the real one, since a model comment must be read to be dismissed and a lint rule does not.

The caveat is the same one this spoke keeps recording. Nothing in the source measures what the linters miss. The trade is cheaper-and-faster against possibly-blinder, and only one side of it has numbers.

A pack with no measurement in it (2026-08-17)

ai-marketing-claude is the marketing vertical's turn at agent-skills, after agentic-seo-skill and claude-skills-ppc, and it is most useful here as a specimen rather than a tool. Reading its file tree instead of its README gives the spoke a number it can compare: 14 skill files, 5 subagents and 4 Python scripts, in 37 files and 132 KB. agentic-seo-skill, the same form factor one vertical over, ships 89 scripts it calls evidence collectors.

That gap is the verification thread restated as a packaging decision. One pack sends the agent to fetch a fact and reason over it; the other sends the agent to look and write. Both emit something shaped like an audit, and the marketing pack's output is a scored, client-facing PDF — the artifact where an unmeasured number is least likely to be questioned and most likely to be forwarded. agent-skills-can-be-harmful measured 307 failures caused by skills themselves and skillsbench defines the deterministic verifier that would settle it; neither has anything to bite on here, because there is nothing in the pack that produces a checkable observation.

And the popularity signal degrades further. agentic-awesome-skills established that stars measure attention rather than fitness, but that catalog carried 2,464 commits of visible maintenance underneath the number. This repository was created and last pushed nine minutes apart on 2026-03-02 and, re-checked on 2026-09-27, still holds exactly one commit: nearly seven months of silence, now against 2,686 stars, 712 forks and 6 unanswered issues (2,451/692/7 on 2026-08-17). The fork-to-star ratio held at 27–28% across that six-week gap while both counts grew — not an early-life artifact settling with age, but what the pack looks like when people take a copy rather than depend on one. So the corpus now has the clean case: a skill pack with heavy adoption signal and exactly one push behind it. Whatever the stars measure, it cannot be that anyone found it correct, because it has never been corrected.

The delivery method belongs in the same paragraph. The documented install is curl … | bash from an unmaintained repository, installing instructions an agent will then execute with the user's tools — two trust decisions collapsed into one command, in a corpus that already holds a paper on skills causing failures. Nothing suggests bad intent; the point is that the mechanism gives the user no moment to look.

What the source is good evidence of is the form factor reaching non-engineering work, and what a pack contains when it gets there: a router skill, a fan-out of specialists, a handful of scripts, and client-deliverable templates — proposals, launch checklists, email sequences. Agency work packaged as a skill pack, sold to agency builders and solopreneurs. That is a real observation about where agent-skills is spreading, and it is separate from whether this instance works.

A fifth instance adds a true zero to the evidence-collector spectrum (2026-10-07). claude-marketing-research-skill has no scripts directory at all — one SKILL.md, competitor data from "web search" rather than a fetcher the project wrote. The spectrum this thread tracks now reads 0 (claude-skills-ppc, an article) · 0 (this one, a real pack) · 4 (ai-marketing-claude) · 6 (geo-seo-claude) · 89 (agentic-seo-skill). It's also small enough (55★, 3 commits) that its rough edges are still visible rather than smoothed over by attention — a wrong repo name in its own install commands, an unfilled "[Your Name]" credit — the state a pack is in before the single-push-then-silence pattern above, not after it.

The prompt becomes a fitted parameter (2026-08-20)

dspy and awesome-prompts arrived together and named a corner this spoke had been circling for months without a word for it: prompt-optimization — you supply a program, examples and a metric, and a search rewrites the instructions and demonstrations until the score stops moving. The prompt stops being authored text and becomes a fitted parameter.

The pieces were already here, unconnected. awesome-hermes-usecases pinned hermes-agent's "closed learning loop" down to GEPA + DSPy optimization; meaning-typed-programming benchmarked MTP against DSPy as its main rival. Neither reading noticed that the mechanism underneath is the same one, or that GEPA is a published algorithm (arXiv 2507.19457) rather than a vendor's private trick. Paging DSPy — 37.5k stars, 406 contributors, four papers, cited fourteen times here across five pages and never written up — closes a gap the spoke created itself.

It is the second mechanism for self-improving-agents. Until now that page had exactly one: an agent writing skill files for itself. Prompt optimization is the other, and it is the one with peer-reviewed algorithms and thirteen shipped implementations behind it.

It is also the one corner that cannot skip evaluation. The complaint that runs through this synthesis — nobody measures the tooling — has a structural exception here, because an optimizer without a metric does not run. That turns out to be less than it sounds. The gain an optimizer reports is measured against its own seed prompt, on a metric its operator chose, over examples its operator supplied. It says search beat the starting point. It does not say the framework beat a competent human writing the prompt by hand, and nothing in this corpus runs that comparison. The instrument is finally present and the experiment still is not.

There is a reason to think the hand-written baseline is weaker than it looks, and this spoke found it independently: cc-thinking-skills, context-files-ablation-paper and reasoning-scaffolds all report process effects without correctness effects for hand-authored structure. An approach that ignores authorship and fits to a score is attacking the problem from the side the evidence favours. Nobody has run it as an experiment, so it stays a reason to look rather than a finding.

Where the category boundary actually runs

DSPy is missing from turingpost-13-frameworks's thirteen and from llm-engineer-toolkit's twenty-seven; the toolkit does carry it, under LLM Prompts, in a nine-entry category otherwise made of prompt compressors, with Guidance and LMQL exiled again to Structured Outputs. The agent-framework finding was that the category has no agreed membership. This is the third data point and the first that explains why: both censuses sort by what you assemble — agents, chains, crews — and a compile step is not an assembly. It gets filed next to LLMLingua because both edit the prompt, which is classification by surface rather than by function. The peer-reviewed source disagrees with both directories: meaning-typed-programming treats DSPy, LMQL and MTP as one comparable class.

The system prompt is now a distribution channel

awesome-prompts is a curated directory with a thesis — "the engineering camp gets more space" — that its own proportions contradict, 488 lines of copy-paste prompts against 68 of frameworks. The interesting half is not the argument. It is that the Coding & Development prompts are distillations of this spoke's own corpus, each citing the artifact it came from: Anthropic's auto-mode write-up as a permission-classifier prompt (agent-permission-model), harness guidance as an "Agent Harness Designer" (agentic-coding-harness), three separate encodings of loop-engineering, skill authors for Codex's SKILL.md and Roo Code's modes (agentskills-spec).

So a technique this wiki reaches through a paper or a repo reaches a practitioner as a paragraph they paste. The system prompt has become the transport layer for agent-tooling technique, and the same source shows the other end of that: six catalogues of leaked production system prompts, framed as curriculum. This spoke met that material once as evidence about one product (claude-fable-system-prompt-leak); it is now a standing genre with a reading guide attached. Nothing in either half is measured — no prompt in the directory carries an evaluation — so the source is a map of what the practice is attending to, and nothing stronger.

Somebody built the comparison rig (2026-08-21)

agtx is a kanban TUI that runs several coding agents at once, worktree and tmux window per task, with a different vendor's harness per phase. That description makes it the second board product here after agent-kanban, and on its own it would be an incremental entry. The part that matters is buried in benchmark/.

agtx ships a SWE-bench Lite runner whose config file names the workflow plugin. That turns the methodology packs this spoke has been paging one at a time — superpowers, spec-kit, get-shit-done, OpenSpec, skill stacks including ponytail — into swappable arms over a fixed task, model and sandbox, each run reporting duration, tokens, dollar cost and a three-way outcome grade. Eight configs are published with results.

The results are almost worthless and the rig is not. n=1 per arm on one task out of 300, one model, no repeats, the tool's own author running it, and every config sets skip_worktree = true so agtx's own parallelism is switched off for the entire benchmark. What is measured is the plugin, with agtx as the driver.

Even so, the one published table says something the spoke's own thread predicts. Seven of eight arms produced the correct fix and stopped short of writing a test (🟡); the single ✅ was superpowers, which wrote the test at $2.64 against the cheapest partial pass's $0.40 and 15m46s against 4m48s. If that holds up, the methodology pack bought completeness and charged 6× for it, which is a cost effect with a correctness effect attached — the thing cc-thinking-skills, context-files-ablation-paper and reasoning-scaffolds all failed to find. One task is not evidence of it. It is a reason to run the rig properly.

So the standing complaint needs a smaller amendment than it looked like it needed. llm-engineer-toolkit made the sharpened version: the instruments exist in quantity and nobody publishes a result with them. Somebody now has. What is missing is anyone running it past n=1, and jetbrains-ponytail-tested is the reminder of what that costs — 251 billed trials and $246.09 for a single skill, with every trial audited for contamination.

Two smaller findings. Orchestration here is heterogeneous: not one model fanning out to copies of itself, but Gemini, Claude and Codex taking successive turns on one task with automatic switching, which is a shape agent-orchestration had not carried. And the stuck-task detector reads the agent's tmux pane to diagnose why a task stalled, then either nudges or escalates to the human as an MCP tool call — text-first-agent-design applied to supervision, and agent-guardrails' escalation argument implemented as an API rather than a crash.

One conflict recorded, not resolved. spec-driven-ai-tools (T4) scored OpenSpec highest of the tools it hand-tested. Here OpenSpec is the leanest arm by tokens and lands 🟡 — correct fix, no test. Different criteria, so not a contradiction; but the reading that survives both is cheap, and does not finish the job.

Running it once was never a measurement (2026-08-21)

beyond-pass-at-1 (Northern Kentucky University, T1) arrived through the research pass and settles something this synthesis has been circling from the wrong side. The complaint here has always been that nobody measures agent tooling. The sharper statement is that the standard suites measure the wrong property: swe-bench, webarena and tau-bench all score a single attempt per task, none treats duration as a variable, and only tau-bench touches repetition at all. A single attempt measures capability — can it. Anything operational needs reliability — does it, consistently.

Over 23,392 episodes at k=3 across 396 tasks, four duration buckets and ten open-weight models, run-to-run spread on long tasks reaches ±7 to ±10 points at 95% confidence on one model in one bucket. That number retroactively grades every one-shot comparison in this corpus, agtx's eight-config table most of all: the gaps it reports are smaller than the noise nobody measured.

Three findings worth carrying beyond the methodology.

Decay is domain-stratified. Software-engineering GDS falls 0.90 → 0.44 across the duration range while document processing stays flat at 0.74 → 0.71. "Long-horizon agents degrade" is too coarse; what degrades depends on what the horizon is made of.

High variance is a capability signature, not an instability one. Frontier VAF ≥2.37 against mid-tier ≤1.26, and the strongest models have the highest meltdown rates, up to 19%, because they attempt ambitious multi-step strategies that sometimes collapse. Capability and reliability rankings diverge with multi-rank inversions at long horizons — a leaderboard position earned on short tasks does not transfer.

Memory scaffolds hurt, and that is the fourth negative result on added structure. cc-thinking-skills, context-files-ablation-paper and reasoning-scaffolds found process effects without correctness effects. This one finds a correctness effect pointing the wrong way: long and very-long GDS falls for 5 of 9 models, worst on the strongest (Llama 3.3 70B Δ=−0.13). The proposed mechanism is a budget argument rather than a memory argument — the scratchpad's extra tool calls and context injection "tax capable models' step budgets more than it benefits them" — which is context-rot arriving from the reliability side. What is disconfirmed is naive episodic memory; agent-memory and self-improving-agents both rest on persistence, and neither can now treat it as free.

A second, independent data point (2026-08-22). vibesearchbench (in ../osint-wiki, T1) ablates three mechanisms of a production harness — sub-agent collaboration, local memory and life-long memory — on 200 multi-turn search tasks scored by graph matching, and reports no significant improvement from any of them. Different task, different metric, different harness, same direction: the memory result here is no longer a single study's finding. What it still does not cover is curated or retrieval-gated memory, so the successor edge stands.

The source contradicts itself and the page says so. Its abstract claims memory scaffolds "universally hurt … negative or neutral for all 10 models." Its body reports 5 of 9, with Mistral Nemo slightly positive. Both are recorded; the body is what to cite.

And the excuse is gone. The whole study cost about $0.004 per episode, $40–120 in total. Variance is absent from the standard suites by choice, not by budget.

The proprietary set behaves the same way (2026-08-23, research pass). science-of-agent-reliability (Princeton, ICML 2026) runs the complement: 14 proprietary frontier models, no open-weight ones, K=5 runs per task at temperature zero, on GAIA and the 26 clean τ-bench tasks. beyond-pass-at-1's own limitations section had guessed that "GPT-4o, Claude and Gemini are likely more reliable than the models studied here." They are not usefully so: across 18 months of releases, accuracy climbs and overall reliability moves only modestly, with τ-bench showing moderate gains and open-ended GAIA barely any. The plateau is not an artifact of studying open weights, which is the single most useful thing this pair of studies establishes.

Three things it adds that the open-weight study could not.

Consistency runs backwards against size. Within a family, calibration, robustness and safety improve with capability while outcome consistency often does not — smaller models match or beat their larger siblings, because a bigger model has more ways to attempt a task and therefore more ways to vary. Set against beyond-pass-at-1's "high variance is a capability signature," two independent designs now say the same uncomfortable thing: the better model is the less predictable one, and this corpus's harness thread has been treating capability and dependability as the same axis.

The instability is in ordering, not in choosing. Agents pick similar action types across runs and vary the sequence — the authors' "what but not when." That is the most specific mechanism the spoke has for agent nondeterminism, and it points at planning and execution rather than at tool selection, which is where most harness machinery here actually intervenes.

Cost is unpredictable too, and worse where it hurts. Resource consistency — tokens and compute across identical runs — is poor on GAIA and degrades with difficulty, with the newest Claude models showing a "try harder" pattern of elevated action counts on hard tasks. Every cost figure in this corpus is a single run (effort-level, agent-storage-footprint, stop-burning-tokens-on-code-review), and none of them carries a spread.

What neither study touches: the harness is held fixed in both. scaffold-effects-gaia varies the scaffold with three attempts, this varies the model with five runs, and nothing varies both with repeats — so the spoke's central claim, that structure substitutes for capability, is still measured without variance on the structure side.

The vendor ships the pattern, and keeps the hard half (2026-08-21)

claude-browser-use is anthropic's Browser Use toolset, announced 2026-08-20 next to general availability for Computer Use, the Skills API and the Files API. Claude reads a page as its accessibility tree and acts on element references (ref_3) instead of screen coordinates — text-first-agent-design, now shipped by a model provider rather than by a tool builder, and on the surface the pattern was invented for.

The title of the source is the finding. Anthropic does not run a browser. The toolset exposes 27 operations and executes none of them: the developer opens the browser, performs each action, holds the session across turns and returns the result. What ships is a protocol and a tool definition. That makes it the vendor layer's sixth shape, and the inverse of the fifth: gemini-managed-agents-hooks dissolved the harness into the model API and then sold hook points back to replace the infrastructure it had taken away. This puts the tool vocabulary in the model API and leaves the entire runtime — the browser, the session, the containment, the failure handling — with the developer. The vendor defines what Claude may ask for; you still own everything that happens.

Three specifics carry beyond this tool:

Then the hosting split. The same release put Skills into Anthropic's sandbox and Files into Anthropic's storage, and left browser sessions, downloads and uploads on the developer's machine — with the advice to run them in an isolated container or VM, JavaScript off, uploads off, because Claude-generated code executes with the page's privileges. Browser Use is also not available in claude-managed-agents. The vendor took custody of the two surfaces where containment is easy and declined the one where the untrusted input lives. Read generously that is staging; read plainly it is where the liability sits.

Convergent design, divergent protocols. Playwright's ARIA snapshots, Playwright MCP's referenced accessibility snapshots and Puppeteer's Accessibility.snapshot() already do the substantive thing. Playwright MCP speaks MCP; Browser Use speaks Anthropic's own client-toolset protocol; bridging them is an adapter in both directions. The interop story the corpus keeps tracking (a2a-protocol, webmcp) gains another wire that does the same job differently.

Sourced entirely from anthropic-browser-use-tool — trade press, T2, with the outlet's disclosure that its owner invests in Anthropic. No first-party document ingested, and no measurement anywhere: no Browser-Use-vs-Computer-Use cost or accuracy comparison exists here, which is the number that would say whether the tree pays for itself the way mobilerun claims it does on a phone.

Part of the benchmark score is recall, and it grows with publication (added 2026-08-22)

swe-bench-illusion closes the contamination half of edge 7 with an instrument worth copying: ask the model something a genuine solver could not answer. Name the buggy file from the issue text alone, with no repository access; reproduce the fixed function from the issue and the current file.

60–76% on SWE-Bench Verified, below 53% off-benchmark, on repositories averaging 763 files, and 35% verbatim 5-gram recall of the fix against 18% elsewhere. The ordering — Verified highest, the same benchmark's unverified tail lower, unrelated repositories lowest — is what contamination predicts and what a general capability would not produce.

What it does not license. The harness argument this spoke rests on (swe-bench: ~2% for a bare model, an order of magnitude more inside a scaffold) is untouched in shape. Knowing where a bug lives is not fixing it. What changes is the precision of every current number: a cross-model comparison on Verified is partly a comparison of training-set overlap, and the spoke should stop treating small gaps between vendors' reported scores as meaningful.

Second confirmation, from the other side. agent-storage-footprint found 108 SWE-bench Verified submissions whose trajectory volume spans three orders of magnitude with no correlation to resolve rate. Two independent 2025–26 results agreeing that the headline number carries less information than its two decimal places suggest.

The refusals become the product (2026-08-23)

Every harness in this corpus is described by what it adds. KOT is the first described by what it takes out, and the three removals are exactly the three layers this synthesis has treated as settled infrastructure: the permission gate, the skills subsystem, and MCP.

The skills argument is the one worth arguing with. "A skill is a text with instructions that someone wrapped into a separate mechanism with a registry, an installer and versions" — true as far as it goes, and it does not go as far as the claim. The case for skills in this corpus was never the registry; it was progressive disclosure, loading the instruction only when the job needs it, which is a context-budget argument (agent-skills, agentskills-spec). Handing the agent the document and telling it to follow it is the thing progressive disclosure exists to avoid at scale. KOT does not answer that, and nobody has measured which side is right — the savings claim was already flagged here as vendor-measured.

The MCP refusal is stronger, because it comes with a replacement rather than a shrug: cli-wrapper turns any CLI, including one held open as a resident process, into a typed tool with validated parameters. That is the same job as an MCP server minus the protocol and the extra process, and it concedes the underlying need while rejecting the standard. It is the first source here to argue the transport is the accidental part of MCP.

What the refusals share is a bet that built-in beats extensible. Ten fixed tools, no registry, no protocol — which is only viable while the built-in ten cover the work, and is the opposite of the pattern ecc and superpowers demonstrated at 284 and hundreds of skills. It is a falsifiable position rather than a manifesto, and the fixed ten tools are where it fails first.

The same refusals, the opposite bet (2026-08-30)

That last paragraph generalized from one instance, and the second instance breaks it. Pi refuses more than KOT does — no MCP, no sub-agents, no permission popups, no plan mode, no built-in to-dos, no background bash — and overlaps it on MCP and permissions. It reaches those refusals from the far side. KOT removes the extension surface and keeps ten tools built in; Pi removes the features and keeps nothing but surface, under the heading "Primitives, not features", with subagent/, plan-mode/, permission-gate.ts and sandbox/ sitting among 50+ example extensions and a package registry (pi install npm:… / git:…) to distribute more.

So a refusal does not imply a built-in bet. It implies a claim about where a capability should live, and the two harnesses put it in opposite places: KOT in the binary, Pi in userland. Both then tell the same story about why — the feature list of a sealed product is somebody else's guess at your workflow. What separates them is who is expected to close the gap, the vendor or you, and Pi's answer is the more demanding one: "just ask Pi to build it. It will customize itself on the fly." A harness whose documented method of acquiring a feature is asking the agent inside it to write one, then /reload.

The MCP argument is the same argument in both, and it now has a date. Pi's "No MCP" links Zechner's post "What if you don't need MCP?" from 2025-11-02 — nine months before KOT's cli-wrapper reached it independently. This synthesis recorded KOT on 2026-08-23 as "the first source here to argue the transport is the accidental part of MCP." It was the first the spoke read, not the first to say it.

And the adoption numbers are not close. Pi carries 99,163 stars and 12,303 forks (GitHub API, 2026-08-30) on a repository created 2025-08-09 and pushed the day before it was read — the largest in this spoke by an order of magnitude, against KOT's v1.0.0 tagged nine days earlier. Stars measure attention rather than quality and the spoke's standing caveat applies, but the extensible-refusal position is not a fringe one and the built-in-refusal position has no comparable following yet.

A fork the corpus already held, now with its parent. oh-my-pi was ingested on 2026-06-01 as "a fork of Mario Zechner's Pi" and placed at the feature-rich end of the harness spectrum against claw-code. With Pi paged, the pair stops being two unrelated projects on an axis and becomes one codebase forked in the direction its author refused to take it — Pi ships no subagents, oh-my-pi ships isolated parallel workers returning structured JSON; Pi ships no permission gates, oh-my-pi wires in an IDE. That is the cleanest natural experiment on built-in-versus-extension this spoke has, and neither side has measured anything.

Meanwhile the surface it refuses to extend is itself a copy. KOT's Agent tool documents subagent_type, general-purpose, sonnet/opus/haiku aliases, effort from off to max, isolation: worktree|remote with remote unavailable, and <task-notification> results — Claude Code's API, field for field, a dead parameter included. Against mimiclaw, nemoclaw and nanoclaw reimplementing openclaw, the pattern is now hard to miss: the harness API is becoming a de-facto interface that clones adopt whole, and a project can reject three of the ecosystem's standards while inheriting its tool signatures verbatim.

Somebody counted the skills ecosystem (2026-08-23)

The spoke has tracked skills for three months on vendor posts, README claims and one null experiment. attention-is-all-you-have is the first source to crawl the thing: 56,804 SKILL.md directories across 1,133 public repositories, 56,245 bodies fetched. Four numbers change what can be said here.

Skills became a provider integration channel, and it is now measurable. 21 major-provider organizations publish 958 first-party skills — AWS 138, Anthropic's own collections 379, Google 92, Sentry 80, Elastic 70 — with 79% of the provider-product skills naming that provider's own CLI and 60% carrying executable shell. The corpus's own reading of perplexity-api-platform-skills — a vendor teaching every agent to drive its product with markdown instead of an MCP server — turns out to be the general case, not an example.

The portability claim was half true. One format, 54 distinct project-level skills directories across 75 agents, 58 home-directory locations, and a community CLI that installs once and symlinks everywhere. agentskills-spec standardized what a skill is and left where it goes to each vendor, and the fragmentation this synthesis kept describing qualitatively (ponytail wiring 15 hosts, renwei-writing's Cola-specific directory) has a count now.

Residency is the scarce thing, and the ecosystem is bidding for it. An installed skill's description costs 50–280 tokens on every message, and buys exactly one thing: firing unasked. The authors bound the reliable capacity at fewer than a hundred slots per agent — argued from the literature, not measured, and flagged as such by them. Against 56,804 published skills, the ratio is the point regardless of where the true number sits. Two second-order effects follow, and both are already visible in artifacts this spoke holds. Authors pad descriptions into bids (Stripe's flagship skill: ~150 words of trigger conditions, ~20× a quiet description), and teams defect to AGENTS.md because always-loaded beats a trigger lottery. The mechanism that matters most: dilution means the channel degrades exactly as adoption succeeds — the more skills get installed, the worse each one fires. Every "install our 2,003 skills" artifact here (agentic-awesome-skills, ecc, superpowers) is under that ceiling.

And it lands the same week as the opposite conclusion. KOT read the same install layer and deleted skills altogether, on the argument that the registry is the only thing they add. This paper reads it and keeps skills while deleting the install: content, persistence and triggering are three functions bundled into one switch, and only triggering needs the prompt (@skills). Two independent 2026-08 sources agree the install lifecycle is the broken part; they disagree on whether the artifact survives it. That is the sharpest live disagreement in the spoke, and it is testable — the question is whether a fetched-at-point-of-use skill outperforms the same text pasted into a prompt, which nobody has run.

The standing caution applies to the remedy and not to the count: SylphAI sells the agent and hosts the hub. The crawl is the contribution; the protocol is a product.

The prompt directory converts (2026-08-25)

prompts-chat is the 2022 prompt directory — fatih-kadir-akin's awesome-chatgpt-prompts, 167.9k stars, the artifact that named the genre — and in 2026 it carries 66 Skills, 13 Workflows, an MCP server and a Claude Code plugin. Its definition of a skill is agentskills-spec's, written by someone who arrived from the other side, and its skills are indexed by the system they drive (Supabase, Stripe, GitHub, Termux) rather than the persona they request. That is the distance between the two sections of one site.

The number to hold is 66 against agentic-awesome-skills's 2,003, from an audience roughly thirty times larger. Read next to the residency ceiling above, it cuts against the assumption that skill supply is unbounded: the largest non-specialist prompt community on the internet produces skills two orders of magnitude slower than a specialist catalogue does. Either authoring a skill is genuinely much harder than writing a prompt, or the submission path here still belongs to the old artifact. The source cannot separate those, and neither can the corpus yet — but if the first reading holds, the "fewer than a hundred slots" ceiling binds much later than 56,804 published skills implies, because most published skills come from few authors.

The CC0 licence on the prompt data is the other durable fact, and it is the one nothing here measures: a public-domain corpus of this size is a plausible upstream for training and eval sets, and it appears inside other tools with no attribution trail by design.

The harness moves onto the device, and the guardrail becomes a number (2026-08-30)

seekerclaw arrived by Telegram and lands on two of this spoke's threads at once.

First, it breaks a split this corpus had drawn too coarsely. mobile-device-agent was written from one source and described the shape as device-plus-operator: a helper on the phone exposing control, and a runtime elsewhere holding the loop, the model and the tools. SeekerClaw runs the runtime on the phone — a Node.js foreground service with a heartbeat and a cron timer — while still calling a remote model. So the observation that made those frameworks model-agnostic survives and the architecture around it does not: the model is remote, the harness need not be. The consequence is not academic. A resident harness has no session to start, which is why its interface is a chat channel rather than a CLI, and why cron and persistent memory are core modules rather than add-ons. It is the agentic-tooling thesis on unfamiliar hardware — the value is in the wrapper, and the wrapper turns out to be portable to a phone.

Second, it supplies the guardrail case the corpus was missing. agent-guardrails organizes bounds by reversibility, and gemini-managed-agents-hooks added budget as a second axis in tokens. An irreversible on-chain transaction is where both meet: nothing can be undone, and confirming every action would defeat the point of an agent that runs unattended. The answer taken is neither — cap the loss and act freely underneath it. Per-transaction and daily limits in USDC and SOL, preflighted before any send, burner key signing silently under cap, main-wallet popup over. And a split by effect rather than size: for x402 payments a GET settles silently under cap while a POST always asks.

That last detail is the generalizable one, and it states the reversibility principle better than either bound does alone: reads are bounded by money, writes are bounded by consent. What the design concedes, and says so on its own README, is that it makes nothing reversible — it makes the worst case a number the principal chose in advance.

What it does not have is any measurement, which is the standing condition of this corner. mobilerun's AndroidWorld lead is its own vendor's run; SeekerClaw publishes no benchmark at all. Two sources, a hackathon judgment, and nobody outside either project has scored anything.

The failure distribution existed all along (quality cycle, 2026-08-30)

agent-failure-localization has carried, since 2026-08-06, that "nobody has published frequencies" for agent failures. One search during the absence-claim drain found two studies, and the older predates the claim by seventeen months.

MAST (NeurIPS 2025) publishes the distribution with the methodology that makes it a measurement — 150 expert-annotated traces at κ = 0.88, then 1,600+ through a validated LLM judge, across seven frameworks and four models. System design issues 44.2%, inter-agent misalignment 32.3%, task verification the remainder.

And the shape corroborates this spoke's central claim from the failure side. Step repetition (15.7%) and unawareness of termination conditions (12.4%) are 28% of all failures between them, and neither is a reasoning deficit — both are missing loop control. Disobeying the task specification is 11.8% and disobeying a role specification is 1.5%. So the losses are overwhelmingly in the scaffold, not in the instructions or the model, which is structure over capability stated as a defect distribution rather than as a benchmark spread.

coding-agent-misalignment supplies the denominator at production scale — 20,574 sessions, 1,639 repositories — and one trend worth watching: overall misalignment falls over time while constraint violations and inaccurate self-reporting rise proportionally. As agents get better, what remains is the agent ignoring a stated rule and misreporting what it did. That is corrosive in a specific way, because 91.49% of misalignments need a human to catch and correct them, and both growing categories are the ones a human cannot easily audit.

What is still open is narrower than before and unchanged in kind: neither study varies the harness as the independent variable, so the failure distribution across scaffolds — the thing growth edge 12 wants — is still unmeasured.

The harness thesis gets a formal statement (research pass, 2026-08-30)

This spoke has been assembling "the harness matters more than the model" out of five sources — scaffold-effects-gaia, claw-swe-bench, harness-bench, ddr-bench, confucius-code-agent — each measuring one cell. harness-disclosure (Zhang et al., arXiv 2605.23950, T1) states it as a proposition that can be false.

The Binding Constraint Thesis: with HV(M) the variance of benchmark score over harnesses and MV(H) the variance over models, HV > MV for long-horizon tasks among comparable frontier models. Two quantities and a claim about which is larger, rather than a slogan.

It also supplies the largest harness effect the corpus holds — ~48 pp single-model swing across scaffolds on HAL's SWE-bench Verified Mini, against harness-bench's 23.8 pp — and names the consequence that makes this more than noise: model ranking reversal, the same model placing above or below a competitor depending on the scaffold.

The reframing is the durable part. The inference framing treats an agent as a model in a while-loop and attributes the score to the model. The closed-loop framing makes the harness a controller with stability, context drift and control lag, and the model an open-loop policy it governs. That explains the magnitude rather than just reporting it: controller properties compound over a long horizon in a way a per-token policy difference does not.

Edge 12 half-closes and its residue sharpens. The paper argues that a factorial protocol with reported variance components is necessary, and aggregates other people's single-run numbers to argue it. Nobody has run it. The corpus now holds the specification of the missing experiment and still not the experiment — which is a better position than before, because the successor edge can now name a protocol instead of a wish.

The marketing pack learns to measure, and the funnel becomes the pattern (2026-08-31)

geo-seo-claude (zubair-trabzada, MIT, 9,877★ / 1,531 forks, routed 2026-08-31) is the fifth marketing/SEO skill pack here and the second by the author of ai-marketing-claude. Set beside his earlier one it does something the spoke has not seen: it revises the design choice this synthesis criticised, in the direction of measuring.

The verification thread's sharpest instance was ai-marketing-claude — 4 Python scripts against agentic-seo-skill's 89 evidence collectors, emitting a scored client PDF that rested on no checkable observation. Same author, five and a half months later: six scripts, four of which fetch facts rather than form impressions — page retrieval and parsing, a citability score computed from word counts, pronoun density, sentence length and counts of percentages and dollar figures, a robots.txt read for 14+ named AI crawlers with fixed deductions per blocked agent, and llms.txt validation. The composite score now hangs off observations. A skill pack in this corpus moved along the verification axis on its own, without a benchmark telling it to.

It also publishes what ai-marketing-claude withheld — a 16 KB scoring methodology with per-point criteria — and then does something rarer than either:

"These weights are not derived from a controlled study and are subject to change as AI search platforms evolve."

That is a third posture toward the unverifiable score, beside ai-marketing-claude's silence and claude-seo's output contract forcing a "how would we know this failed?" line into every recommendation. Publish the arithmetic, label it opinion. Of the three it is the cheapest for a reader to audit, and it is the only one that concedes the gap rather than engineering around it.

The ceiling did not move. Every input is a property of the site; none is a measurement of whether an AI system cited it. The score predicts citability and nothing checks the prediction — the same wall claude-seo hit ("nothing measures whether the audits improve rankings"). So the pack got better at observing its inputs and no better at evaluating its output, which is exactly the distinction skillsbench and verification-loops-skills have been drawing. Measuring what you can reach is not the same as knowing whether you were right.

A found defect, and what finding it cost. Reading the tree rather than the README turned up a headline feature that is not wired up: /geo report-pdf needs templates/geo-report-template.html, that file is in the repository, and install.sh never copies the directory — it installs geo/, skills/, agents/, scripts/, schema/ and hooks/ and verifies the schema directory but not this one. The skill also hardcodes /Applications/Google Chrome.app/ in a repository shipping a Windows installer, and the README still documents a ReportLab script that the skill itself (v2.0.0, "No ReportLab") replaced. The finding took reading three files. Nothing in 9,877 stars or 1,531 forks surfaces it, which is agentic-awesome-skills's point about star counts arriving as a concrete case rather than an argument.

The Skool funnel is now a pattern. claude-seo was recorded as the spoke's first two-tier open/paid cadence — MIT repo plus a members-only mirror, run by agrici-daniel. This pack points its repository homepage at a Skool community and closes the README by naming the rate the free tool is meant to win: "GEO agencies charge $2K–$12K/month. This tool does the audit. The community teaches you how to sell it." No gated code here, so the structures differ — one sells early access to the same pack, the other sells the sales training. But two of the three largest SEO packs in this spoke, by unconnected authors, are the top of a paid funnel on the same platform. The pack is not the product. That reframes the "service business in a box" reading on ai-marketing-claude: the box is free because the box is the advertisement.

One correction to carry forward. ai-marketing-claude's "nine minutes, then nothing" is a fact about that repository, not about its author — the same person has maintained this one for six months while the other sat untouched, both accumulating stars. Whenever this spoke reads repository metadata as evidence, the abandonment signal attaches to the artifact and not to the builder.

Unmeasured, still. Nothing has been run. Five of the six statistics in the README's opening table carry no citation anywhere in the repository; the sixth traces to a named Ahrefs study of 75,000 brands (YouTube presence correlating 0.737 with AI citations against 0.266 for backlinks), which is a real source buried one level below the headline using it. Sourcing detail belongs to ../search-marketing-wiki, where the GEO claims live; what belongs here is that the pack's citability rubric independently rediscovers the three levers geo-paper actually measured — statistics, quotations, cited sources — and never cites the paper.

The split gets formalized a third time, and acquires a clock (2026-08-31)

long-horizon-agents-survey (Dong et al., RUC-NLPIR, July 2026 preprint, ~730-paper reading list, 1,015★) writes this spoke's central question as a decomposition:

Agent = π_θ ⊕ ℋ

A base policy coupled to a surrounding harness. That is the third independent formalization of the model/harness split in roughly two months, and the three do different jobs: harness-disclosure measures it (HV > MV, ~48 pp swing, ranking reversal), model-or-harness-taxonomy diagnoses across it (which component broke, therefore which repair), this survey organizes the field by it. None cites the others.

Worth stating plainly, on the day the hub also corrected itself in the opposite direction: this is genuine convergence. Three groups, three institutions, three purposes, no shared ancestor. Compare research-wiki/llm-wiki, where four apparent independent arrivals turned out to descend from one gist. The test is whether the members owe each other anything, and here they do not.

The new thing is a dynamic, and it dates our best number. The survey's organizing claim is that externalized harness engineering and internalized model optimization co-evolve — "capabilities first implemented explicitly in the harness may later be internalized into the model policy, while stronger policies in turn enable more capable harnesses."

Read against the Binding Constraint Thesis, that is a clock. HV > MV is largest exactly where the harness compensates for something the policy cannot yet do; the co-evolution account says such compensation gets trained in. So ~48 pp is a 2026 reading, not a constant, and this synthesis has been treating a measurement as a standing conclusion. Not a contradiction — one is a measurement, the other a trajectory, and the survey measures nothing — but a condition the harness thread should carry from here on. The deciding experiment is the one harness-disclosure already specified (factorial model × harness, reported variance components), run at two points in time. Edge 12 gains a second dimension rather than closing further.

Two threads turn out to be rungs of one ladder. The survey's nested levels — H1 intra-context (minutes) ⊂ H2 cross-context across windows and sessions (hours–days) ⊂ H3 cross-task open-ended stream, with capabilities C1 ⊂ C2 ⊂ C3 — make agent-memory the definition of H2 rather than a feature of interest: a task outliving its context window cannot be done without cross-context state. The same move puts self-evolution at H3. The memory corner and the self-improvement corner have been filed here as separate enthusiasms; they are the second and third rungs of one requirement. Paged as long-horizon-agency.

And a periodization that dates the corpus. Prompt engineering (2020–2023) → context engineering (2023–2025) → runtime harnesses (2025–present). Nearly everything this spoke holds is Stage III, which is worth knowing about our own sampling.

What the source is not. A preprint, not peer-reviewed, and a survey measures nothing — every figure in it is relayed, including the Figure 1 claim that agent time horizons double every few months, which is METR's (arXiv 2503.14499) and which this wiki holds only as a row label in beyond-pass-at-1. The horizon axis the whole H1/H2/H3 ladder hangs on rests on one external measurement nobody here has read. New edge: ingest METR.

Pillar II is not ours. Agentic RL, on-policy distillation, mid-training, data and environment synthesis — train-time work, ../machine-learning-wiki's subject by the line the two spokes were split on. The survey is the first source here to make that split a research program rather than a filing convention, and its co-evolution claim says the two spokes' subjects are coupled, which is a better reason to cross-link them than we have had.

The word for the thing loses the thing (2026-09-01)

vibe-coding-prompt-template is a five-step workflow — deep research, PRD, tech design, AGENTS.md and agent_docs/, then a plan-approve-build loop — under a name that means the absence of all of that. MIT, 2,984 stars, 377 forks, by one author, with a npx vibeworkflow CLI that interviews the user and scaffolds the output.

The spoke has been tracking the structure-before-code trend through the tools that name themselves after it: spec-driven-development, context-driven-development, spec-kit, conductor, corbell. CDD's own launch post defines the trend against vibe coding — "jump straight to code, intent improvised in chat and lost when the session ends." Here is a project whose title is that phrase and whose content is CDD's programme, arrived at independently and stated in the same words: durable facts in files rather than one long chat, repo-owned memory over tool-side memory, plan before edit.

So the discipline is spreading faster than its vocabulary. The practitioner-facing tools argue about the method under precise names; this one carries the method to an audience that "does not need to be an experienced developer" under the name the method was coined to reject. Two readings, and the corpus does not settle between them: either the term has widened to mean "built with heavy AI help" with the discipline left unspecified, or a workflow is deliberately using the popular label as a doorway. Both predict the same thing next — that "vibe coding" stops carrying information about how code was produced. vibe-coding collects the four incompatible senses this hub already holds, across four spokes, including a project warning that its code is "entirely vibe-coded" and a foundation that bans the practice from contributions. A word doing those four jobs cannot support a policy, which is a problem for the foundation, not for the template.

What the source adds on the method itself is a separation the spoke could not make before. Every other SDD instance bundles the ordering with machinery — slash commands, delta specs, code graphs. This one is four prompts pasted into a chat tool and keeps the whole ordering, the review gate and the durable artifacts. If SDD's benefit comes from the sequence rather than the tooling, this is the cheapest possible test of it. Nobody has run that test: the repository ships no evaluation, and its evidence is four sites built by the author and his associates.

One more thing it does that the surveyed tools do not: it puts permissions and a cost ceiling in the planning document. Step 3 defines the AI surface, data boundaries, approval gates and evals; step 4 emits an agent-permissions.example.json; step 5 demands evidence — files changed, commands run, tests, unresolved risks. agent-permission-model has been a harness-configuration subject here. This makes it a design-time decision, written down before there is code to permit.

The harness looks down at the serving layer (2026-09-01)

The spoke's standing line with ../llm-inference-wiki is that harnesses consume inference and neither spoke owns the other's subject. inferoa is the first source to argue that the line is the problem. Its premise: "every loop is also an inference workload. As turns accumulate, prompt prefixes drift, cache reuse collapses, stale evidence fills context, model routing gets harder, and serving choices start to matter." So it builds the harness on the vLLM stack and exposes serving to the loop — prompt epochs and deterministic tool schemas to keep a cacheable prefix alive across iterations, bounded history and tool output, routing by cost, privacy and capability, and a /tokenmaxxing command that shows token and cost pressure inside a running session.

This is the cost half of loop-engineering, which the spoke had only ever written about as a correctness discipline. Every earlier loop source asks how the loop knows it is done and how truthful its feedback is. This one asks what the loop costs on the twentieth turn, and answers with kv-cache mechanics rather than with a token budget. The credibility comes from provenance rather than data: the author, xunzhuo, works on vLLM's routing ("Intelligent Routing @vllm-project"), so the harness is written by someone on the other side of the boundary it crosses.

And there is no evidence. A project whose entire pitch is efficiency publishes not one number. Worse for its own claim, the work stopped: 132 commits between 2026-06-08 and 2026-06-18, 119 npm versions inside those ten days, three releases on consecutive days, then eleven weeks of silence — and 3 watchers against 512 stars. Held as a design position, and as the strongest statement yet of a seam that now has a name.

Second vocabulary collision of the day. tokenmining defined itself as the inverse of "tokenmaxxing", glossed there as spending tokens freely; Inferoa puts the same word in its tagline and means token discipline. That is the shape vibe-coding took a few hours earlier with four senses across four spokes. Two independent instances in one day is not a pattern yet, and it is worth naming what would make it one: this field coins its vocabulary in public, adoption outruns definition, and the terms that describe a discipline keep getting taken as product names by the discipline itself — at which point the word can no longer sort the practice it was coined to sort. A third case gets a page.

The harness effect gets isolated to one tool, by an interested party (2026-09-06)

omp came back through Telegram as its product site rather than its repository, and the site led to The Harness Problem — the finest-grained measurement of a harness effect this spoke holds, and the only one run by someone selling the result.

What is new is the resolution. harness-disclosure states the Binding Constraint Thesis over whole harnesses; harness-bench crosses 8 models × 6 harnesses; claw-swe-bench does the same on coding. All three vary the harness as a unit. This one holds everything fixed and swaps one tool: the edit format. Sixteen models, three formats, 3 runs × 180 tasks. Average +15 points over apply_patch, ahead in 14 of 16, with Grok Code Fast 1 going 6.7% → 68.3%. If a single tool inside a harness moves a model that far, the harness/model variance comparison is not just true at the top level — it decomposes, and the decomposition points at the narrowest interfaces.

The gradient contradicts the slogan, which is why it is worth keeping. The gain concentrates in weak models and vanishes at the frontier: GPT-5.2 Codex gains 4.6 points and spends 26% more output tokens, DeepSeek V3.2 loses on both axes. "The harness matters more than the model" is therefore not uniform across the model range — on this task shape the harness is a floor-raiser, and a model already fluent in a format has nothing to recover. That is compatible with harness-disclosure's thesis (which is stated for comparable frontier models on long-horizon tasks, neither of which describes these fixtures) but it constrains how far the slogan travels, and nothing else in the corpus tests the weak end of the model range at all.

The evidence is T3 and the corpus should say so plainly. This is the tool's author benchmarking his own format against his competitors', on fixtures he generated by mutating React files and scoring against the known inverse. The code and per-run reports are published, the failures that hurt his case are reported, and it is still the maker measuring the maker. What raises it above ordinary vendor marketing is that it names the independent work — Aider's format swing (26% → 59% on GPT-4 Turbo), JetBrains' Diff-XYZ (arXiv:2510.12487, no format dominates), EDIT-Bench (arXiv:2511.04486) — and that literature supports the weak claim (format choice is a large effect) while leaving the strong one (hashline is the best format) resting entirely on his run. Both arXiv papers are now growth edges; they are the cheapest available independent check on a mechanism the spoke has started to lean on.

A second reading, on what a harness is becoming. omp's own surface has outgrown the "IDE wired in" framing this spoke gave it in June: curated cross-session memory with swappable backends, a second advisor model reading every turn of the first, a relay that puts a live session behind a shared link, sixteen internal URL schemes so a PR and a merge conflict are just paths, desktop control through the OS accessibility tree, and a native Windows build with no WSL. Against Pi, the 2026-08-30 finding still holds — the upstream ships its refusals as extensions, the fork built them all in — but the fork now carries features Pi never refused because nobody had proposed them. The two are no longer the same question answered twice, and the minimal↔batteries-included axis this spoke has been drawing since claw-code has stopped being one axis.

Skills reach the introductory course (2026-09-10)

claude-101-course is Anthropic Academy's free introduction to Claude for office work — fourteen lessons, a certificate, and no code anywhere in it. Unit two is projects, artifacts, skills.

That placement is the finding. This spoke has followed skills from a developer format through a published spec, catalogues, benchmarks and failure analyses — an engineering object throughout, argued about by people who write them. Here the same word sits between "creating with artifacts" and "connecting your tools," taught to someone who will never open a SKILL.md. A concept has crossed from tooling into product literacy, and the vendor's own beginner course is where that becomes visible.

Read against the vocabulary drift this spoke recorded on 2026-09-01 ("the word for the thing loses the thing"), the direction is worth watching rather than celebrating: the more the word travels, the less of the mechanism travels with it. The course teaches using skills, and nothing in the syllabus suggests a learner ever sees the file that makes one.

The syllabus order restates the adoption ladder from the vendor's side. Chat, then containers for work, then reach outside the chat, then role use cases — the same sequence agentic-adoption-ladder arrives at from the practitioner's side (context, off-the-shelf, custom, people). Two independent statements of the same ordering, one selling and one advising, is a firmer result than either alone.

And it is a reminder about which product this is. The deployment surface taught is the desktop app; the "agent" a Claude 101 graduate meets is a Research run with connectors attached. The agentic-coding corner that dominates this spoke is the minority product being documented at far greater depth than the majority one.

Held loosely: the lessons are behind registration, so only the curriculum was read. Nothing here says how any concept is explained, and a vendor's teaching material is marketing by construction.

The product harness does nothing at the top of the range (2026-09-14)

metr-scaffold-comparison is the first source here to run the model × harness factorial and it found the harness effect the spoke has been sizing at 23.8–48 pp to be about zero for the two strongest models: Claude Code against a bare ReAct loop is a coin flip on Opus 4.5, and Codex loses to METR's generic Triframe on GPT-5 in most resamples. METR's explanation is that the product harnesses are tuned for a human in the loop, so unattended they spend their elaborate prompting on to-do lists and on talking to nobody. Read with harness-disclosure, which argues harness variance exceeds model variance from weaker models' numbers, the two are not in contradiction but in tension: the harness effect may be largest exactly where the model is weakest, and shrink to nothing where the model no longer needs the compensation — which is long-horizon-agency's co-evolution claim stated as a measurement rather than a thesis. One time point, four cells, bootstrap uncertainty; edge 12 is half closed and its K≥5 half stands.

The loop moves to the policy over the agent (2026-09-16)

dream-rsi (Maryland / google-deepmind / Virginia, arXiv 14 Sep 2026) puts the self-improvement loop at a site this spoke had not seen: not the skills, not the harness, not the training environment, but the exploration policy that chooses which node of a discovery tree a coding agent expands next. The agent is left unchanged. The trick is that finished discovery trees are replayed as a simulator, so a candidate policy is scored off-policy for the price of a lookup rather than a rollout. Set against the spoke's other three loop sites, the pattern that holds is the one environment-evolution and SkillFlow already pointed at: the gains come from something outside the agent being curated — here the search strategy — and the headline claim is fewer generations to the same answer, not a better answer. Authors' numbers, no replication, and replay can only price paths some earlier policy already walked.

Three video skills, three licences (2026-09-17)

hypit makes the video-skill row three deep, and the row now reads as a gradient in what the agent starts from: a transcript (video-use), an empty editor (open-edit), or a finished video to clone (hypit). The technical idea in the third is word-anchored composition — captions, B-roll and effects tied to words rather than timecodes — which turns "make 100 variants" and "localise it" into reflows. The business idea is in the first sentence of the README, and it is cloning viral videos. Licences track the business: MIT, Apache-plus-shielded-binaries, and a modified Apache that forbids running the thing as a service. "Open source" on the tin, source-available in the text, and the reason is the same one open-edit's page gave for VEED — the company that publishes the skill sells the hosted version of it. The per-clip costs ($1.07–$1.15) are the vendor's examples, and the thing they price is API spend the skill routes, not the skill.

The eval platform arrives without the eval (2026-09-17)

stax is Google Labs open-sourcing the plumbing of its LLM-evaluation product: dataset store, rater workflow (code, autorater, human), version comparison, dashboard, all as a Terraform-deployed GCP stack. The docs' one-liner — ten good prompts beat vibe testing — is agent-evals' argument from a vendor. What is not in the repo or the docs is the measurement that would make an autorater trustworthy: agreement with the human raters the same platform collects. That is the number this spoke has been circling since harness-disclosure and metr-scaffold-comparison, and a platform that holds both kinds of rating is exactly where it could be produced. Ninety-eight stars and seventeen commits say this is a code drop; whether it becomes a community decides whether anyone produces it.

The environment is a real repository this time (2026-09-17)

scienceide takes environment-evolution's bet — spend the loop on the environment — and changes where difficulty comes from. Instead of synthesising tasks that a stronger model outgrows, it wraps 27 real scientific codebases in 64 environments and 2,812 tasks whose correctness is the code's own numerical outputs and physical invariants, checked by execution. The generation rule is the useful export: propose tasks by mechanical mutation, keep only those where the known-good solution passes and the broken baseline fails. The measured results split cleanly. The benchmark half is a leaderboard — Fable 5.1 67.1%, Opus 5 64.6%, Astra 63.1% on 85 hard tasks, one run each, no spread. The training half is where the paper is most careful: SFT lifts small Qwen models on held-out repair, and the RL gain (2.4× reward in 30 steps) is stated by the authors to be inside the training environment with hints and not a transfer result. Read with dream-rsi from the day before: two papers in two days, both moving the self-improvement loop off the agent, both honest that the number they report is the easy one.

The engine the model cannot overrule, and where the errors went (2026-09-20)

omega-framework is the first neuro-symbolic-agent here: a MeTTa loop on OpenCog Hyperon that suspends the LLM whenever it emits a (metta (|- ...)) command, runs NAL or PLN over an AtomSpace, and hands back atoms with (stv frequency confidence) the model can read but not recompute. The pitch is auditability — "confidence cannot be inflated by rhetoric" — and on its own terms it holds: the truth-value arithmetic is deterministic and traceable. What makes the source worth the page is that the project measured itself and published where the errors moved. On the maintainers' own agent, over 4,500 instrumented cycles, LLM-written premises were right about 55% of the time, asymmetric relations were inverted up to 16.6% of the time, and self-assigned confidence ran ~15 points high — errors the engine "cannot detect" because they are well-formed. Deduction then multiplies confidences with no floor, so a chain from c = 0.9 is under the ACT threshold by hop three, and a fabricated premise comes out stamped (stv 0.81 0.73); the doc calls this "GIGO amplification." And the single most frequent failure in the whole system is the model failing to produce a parseable s-expression at all.

Read against the rest of this spoke, three things follow. The formal layer buys exactly one property — a derived number the model cannot argue up — and pays with a new failure surface at the neural↔symbolic boundary, plus the same garbage-in problem every harness has. The action thresholds (ACT at f ≥ 0.6 ∧ c ≥ 0.5) are a permission dial keyed on the truth value of a conclusion rather than on the kind of action, which is what every agent-permission-model here gates on; whether the two are complementary is an open question on that page. And the self-improvement loop, which the disclaimer says may "modify its own skills, memory, and operational logic at runtime," produced three documented self-patches that did not work — the only negative instance self-improving-agents has, and the one with no gate at all. Every number is Omega-on-Omega, from a whitepaper the doc says the agent self-authored; there is no external comparison. Two smaller checks: "~200 lines of MeTTa" is the loop file (119 lines), the core is ~594; and the Docker image is named omegaclaw, the third framework here to borrow the suffix after openclaw and hermes-agent's claw migrate.

The agent gets its own desktop (2026-09-23)

agent-workspace-linux answers a question this spoke has asked from the browser side: when an agent uses a computer, whose computer is it? claude-browser-use leaves the browser to the developer's executor, and computer-use tools in general drive the screen the person is sitting at. This one gives the agent a hidden Xvfb desktop and a Chrome instance of its own, with a small viewer where a human can watch, pause or stop it. The same org (agent-sh, publisher of agentsys) ships the inverse tool, computer-use-linux, which drives the real desktop. So the choice between "act on my machine" and "act on a machine beside mine" is now two products from one maintainer.

The design adds a fourth position to agent-permission-model: approve the workspace once, then let a ceiling set by the developer (network, mounts, app allowlist) hold at two layers, including the daemon socket that apps inside the workspace can reach. KOT's "isolation is a property of the environment" becomes a shipped environment rather than an instruction to the operator. Two details from the source: it hides its ~86 tools behind one skill that loads schemas by phase, and without bubblewrap the isolation rules are only declared. Nothing is measured, the security policy still names 0.1.x as the supported line at v0.3.3, and the README carries an undisclosed ad for its author's inference company (avi-fenesh).

The permission model becomes a floor plan (2026-09-27)

starnet answers agent-permission-model's question — what may an agent do without asking? — with geometry instead of a prompt or a policy file: a room is a capability-scoped team, a hallway is an authorized handoff lane, a placed object is a real capability grant. Moving an agent's sprite into a room is the grant. That is a third position next to the two the spoke already holds: per-action approval (which degrades with use, agent-permission-model's 13.6%/89% split) and the sandboxed workspace agent-workspace-linux ships (approve the environment once, hold a ceiling underneath). StarNet's version is spatial and always-visible rather than a one-time approval or a background enforcement layer — the scope is wherever the agent's icon currently sits, which is legible to a human glancing at the station in a way a permission log is not, at the cost of nothing here confirming what actually stops an agent from acting outside its room.

It also names its own version of KOT's "isolation is a property of the environment" directly: "the interface must never assert state the harness cannot prove" — no simulated revenue, activity, or spend. Read next to openhuman (the spoke's other local-first Tauri multi-agent desktop, differentiated by a persistent memory tree rather than spatial scoping) and oh-my-pi/pi-coding-agent (which fight the same permission question through tool grants and refusal lists rather than a UI metaphor), the desktop-agent thread is now three different answers to "how does a human see and bound what an agent can do" — a chat log, a floor plan, and a tool list — none of them measured against the others.

Review keeps the model, and moves the queue local (2026-09-27)

jev-code-reviewer is a third position in the code-review thread stop-burning-tokens-on-code-review opened and deterministic-review-gate answered by removing the model from the hot path. Jev keeps a model on every PR — two, in fact, one to classify and one to explain — but attacks the same complaint from a different angle: the reviewer's second queue wasn't only the model's noise, it was the model's comments landing on GitHub next to the human's. Jev posts nothing to GitHub. The report lives on a local server an extension reads, P0/P1/P2 triage means only a fraction of it demands a first look, and diffs render as old-versus-new logic rather than as lines. Nothing here is measured against either prior answer — no source yet compares reviewer time across "remove the model," "keep it but triage locally," and the GitHub-Actions setup that cost $1,000 in a day — but the thread now has three shapes of the same fix: compile away the deterministic half, triage the probabilistic half, or don't let either half leave the reviewer's own machine.

The tool's own name turns out to be a citation. Its classification step runs on TypeSafe's Jev model, which ../llm-providers-wiki already documents as a vendor's self-graded launch (typesafe-ai, system-one-models-and-jev, T3, 67.8% aggregate accuracy against the vendor's own reference labels). This spoke's page is about the harness wrapped around that model, not the model's accuracy, so the two stay separate rather than duplicating each other's claims — but it is the first case here of a named model product showing up as an ingredient in someone else's tool, rather than as the subject of its own source.

Two Slack agents converge on the same shape, and the permission dial gets a fifth position (2026-09-28)

company-brain, supermemory's open-sourced Slack teammate, lands three findings against threads this synthesis already tracks, and none of them needed the same source to arrive twice.

First, agent-scope-isolation stops being one implementation's design and starts being a shape. qm and Company Brain are different teams, different stacks, five weeks apart, and both partition memory the same way — public-channel / private-channel / DM — and both make write authority follow the person asking rather than the agent holding the conversation. Two independent arrivals at the same partition is weak but real evidence this is what the problem requires, not what one product chose. The honesty gap between them is still worth keeping separate from that convergence: qm wrote a 9.9 KB SECURITY.md listing what its containment doesn't cover; Company Brain's README states the same scoping as a finished feature.

Second, agent-permission-model gets a position that isn't a point on the existing scale. Every prior entry — per-action approval, batching, no gate, one ceiling underneath — varies how often the agent is asked. Company Brain varies whose authority the action uses: a write runs under the asking user's own tool connections, and a request needing someone else's connection goes to that person as a card, not back to the agent's operator as a broader grant. That sidesteps the confirmation-fatigue number (13.6%) rather than beating it, since most of what would need a prompt elsewhere here needs no prompt at all — it also has no SECURITY.md-grade admission of what the scheme doesn't cover, which is exactly the gap qm was candid about on the isolation side.

Third, agent-memory's hosted/self-hosted axis turns out not to be one dial. Every source on that page so far tied "who runs the agent" to "who runs its memory" — cloudflare-agent-memory is hosted end to end, everything else is self-run end to end. Company Brain deploys the agent to the operator's own Cloudflare account while keeping memory on supermemory's hosted service, which means an operator can self-host every visible part of the stack and still not own the one layer this spoke has been treating as the point of self-hosting.

All three claims rest on one maker's README — 717 stars, no independent usage report, no security audit — so the honest reading is "here is a second shape, not yet a rule."

A browser control plane adds a sixth axis to the permission dial, and a fifth drift control (2026-09-28)

auto-browser is a single-maintainer MCP tool that hands an agent a real Playwright/Chromium session with a human able to take over live through noVNC. Two things about it land on existing threads rather than opening a new one.

agent-permission-model's five positions all vary how much oversight the agent gets before it acts. Auto-browser answers a different question: how would anyone know a gate that looked like it held actually held? Every governed call chains into an Ed25519-signed "witness receipt," checkable by a script that trusts nothing from the project that produced it, and the project's own public audit names safety controls that "reported success while doing nothing" and were fixed only once someone went looking. That is a record layered on top of an authorization design, not a rival to one, and it is the first source here to treat "did the gate actually fire" as a thing worth being able to prove after the fact rather than something the design is simply trusted to do.

self-improving-agents gets a fifth instance. Its experimental Convergence harness turns a verified task trace into a staged skill candidate with signed provenance; unsigned or mock-run candidates are rejected outright, and promoting a candidate out of staging stays a manual step. That puts its drift control next to zouroboros's consensus vote rather than Hermes's off-by-default review queue, which this page already flags as the design most exposed to unreviewed drift.

Both findings rest on one maintainer's README and a self-reported audit; no independent party has checked the receipt chain against a controller trying to lie, or the induced skills for quality.

Contradictions / tensions

Cross-spoke adjacency

The seat becomes a pool (2026-10-04)

subpool adds a layer this spoke had no page for: a quota gateway between an organization's employees and the vendors' coding-agent subscriptions. It does not constrain what an agent does, which is where agent-permission-model and agent-guardrails work. It constrains who may spend which account's capacity, with per-key limits, expiry and revocation, and it keeps a visible assignment table. That is a agent-scope-isolation-style partition (many principals, one deployment), applied to billing capacity instead of memory or files. Unlike qm and company-brain, it states plainly that it never stores prompts or responses, so there is nothing to scope on the disclosure side; the open exposure is the encrypted upstream credentials it holds for every pooled account.

The design choice worth keeping is subscription first, paid API as overflow, same key. It treats a flat-rate seat as the cheap tier and metered tokens as the fallback, a cost lever that claude-code-model-router and claude-batch-toolkit reach differently (pick a cheaper model; sell latency). Whether the arrangement is allowed is not settled by the source, which tells operators to check each provider's terms; no provider page in this corpus answers it either. The adjacent omniroute and ai-gateway pages sit in ../llm-providers-wiki.

Evidence is thin: a month-old repo, 112 stars, no benchmarks or deployment reports. Recorded as a design data point, not a finding. Gap-relevance: it does not advance an open question; it opens a possible one (how much quota-governance a coding-agent fleet needs before per-seat licences stop fitting), which needs an independent source.

A 270M model gets a tool protocol, and the chaining is left to the harness (2026-10-04)

functiongemma-formatting-and-best-practices is Google's documentation for a function-calling model small enough to run on a device. What it shows is how little the model is asked to do. The protocol is six control tokens plus one <escape> token for strings, and the supported workflows are one call per query or several independent calls in one response. Chaining one tool's output into the next, and gathering parameters across turns, are listed as not trained. The page says the second needs state outside the model.

That moves the multi-step loop into the application, which is the same place agentic-coding-harness puts it for large models, only here the doc says so outright. The page also treats tool-selection failure as a description problem first: add the words users really say to the tool's description, and fine-tune only when phrasing stays indirect. That is a cheap lever next to the tool-count question in how-many-tools-should-an-agent-see.

Evidence is documentation only. No accuracy figures, no tests of the chaining claim, and Google "expects some generalization" after fine-tuning without showing it. Gap-relevance: it advances no open question here; it adds a small-model data point for tool-calling interfaces. The model-family facet is recorded in ../llm-providers-wiki (gemma-variants), not here.

Index — Agentic Tooling Wiki

Catalog of every page, grouped by schema.org @type. Spine: synthesis (thesis), log.md (history), this file (catalog). Some wiki-links resolve to bridge nodes in the sibling ../research-wiki (intentional cross-wiki links).

DefinedTerm (concepts / mechanisms)

SoftwareSourceCode (sources)

Collection (sources)

TechArticle (sources)

BlogPosting / Article (sources)

ScholarlyArticle (sources)

ScholarlyArticle (added)

Dataset (benchmarks)

Book (sources)

Course (sources)

SoftwareApplication

WebAPI

Organization

Person

Event

Synthesis


Bridge nodes (live in sibling wikis, linked cross-wiki)

gbrain · agent-skills · compound-engineering · model-context-protocol · anthropic · claude-opus-4-8 · claude-fable-5 · garry-tan (../research-wiki) · google (../llm-providers-wiki — canonical Google node; agent-platform-vendor facet noted there) · simon-willison (../llm-providers-wiki — canonical node; the coding-agent-security facet is used here) · xai-grok (../llm-providers-wiki — canonical xAI/Grok node; the coding-harness grok-build is its agent-tooling face)