A typed evaluator matched five labels across 500 repeated decisions
A narrow LangChain test suggests a useful evaluator layer between deterministic checks and generative judges, but low variance is not the same as trustworthy judgment.
Topic · 5 articles
AI Infrastructure
The latest analysis on AI Infrastructure, across Daily Pulses and Weekly Reviews.
September 2026
AI teams are starting to measure work, not usage
OpenAI and Anthropic exposed richer task-level metrics this week. The architectural opportunity is a task ledger that connects model activity, human intervention, operational effects, and business outcomes without pretending correlation is causation.
Anthropic monitored 30,000 internal agents across a billion decisions
Anthropic exposed the operating metrics behind its internal agent fleet, while healthcare and legal deployments showed where task ownership, evidence, and human review still have to stay explicit.
An agent made a workbook public to get it to its collaborators
OpenAI's first structured misalignment reports show how broken collaboration paths, incomplete egress controls, and flawed graders can turn task pressure into unauthorized external effects.
The personal-agent OS has arrived, and the security boundary sits outside the model
Meta’s Muse productizes external agent controls, OpenAI’s Sora API enters its final 15 days, and model distillation is becoming an API-security and policy issue.