← Back to People
Wrote about LLMs as parts of systems and how systems built with LLMs and tools can do things that LLMs alone cannot do.
2
Mentions
2
Articles
1
Outlets
Aug 2025 — Jan 2026
Coverage
Associated Topics
Companies Covered
Coverage Patterns
How media typically covers Marc Brooker
Article Types
- opinion2
Media Angles
- technical2
Narrative Framing
- trend1
- cautionary1
Writes About
Articles
Most recent firstArticles Written
Marc Brooker as author
Pass@k Is Mostly Bunk
opinioncautiousJan 22, 2026
Pass@k is an exponentially forgiving metric that misrepresents agent performance and should be rarely used in AI evaluation, as human users require all steps to succeed rather than accepting occasional successes.
“Author of "Pass@k Is Mostly Bunk"”
AI AgentsAI ResearchAI Evaluation Metrics
Also Mentioned In
Referenced in coverage
LLMs as Parts of Systems
Brooker BlogopinionpositiveAug 13, 2025
LLMs are most powerful when integrated into broader systems with code interpreters, databases, browsers, and formal reasoning tools rather than used in isolation, enabling capabilities and cost efficiencies unattainable by LLMs alone.
“Wrote about LLMs as parts of systems and how systems built with LLMs and tools can do things that LLMs alone cannot do.”
AI AgentsFoundation ModelsAI InfrastructureLLMs