Ephemeris · Issue 052 Tuesday · 09 Jun 2026 · Zürich
Ephemeris · Issue 052 01 / 6 · Cognition · via @seeallochnaya
Dev tools · Benchmarks

Correct, but unmergeable.

FrontierCode, from Cognition, asks a harder question than SWE-Bench: would a maintainer actually merge this PR? Built with 20+ open-source maintainers grading on behavioral correctness, regression safety, scope discipline and test quality — not just whether the tests pass.

13.4% Claude Opus 4.8 — the best score on the hardest Diamond subset
Opus 4.8 · Diamond
13.4%
GPT-5.5 · Diamond
6.3%
Gemini 3.1 Pro · Diamond
4.7%
Ephemeris · Issue 052 02 / 6 · Sentry Engineering
Dev tools · Debugging

Hand it the issue,
get a repro._

Sentry's SDK team wired a Claude skill to the worst part of triage — building a minimal reproduction. Feed it a GitHub issue, it picks the right language, framework and SDK versions and opens a PR with steps. They stopped short of full automation so the bot wouldn't drown maintainers in noise.

sdk-team@sentry:~$ repro https://github.com/getsentry/sentry-javascript/issues/4821
→ parsing report… next@16.2 · @sentry/node 9.x · node 22
→ scaffolding minimal app + failing route
→ confirmed: span dropped on edge runtime
✓ opened PR #4822 — "repro: missing span, edge runtime"
human review: required
Ephemeris · Issue 052 03 / 6 · Vercel
Models · Economics

Volume went cheap.
Spend didn't.

Vercel's June AI Gateway index, drawn from production traffic across hundreds of models, shows the split every founder budgets around: low-cost models are landing real workloads, yet the money still concentrates. The model you call most often isn't the one taking most of your invoice.

AI Gateway · production traffic · June 2026
ProviderToken volumeSpend
Anthropic—65%
DeepSeek17%—
Everyone elsebalancebalance
Ephemeris · Issue 052 04 / 6 · Cloudflare
Security · Edge

Block the actor,
not just the request.

Cloudflare opened its Cloudforce One threat intelligence as new cf.intel fields you can write straight into WAF rules. Match on the threat actor behind a campaign — or the industry it's targeting — and block in real time, instead of waiting for the next managed-ruleset update.

CLOUDFORCE ONE · LIVE
actor: REDACTED-GROUP-7   targets: financial svcs

when cf.intel.threat_actor in $known_actors
or cf.intel.target_industry eq "finance"
then block
Ephemeris · Issue 052 05 / 6 · Import AI · Jack Clark
Research · Alignment

Reward hacking, scaled to society.

Import AI 460 leads with SocioHack — a benchmark of 72 simulated institutional environments that measures how well models exploit regulatory loopholes. The finding behind the title: reward hacking, given enough capability, becomes hacking the rules society runs on. The same issue carries Anthropic's own marker of recursive self-improvement.

Ephemeris · Issue 052 06 / 6 · PostHog · via Joe Martin
Applied AI · Analytics

Instrument what you vibe-coded.

A marketer built Joe-OS — a desk dashboard on a Pimoroni Presto, with panels for news, games and a roguelike — by letting AI write the code. He couldn't tell what anyone actually used until he had the MCP wire in analytics. The lesson for every AI-built side project: measurement is the step you skip, then need.

End of issue 052 Back to top ↑

That's today.

Six readings on AI tooling doing the unglamorous work — the merge, the repro, the bill, the blocked request, the loophole, the dashboard.

Sources today: Cognition, Sentry Engineering, Vercel, Cloudflare, Import AI (Jack Clark), PostHog — surfaced via @seeallochnaya and @denissexy.
Rubric: tools you could adopt this week, dev & agentic tooling, security with real signal, model economics, research with a practical kernel.
Issue 052 · 9 June 2026 · Europe/Zürich.