Find published dossiers by topic, company, product or technology.

Showing 1–20 of 243 dossiers

Google DeepMind is piloting double-blind frontier-model evaluations with confidential computing

The pilot attacks a persistent evaluation trade-off: labs do not want to reveal frontier-model internals, while evaluators do not want benchmark prompts leaking back to the model provider. DeepMind says a Singapore AI Safety Institute pilot kept both sides’ sensitive assets hidden during execution.

Android Bench 2.0 shows frontier coding agents still fail most multi-day Android tasks

Android Bench 2.0 moves coding-agent evaluation away from small repository fixes toward dependency upgrades, app builds, migrations and other jobs that can take a human engineer days. The results expose a much larger reliability gap than short-task benchmarks—and show that the agent harness can materially change cost and outcome.

AWS Security Agent can now hard-cap autonomous pentest spend and revalidate individual fixes

AWS’s agentic pentesting service can run multiple security tasks in parallel, so billable task-hours may exceed wall-clock test duration. New per-run task-hour limits stop a test gracefully at the ceiling and preserve findings, while targeted revalidation checks specific fixes without rerunning the entire pentest.