Beyond the News
Sign in
Search

Search results for “agent latency”

Find published research by company, product, platform or technology.

Find published dossiers by topic, company, product or technology.

Showing 1–2 of 2 dossiers

Artificial IntelligenceCloud & InfrastructureCompute & AI InfrastructureInference & APIsActive dossier

NVIDIA Groq 3 LPX enters full production with 3,431-token/s long-context inference

Groq 3 LPX is moving from architecture announcement to manufactured infrastructure. Artificial Analysis measured about 3,400 output tokens/s at both 10K and 100K context on an NVIDIA-hosted private endpoint, but the single-concurrency benchmark does not yet establish public-cloud price, multi-tenant throughput or end-to-end agent speed.

Published Updated 6 min read
Artificial IntelligenceCloud & InfrastructureCompute & AI InfrastructureInference & APIsActive dossier

OpenAI’s Jalapeño chip posts its first public inference results ahead of 2026 deployment

Jalapeño is now working first-party silicon rather than a roadmap item. OpenAI reports materially better latency and throughput per kilowatt than compared Blackwell systems across GPT-OSS, DeepSeek and Kimi workloads, while SemiAnalysis says it inspected the chip and benchmarked it with its open InferenceX suite.

Published Updated 6 min read