Premium Content

Praesent auctor dignissim risus ac semper. Nullam congue lacus sed justo lobortis vestibulum. Sed eu eros eros. Vivamus nec convallis nibh. Phasellus quis suscipit diam, feugiat fringilla ante. Vivamus sem ante, rhoncus nec lectus sit amet, condimentum rhoncus quam. Donec luctus felis quis lobortis porta.

Stay tuned

Subscribe to our latest newsletter and never miss the latest news!
Our newsletter is sent once a week, every Monday.

Google Cloud Ships llm-d 1.0 With Cache-Aware Routing for TPU and GPU Fleets

Agentic AI
Google, Red Hat and IBM released llm-d 1.0, an open-source Kubernetes-native stack for distributed LLM inference. It adds multi-tenant flow control, zero-downtime upgrades and agent-aware routing across vLLM, SGLang, TPUs and GPUs.

Google Open-Sources TorchTPU, a Native PyTorch Backend for Cloud TPUs

Agentic AI
Google and Meta open-sourced TorchTPU, a native PyTorch backend for Cloud TPUs. It runs eager by default, compiles through torch.compile and XLA, and replaces PyTorch/XLA for new workloads.

DeepSeek Open-Sources DeepInfer, the Inference Framework Behind DeepSeek-V4.1-Flash

Agentic AI
DeepSeek has open-sourced DeepInfer, the Apache 2.0 inference framework that serves DeepSeek-V4.1-Flash in production. It targets NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs, and ships offline inference only.

Exa 3.0 Search API Tops Perplexity, Brave and Parallel on 8 Benchmarks

Agentic AI
Exa 3.0 is a search API upgrade from Exa. It adds a larger embedding model, Exa Lite at $4 per 1,000 requests, and Dynamic Highlights, and leads 8 benchmarks Exa ran itself.

Cloudflare Releases Clairic, a System One Extraction Model on Workers AI

Agentic AI
Cloudflare has previewed Clairic, a System One extraction model on Workers AI that returns typed values with confidence scores in one forward pass. It costs $0.10 per million input tokens and charges nothing for output.

Inception Releases Mercury 3 Diffusion LLM at 1,068 Tokens per Second

Agentic AI
Inception released Mercury 3, a diffusion LLM it says runs at 1,068 tokens per second with a 1M-token context. On Inception’s own table it leads GPT-6 Luna and Claude Haiku 5.5 on 8 of 12 benchmarks.

Meet Drex Max: Nace AI’s Multimodal Decision Model for Computer-Use Agents with a Score 67.59

Agentic AI
Nace AI released Drex Max, a multimodal decision model that reads text and screenshots and returns calibrated probabilities. Nace reports 67.59 on Decision Index 0.3.2 at $0.06 per 1M input tokens.

MiniMax Just Launched M3.1 Flash: 428B MoE Agentic Model at $0.15/M Input

Agentic AI
MiniMax has released M3.1 Flash, a 428B-parameter MoE model with about 23B active parameters and a 1M-token context. API pricing is $0.15/$0.60 per 1M tokens, with weights due October 23

NVIDIA Open Sources Run:ai Under Apache 2.0 for Kubernetes GPU Orchestration

Agentic AI
NVIDIA has released the full Run:ai GPU orchestration platform as open source under Apache 2.0. The release includes KAI Scheduler, CUDA 13.4 GPU fractioning, quota management, and a local Kind dev environment.

Mistral AI Releases Timestral: A 209M Forecasting Model Family That Outperforms Google’s TimesFM-3

Agentic AI
Mistral released Timestral, a time series foundation model family from 5M to 209M parameters. The 209M model leads GIFT-Eval, TIME and fev-bench among zero-shot models and runs on CPU.

TinyFish Makes Search Free: What It Really Costs an AI Agent to Read the Web

Agentic AI
An AI agent that reads the web pays 2 kinds of cost. The first is the retrieval charge: what a search or fetch API...

Google Open-Sources Harness2, a Recursive Agent Harnessing Framework

Agentic AI
Google Research released Harness2, an Apache-2.0 framework that rewrites an agent's harness at test time. One refinement step lifted GLM-5 by 11.5 points on WorkBuddy-Bench with no weight updates.
123...975Page 2 of 975

Recent articles

spot_img