Routing
We track 16 posts about Routing from 13 engineering blogs. Most active: Vercel, Cloudflare, IPFS. Latest post: Oct 8, 2026.
Companies writing about Routing
Recent posts
Part 5: Operating an LLM system: observability, cost, routing, and the platform underneath (opens on the source site)
Your service can be 100% up and still quietly approving the wrong things, burning its budget, or failing over into untested quality. Level 5 is the infrastructure that lets you see your decisions, bound your spend, route and fail over between models, kill bad behavior in seconds — and the platform that makes all of it possible.
Skip sending request bodies to Routing Middleware (opens on the source site)
Vercel ·
You can now skip sending client request bodies to Routing Middleware with skipMiddlewareRequestBody. This reduces incoming Fast Origin Transfer usage for middleware invocations and can improve time to first byte, especially for requests with large bodies. Enable this option only if your Routing Middleware doesn’t read request bodies. Vercel Functions and rewrite targets still receive the body, so you can read and process it there. Set skipMiddlewareRequestBody to true in your project’s JSON configuration file, vercel.json: If you use a TypeScript configuration file, add the same setting to…
Microfrontends Routing is now free for Firewall-mitigated traffic (opens on the source site)
Vercel ·
Microfrontends Routing is now free for requests that the Web Application Firewall (WAF) denies, challenges, or rate limits. CDN Requests and Fast Data Transfer are already free for this traffic. The change applies automatically to every project using microfrontends. Learn how to set up WAF rules in the Firewall documentation. Read more
Gemini Interactions API in TypeScript: Task-Aware Thinking Routing (opens on the source site)
Build a task-aware thinking router on the Gemini Interactions API in TypeScript: classify coding tasks, set thinking levels, and track cost and latency. Continue reading Gemini Interactions API in TypeScript: Task-Aware Thinking Routing on SitePoint.
Replica-aware routing public beta (opens on the source site)
Temporary tables and named sessions live on a single ClickHouse replica, so a follow-up query routed elsewhere can't see them. Replica-aware routing pins your requests to the same replica over HTTP or the native protocol — and here's how we built it.
Vercel Sandbox routing is now 18x faster globally (opens on the source site)
Vercel ·
Requests to Vercel Sandbox public domains are now routed 18x faster. Domains created with the sandbox.domain() SDK call are now resolved from the nearest regional replica, instead of a single centralized store. Incoming requests reach the process running in the sandbox with less latency. Median domain lookup latency dropped from 62ms to 3.4ms (18x faster). The improvement is largest in regions farthest from the previous store: lookups are now up to 112x faster in Sydney (syd1) and up to 146x faster in Cape Town (cpt1), at p99. This applies automatically to every request to a sandbox domain.…
Intelligent Model Routing on Replit (opens on the source site)
Replit ·
You want to bring an idea to life, not compare models. But the best model for the task can change week to week, project to project, task to task. Choosing the right one adds another decision point between your idea and the thing you’re making. Starting today, Intelligent Model Routing is available to everyone on Replit. As each task evolves, we match it with the model best suited to complete it - balancing quality, speed, and cost behind the scenes.
Python projects now support routing rules (opens on the source site)
Vercel ·
Python projects can now use routing rules to set response headers or rewrite requests to internal paths, including apps built with FastAPI, Django, and Flask. The Vercel CDN evaluates rules before requests reach your application, so changes apply without a new deployment. For example, this FastAPI app serves a /new route: main.py from fastapi import FastAPI app = FastAPI() @app.get("/new") def new_route() -> dict[str, str]: return {"message": "New route!"} Defines the /new route the rewrite below targets To send requests for /old to that route, create a rewrite from the CDN tab in your…
BGP Role model: tracking the adoption of RFC 9234 (opens on the source site)
RFC 9234 lets routers reject route leaks on their own, using BGP Roles and the Only to Customer attribute. We measured who has deployed it, and found two Tier 1 networks unexpectedly stripping OTC.
Routing and Failover for Microsoft.Extensions.AI (opens on the source site)
.NET ·
Route requests across models and providers natively in Microsoft.Extensions.AI with RoutingChatClient, SemanticRoutingChatClient, and FailoverChatClient — new experimental primitives for content-based routing, failover, and custom routing policies. The post Routing and Failover for Microsoft.Extensions.AI appeared first on .NET Blog.
Sakana AI's Fugu: Is this where model routing should live? (opens on the source site)
Japanese AI company Sakana AI recently released Fugu, a multi-agent and dynamic model routing system delivered as a single model API. In simple terms, it provides a clean and straightforward way to leverage a range of different models, by directing queries towards the model it determines to be most appropriate and effective. It consists of a lightweight learned coordinator sitting behind an e OpenAI-compatible endpoint, which assembles a pool of frontier models, assigns them 'Thinker', 'Worker' and 'Verifier' roles, orchestrating them across turns. The research behind it (TRINITY and the…
A New Approach to Enterprise Routing: Join the MapTiler Beta (opens on the source site)
MapTiler ·
Manage complex fleet logistics with MapTiler's Enterprise Routing API. Get precise terrain data and predictable pricing. Join our global beta today.
From Chaos to Clarity: How We Built a Unified, Self-Routing Support Ops Ticketing System at Lyft (opens on the source site)
Lyft ·
Written by Atul Gupta, Analytics Manager — LUS Support Ops, LyftAt Lyft, getting operators and riders connected quickly and reliably depends on more than technology — it depends on the teams working behind the scenes to keep that technology running smoothly. For the operators managing Lyft’s fleet across markets, having fast, reliable access to support is what keeps bikes on the road, stations stocked, and issues resolved before they affect riders. Building the infrastructure that makes that support possible is what our team does; this is the story of how we built it.When I first joined Lyft…
Project Kijiji: building a GNN-based routing intelligence platform for fragile networks (opens on the source site)
Tinybird ·
How a GNN-based platform uses Tinybird to map African internet routing inefficiencies and predict where new IXP peering agreements would have the highest regional impact.
Faster Peer-to-Peer Retrieval in Browsers With Caching in the Delegated Routing HTTP Server (opens on the source site)
IPFS ·
How caching and active peer probing in the Someguy, the Delegated Routing server accelerates peer-to-peer content retrieval in browsers and mobile applications.
Policy-Based Routing On OPNsense via Wireguard - Bypass Regional Censorship (opens on the source site)
🤦 Intro - The rantings of a muffn # As usual, I’m doing substantial yapping before the guide, if you don’t like reading and/or know what you’re doing, jump to the guide Here we are again. Politicians making laws about technology they fundamentally don’t understand, wrapped up in the classic “think of the children” rhetoric that’s become the defacto justification for the surveillance state.
Related topics
This page is generated automatically from the engineering blogs we follow. Every post links to its source, where it was published. See all sources.