Skip to main content

Cloudflare Adds Three Controls for Production AI: Fail Fast, Lock BYOK Billing and Fence Browser Agents

5 min read

Cloudflare added rejectIfBusy, byok_only and Browser Run guardrails. Here is how the three controls bound latency, billing authority and browser reach.

Cloudflare Adds Three Controls for Production AI: Fail Fast, Lock BYOK Billing and Fence Browser Agents

Three small Cloudflare settings answer three expensive production questions: how long should inference wait, who is allowed to pay for it, and where may a browser agent go?

Cloudflare production AI controls added in September 2026 give operators sharper boundaries around overloaded inference, third-party model credentials and browser-agent network access. Workers AI now supports rejectIfBusy, AI Gateway can enforce byok_only, and Browser Run can restrict sessions to an allowed hostname set while issuing read-only Live View links.

The three controls solve different failure classes

ControlBoundaryFailure when enabled
rejectIfBusyLatency and capacityA synchronous Workers AI request fails instead of waiting in a capacity queue.
byok_onlyCredential and billing authorityA third-party request without applicable credentials returns HTTP 400 instead of falling back to Unified Billing.
Browser Run guardrailsNetwork reachThe session may request only permitted HTTP and HTTPS hostnames.
Read-only Live ViewObserver authorityThe viewer can watch but cannot click, type, navigate or execute JavaScript through that link.

Use rejectIfBusy as a circuit-breaker input

Cloudflare says rejectIfBusy is for synchronous inference that should not wait when capacity is unavailable. It can be passed as the third argument to the Workers AI binding or placed under options in a native REST request. The useful design decision happens after the rejection.

  • Interactive request: return a fast, honest message and invite the user to retry.
  • Non-urgent work: move the job to an application-owned queue with an explicit deadline.
  • Model-flexible task: try a tested fallback model only within a bounded retry budget.
  • Critical workflow: stop and require human action instead of silently changing behavior.

Fail-fast does not create capacity and it does not define the retry policy. A client that retries immediately and indefinitely can amplify an overload. Record rejection rate, end-to-end latency, fallback use and final user outcome. Set a total time budget that includes every attempt, not a fresh timeout for each retry.

byok_only is a billing-authority boundary

AI Gateway can now require credentials for third-party provider requests. With byok_only enabled, credentials must accompany the request or be stored on the gateway. A request without applicable credentials receives HTTP 400 rather than falling back to Cloudflare-managed credentials and Unified Billing.

This is more than a preference for where a key lives. It answers who is authorized to incur a provider charge. Cloudflare also offers a request-level cf-aig-no-wholesale header. That header can make one request stricter, but it cannot relax a gateway-wide requirement. Workers AI requests remain allowed and keep their configured billing mode.

  1. Enable the gateway-level rule in a non-production environment.
  2. Send a third-party request with a valid stored credential and confirm success.
  3. Remove that credential and confirm HTTP 400 rather than managed fallback.
  4. Repeat with a request-supplied key and verify which account receives the charge.
  5. Check Workers AI separately because the setting does not block it.
  6. Alert on unexpected HTTP 400 spikes so a revoked key is not mistaken for model downtime.

Browser allowlists must include the real page graph

Browser Run guardrails accept allowed domains when a session starts through Puppeteer, Playwright or the REST API. A domain list should be built from the workflow’s actual network graph, not only the landing page. Redirects, authentication hosts, content delivery domains, fonts, images and first-party subdomains can all affect whether the session succeeds.

A browser-agent egress test
TestExpected evidence
Direct allowed URLPage loads and requests stay inside the approved set.
Redirect to an unlisted hostNavigation or resource request is blocked and logged.
Approved subdomainWildcard behavior matches the intended hostname scope.
Third-party script or fontThe dependency is explicitly allowed or deliberately blocked.
HTML-to-PDF with an external imageExternal content cannot load unless its hostname is permitted.
Read-only observerThe viewer can see the run but cannot interact through the Live View link.

A production pattern that composes the controls

  1. Start with an application deadline and a small retry budget.
  2. Enable rejectIfBusy for user-facing synchronous calls that cannot tolerate queue delay.
  3. Make the fallback path explicit: retry later, use a tested model, or stop.
  4. Enable byok_only wherever managed credential fallback would violate cost ownership.
  5. Launch browser sessions with the narrowest hostname list that passes the dependency test.
  6. Give reviewers a read-only link unless they need interactive control.
  7. Log the selected model, credential source class, hostname decision and final outcome without logging secrets.

These settings do not establish model accuracy, safe page content or successful task completion. They reduce ambiguity at three control points. A separate evaluation must still test the model output, browser action sequence and business result.

Our guide to Cloudflare Content Signals covers publisher-declared use boundaries. This release addresses the other side of the system: the operator’s responsibility to bound capacity, payment and agent reach.

The practical verdict

The value of these Cloudflare updates is not a new model. It is a clearer production contract. rejectIfBusy can protect a latency budget, byok_only can protect billing authority, and Browser Run guardrails can protect the network boundary. Each control is useful only when the application defines the failure path, tests the negative case and gives an owner the evidence needed to respond.

Primary source

Checked September 18, 2026. Documented behavior comes from Cloudflare. Retry, egress-testing and governance recommendations are MustHave.ai analysis; Cloudflare did not publish an independent reliability benchmark for these controls.

Leave a comment

Your email address will not be published. Required fields are marked *