Cloudflare
– Sundry Photography/Getty Images

Cloudflare and GoDaddy are working to integrate AI crawler controls and support emerging standards for identifying AI agents on the web.

The agreement centers on bringing Cloudflare’s AI Crawl Control into GoDaddy’s hosting platform, giving website owners visibility into and control over how AI-powered crawlers access their content. The feature allows users to allow, block, or set conditions ​​– including potential payment requirements – for AI data collection.

In parallel, the companies said they will support open standards aimed at verifying AI agents. That includes GoDaddy’s Agent Name Service (ANS), which uses DNS and public key infrastructure to assign verifiable identities to AI agents, and Cloudflare’s Web Bot Auth framework, which uses cryptographic methods to validate bot traffic.

The goal is to provide a consistent way to distinguish legitimate AI agents from malicious or unidentified bots interacting with websites and applications.

GoDaddy will integrate Cloudflare’s tooling directly into its hosting environment, targeting small businesses and creators that may lack resources to manage AI traffic independently.

The companies said the joint approach is designed to address three areas: enforcing permission-based access for AI crawlers, enabling verified identity for AI-driven transactions, and supporting new models for content usage as AI-generated answers reduce traditional web traffic flows.

Cloudflare said it will continue supporting an ecosystem of identity standards for AI agents, including its Signature Agent Card, which allows developers to disclose agent identity and purpose.

“By putting tools like AI Crawl Control and open standards into the hands of website owners, we are providing essential underpinnings for a new Internet business model,” Cloudflare Chief Strategy Officer Stephanie Cohen explained.

GoDaddy said the integration and standards support are intended to give customers more transparency into how AI systems interact with their sites.