In a debate likely to get louder as AI agent usage grows, some people say Perplexity crawling blocked websites isn't a simple matter.

Cloudflare claims the AI startup is bypassing robots.txt restrictions to scrape content, potentially exposing Perplexity to lawsuits from publishers like Dow Jones and the BBC.

Cloudflare has accused the AI company of bypassing websites' no crawl directives. Here's how the CDN is responding.