Published on August 6, 2025 at 18:11
Commenter
0

Two fundamentally opposing views of the web are clashing between Cloudflare and Perplexity. On one side, the traditional functioning of the web as it has existed for decades, where bots must adhere to the publisher's choices. On the other side, an AI that claims to act on behalf of the user and does not want to be subject to the same constraints.

Back to the sender. This week, Cloudflare accused Perplexity of 'stealth crawling': the bots of the 'AI answer engine' that go to search for information on the internet bypass the blocks and restrictions set by the publishers. Since the beginning, websites can grant permissions to crawlers (for example, Google's indexing robot) by listing them in the robots.txt file, either allowing them to retrieve content or prohibiting data collection.

Read Cloudflare denounces Perplexity's practices, accused of bypassing website protections.

In its response, Perplexity disputes the accusations, but claims the right to access public content to answer its users' requests. Unlike traditional crawlers that systematically explore the web to build databases, Perplexity claims its AI acts only upon user demand: it retrieves necessary information in real-time to answer a specific question, without storing or using these data for training its models.

The argument may be valid, but one can counter Perplexity by pointing out that there is no formal or legal distinction between a search engine's robot and an AI assistant — indeed, OpenAI respects the directives in the robots.txt file, claims Cloudflare. All robots, regardless of their origin, use automated queries to access websites. And the rules apply to all.

Another issue: the Perplexity agent acting "on behalf of the user" operates anonymously, as demonstrated by Cloudflare's investigation. It changes its user-agent and IP addresses: the transparency argument advanced by the startup is weakened. If the intentions of its robot are legitimate, why not reveal its true face?

Moreover, Perplexity commercially uses the information collected from the web. The content is certainly not stored and is not used for model training (knowing that the response engine relies on third-party AI models), but it is read, summarized, and presented in a proprietary interface with no direct link to the source. What about copyright and compensation for creators? Ignoring the rules that govern robot access, even in the name of the user, amounts to denying the explicit intention of the publisher.

Perplexity's response has a bit of trouble holding up. And the accusations of incompetence towards Cloudflare are not very well-mannered, especially since the engine does not address the technical criticisms on substance.

👉🏻 Follow real-time tech news: add 01net to your Google sources, and subscribe to our WhatsApp channel.

Source : Perplexity

Mickaël Bazoge
The latest news
Laptop Chuwi
Intel Core i5, 16 GB of RAM, SSD 512 GB, W11 Pro : this portable PC is winning over with its value for money 
Nvidia Logo Carte Graphique Gpu
After the Nvidia scandal, Washington is considering new restrictions against China
Spacex Starships Thirteenth Flight Test 1
Starship : SpaceX is preparing to attempt a historic feat with its massive rocket
Tcl La Fnac Bf 2026
For Black Friday, this massive high-end TCL TV drops 1000€, a golden deal
Code Promo Cyberghost
This 2.19€ VPN reserves servers for streaming : its early offer adds 4 months
Hugging Face loses its best ally for open source AI at Nvidia, two months after the acquisition
Microsoft Batiment
Microsoft Outage: ChatGPT and Claude also affected, and they are not the only ones
Canva1920 1280 (24)
SpaceX could soon swallow Tesla: the biggest deal in history is being negotiated... without Elon Musk
Top Downloads
  • Google Play Store
  • 4K Video Downloader Plus
  • VLC Media Player
  • WhatsApp
  • Adobe Reader
  • uTorrent
  • WinRAR
  • Xender
  • Google Chrome
  • CCleaner
  • Mozilla Firefox
  • Avast Free
  • ChatGPT
  • Microsoft 365
  • Opera One
  • Avast One
The trending tests
  • AirPods Pro 3
  • Google Pixel 9a
  • Google Pixel 10
  • Google Pixel 10 Pro XL
  • iPhone 17
  • iPhone 17 Pro
  • iPhone 16e
  • Samsung Galaxy S25
  • Samsung Galaxy S25 Ultra
  • Samsung Galaxy A56
  • Samsung Galaxy A26
  • Samsung Galaxy A17
  • Starlink
  • Xiaomi Redmi Note 14 4G
  • Xiaomi Redmi Note 14 Pro
  • Xiaomi 15T Pro
The latest news
Nvidia Logo Carte Graphique Gpu
After the Nvidia scandal, Washington is considering new restrictions against China
Spacex Starships Thirteenth Flight Test 1
Starship: SpaceX is preparing to attempt a historic feat with its massive rocket
Hugging Face NVIDIA
Hugging Face loses its best ally for open-source AI at Nvidia, two months after the acquisition
Microsoft Batiment
Microsoft outage: ChatGPT and Claude also affected, and they are not the only ones
Canva1920 1280 (24)
SpaceX could soon swallow Tesla: the biggest deal in history is being negotiated... without Elon Musk
In the spotlight
1
Projector: here are 3 pieces of furniture to hide it completely in your living room
Lsi 02
Play and create without limits with the new Samsung 990 internal SSD
The latest tests
Dacia Spring Statique © Thomas Cortesi 4
Dacia Spring 2026 Test: it changed everything, except its canon price and a nasty flaw
Nakamura E Summit 990 00005
Test Nakamura E-Summit 990: What is the value of the first Intersport VTTAE powered by Bosch motor?
Essai Mercedes Classe C 400 4matic 7933
I tried the electric Mercedes Class C: 500 km to disconnect from reality
Software of the Month

Accusé de piller les sites web, Perplexity se défend maladroitement

Opera One
Download the free web browser boosted by AI

Download

Top downloads
  • Google Play Store
  • 4K Video Downloader Plus
  • VLC Media Player
  • WhatsApp
  • Adobe Reader
  • uTorrent
  • WinRAR
  • Xender
  • Google Chrome
  • CCleaner
  • Mozilla Firefox
  • Avast Free
  • ChatGPT
  • Microsoft 365
  • Opera One
  • Avast One
Top Tests
  • AirPods Pro 3
  • Google Pixel 9a
  • Google Pixel 10
  • Google Pixel 10 Pro XL
  • iPhone 17
  • iPhone 17 Pro
  • iPhone 16e
  • Samsung Galaxy S25
  • Samsung Galaxy S25 Ultra
  • Samsung Galaxy A56
  • Samsung Galaxy A26
  • Samsung Galaxy A17
  • Starlink
  • Xiaomi Redmi Note 14 4G
  • Xiaomi Redmi Note 14 Pro
  • Xiaomi 15T Pro