Logo
Eolia @eolia
a répondu au Message de eric - 16 h.
Mouais...
Note: Only cooperative robots follow these rules, and a crawler first needs to access the resource to read headers and meta elements (see Interaction with robots.txt). If you want to prevent bandwidth consumption by crawlers, a restrictive robots.txt file is more effective than indexing rules as it blocks resources from being crawled.

https://developer.mozilla....