retrait de robots.txt
This commit is contained in:
@@ -1,5 +0,0 @@
|
|||||||
# https://www.robotstxt.org/
|
|
||||||
|
|
||||||
# Deny crawling of all content
|
|
||||||
User-agent: *
|
|
||||||
Disallow: /
|
|
||||||
Reference in New Issue
Block a user