14 lines
234 B
Plaintext
14 lines
234 B
Plaintext
# https://www.robotstxt.org/
|
|
|
|
User-Agent: GPTBot
|
|
User-Agent: ClaudeBot
|
|
User-agent: Claude-Web
|
|
User-Agent: PerplexityBot
|
|
User-Agent: CCBot
|
|
User-Agent: Google-Extended
|
|
Disallow: /
|
|
|
|
User-agent: Yandex
|
|
User-agent: Baiduspider
|
|
Disallow: /
|