Skip to content

Commit 8415cd1

Browse files
zigspherezigsphere
committed
Update robots.txt
1 parent 082e18d commit 8415cd1

1 file changed

Lines changed: 18 additions & 0 deletions

File tree

‎public/robots.txt‎

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,22 @@
11
# robotstxt.org/
22

3+
User-agent: GPTBot
4+
Disallow: /
5+
6+
User-agent: ChatGPT-User
7+
Disallow: /
8+
9+
User-agent: Google-Extended
10+
Disallow: /
11+
12+
User-agent: anthropic-ai
13+
Disallow: /
14+
15+
User-agent: CCBot
16+
Disallow: /
17+
18+
User-agent: noai
19+
Disallow: /
20+
321
User-agent: *
422
Disallow:

0 commit comments

Comments
 (0)