bss/ttrpg-site
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

remove unnecessary allow in robots.txt

Browse Source
This commit is contained in:
Brian S. Stephan 2025-03-18 19:38:47 -05:00
parent 55a4e5dec2
commit 26ce537dde
Signed by: bss
GPG Key ID: 3DE06D3180895FCB
1 changed files with 0 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
pages/robots.txt
View File

@ -1,6 +1,3 @@
User-agent: *
Allow: /
# Block all known AI crawlers and assistants
# from using content for training AI models.
# Source: https://robotstxt.com/ai