zgy/zhaoguiyang.site
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

chore: add robots.txt to control crawler access

Browse Source
This commit is contained in:
zguiyang
2026-05-02 09:54:56 +08:00
parent 79afb0ee27
commit de3495b7a6
1 changed files with 6 additions and 10 deletions
Download Patch File Download Diff File Expand all files Collapse all files

16
public/robots.txt
View File

@@ -1,13 +1,9 @@
# robots.txt for zhaoguiyang.com
# https://zhaoguiyang.com
User-agent: * User-agent: *
Allow: / Allow: /
# Sitemap
Sitemap: https://zhaoguiyang.com/sitemap-index.xml
# Disallow admin/private areas (if any)
Disallow: /api/ Disallow: /api/
Disallow: /_astro/ Disallow: /admin/
Disallow: /assets/ Disallow: /*?*
Disallow: /zh/blog/tags/
Disallow: /blog/tags/
Sitemap: https://zhaoguiyang.com/sitemap-index.xml