fix: allow tags crawling, disallow about page in robots.txt
This commit is contained in:
@@ -2,8 +2,8 @@ User-agent: *
|
|||||||
Allow: /
|
Allow: /
|
||||||
Disallow: /api/
|
Disallow: /api/
|
||||||
Disallow: /admin/
|
Disallow: /admin/
|
||||||
|
Disallow: /about
|
||||||
|
Disallow: /zh/about
|
||||||
Disallow: /*?*
|
Disallow: /*?*
|
||||||
Disallow: /zh/blog/tags/
|
|
||||||
Disallow: /blog/tags/
|
|
||||||
|
|
||||||
Sitemap: https://zhaoguiyang.com/sitemap-index.xml
|
Sitemap: https://zhaoguiyang.com/sitemap-index.xml
|
||||||
|
|||||||
Reference in New Issue
Block a user