block crawlers
This commit is contained in:
+8
-1
@@ -13,4 +13,11 @@
|
|||||||
# 44
|
# 44
|
||||||
|
|
||||||
User-agent: *
|
User-agent: *
|
||||||
Disallow:
|
Disallow: /web
|
||||||
|
Disallow: /images
|
||||||
|
Disallow: /videos
|
||||||
|
Disallow: /news
|
||||||
|
Disallow: /music
|
||||||
|
Disallow: /proxy
|
||||||
|
Disallow: /api/v1/ac
|
||||||
|
Allow: /
|
||||||
|
|||||||
Reference in New Issue
Block a user