Drupal
/
drupal
mirror of https://git.drupalcode.org/project/drupal.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

Issue #2492191 by droplet: Remove "Crawl-delay" in robots.txt

8.0.x
Alex Pott 2015-06-08 16:08:49 +01:00
parent 15c848bd62
commit 7d8eb15a2d
1 changed files with 0 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
robots.txt
View File

@ -14,7 +14,6 @@
# http://www.robotstxt.org/robotstxt.html # http://www.robotstxt.org/robotstxt.html
User-agent: * User-agent: *
Crawl-delay: 10
# JS/CSS # JS/CSS
Allow: /core/*.css$ Allow: /core/*.css$
Allow: /core/*.js$ Allow: /core/*.js$