Issue #2446657 by rpayanm: Dead link on robots.txt
parent
cbcf272275
commit
7bc8b517fa
|
@ -12,9 +12,6 @@
|
|||
#
|
||||
# For more information about the robots.txt standard, see:
|
||||
# http://www.robotstxt.org/robotstxt.html
|
||||
#
|
||||
# For syntax checking, see:
|
||||
# http://www.frobee.com/robots-txt-check
|
||||
|
||||
User-agent: *
|
||||
Crawl-delay: 10
|
||||
|
|
Loading…
Reference in New Issue