Issue #2276469 by decibel.places: Fixed robots.txt syntax checking link broken.
parent
67c7e45896
commit
69e9596c01
|
@ -14,7 +14,7 @@
|
|||
# http://www.robotstxt.org/wc/robots.html
|
||||
#
|
||||
# For syntax checking, see:
|
||||
# http://www.sxw.org.uk/computing/robots/check.html
|
||||
# http://www.frobee.com/robots-txt-check
|
||||
|
||||
User-agent: *
|
||||
Crawl-delay: 10
|
||||
|
|
Loading…
Reference in New Issue