catch
eecc9bf2dd
Issue #3123285 by Neslee Canil Pinto, amjad1233, shaktik, Chi, xjm, bkosborne, quietone: Actually exclude user register, login, logout, and password pages from search results in robots.txt (current rules are broken)
2020-08-26 09:40:47 +01:00
Alex Pott
4300e616cc
Issue #1137848 by Tor Arne Thune, mgifford, GaëlG, ericjenkins: /filter/tips page is listed by search engines
2018-03-15 15:02:58 +00:00
Nathaniel Catchpole
d0ccb7457e
Issue #2364343 by damien_vancouver, criz, ksenzee, joegraduate, Neograph734, droplet, pounard, jp.stacey, ciss: Fix robots.txt to allow Google access to CSS, JavaScript and image files
2016-02-29 16:18:01 +09:00
Alex Pott
7d8eb15a2d
Issue #2492191 by droplet: Remove "Crawl-delay" in robots.txt
2015-06-08 16:08:49 +01:00
Alex Pott
7bc8b517fa
Issue #2446657 by rpayanm: Dead link on robots.txt
2015-03-17 23:59:29 +00:00
Alex Pott
d3516ddef5
Issue #2364343 by ksenzee | corbacho: Fixed robots.txt to allow Google access to CSS and JavaScript files.
2014-11-05 09:15:07 +00:00
Jennifer Hodgdon
8a44b5c742
Issue #2290435 by PQ: Fix broken link in robots.txt file
2014-06-25 15:06:24 -07:00
webchick
69e9596c01
Issue #2276469 by decibel.places: Fixed robots.txt syntax checking link broken.
2014-06-01 23:09:07 -05:00
Dries
02750689dd
- Patch #1183208 by effulgentsia, Niklas Fiekas, katbailey, no_commit_credit, catch: remove variable_get()('clean_url()') and switch to index.php/path pattern for dirty URL support.
2012-04-29 11:16:27 -04:00
Nathan Haug
f434037c0e
Issue #22336 by quicksketch, scor, boombatower, and rfay. Move all core Drupal files under a core subdirectory.
2011-11-01 12:48:40 +09:00
webchick
af72bb9dba
Issue #1249132 by aspilicious: Add INSTALL.sqlite.txt in robots.txt.
2011-08-16 02:04:35 -05:00
webchick
01ac764a2d
Issue #1137848 by BrockBoland, tim.plunkett, jensimmons: Disallow /filter/tips page from search engines.
2011-06-01 01:27:15 -07:00
The Great Git Migration
79bcdb8b7d
Stripping CVS keywords
2011-02-25 02:06:03 +00:00
Angie Byron
051f470e9e
#905576 by idflood: Allow crawling of /contact/ by search engines, don't disallow it in robots.txt
2010-12-29 04:05:07 +00:00
Angie Byron
0fa1e14880
#494462 by z.stolar: Don't disallow crawling of of sites/X/files by search engines in robots.txt.
2009-09-11 04:17:07 +00:00
Dries Buytaert
bc719d0c55
- Patch #337820 by Dave Reid, Damien Tournoud, et al: rename menu path 'logout' to 'user/logout'. For real now.
2008-11-29 09:33:51 +00:00
Angie Byron
d7f706f291
Reverting #337820 once more, as it causes mysterious test failures.
2008-11-27 07:07:01 +00:00
Dries Buytaert
c01f85bc37
- Patch #337820 by Dave Reid: rename menu path logout to user/logout.
2008-11-25 13:16:39 +00:00
Dries Buytaert
84ea54a125
- Patch #299582 by hass: robots.txt maintenance.
2008-08-25 08:13:41 +00:00
Gábor Hojtsy
39e9548f8b
#75916 follow up patch by Richard Eriksson: allow aggregator pages to be indexed by default
2007-06-27 22:37:44 +00:00
Dries Buytaert
860313e72b
- Patch #130427 by scor: add INSTALL.txt to robots.txt.
2007-03-25 20:05:19 +00:00
Dries Buytaert
f416390067
- Patch #75916 by pcwick: block user/login page.
2007-01-08 12:02:18 +00:00
Dries Buytaert
a8584f1b18
- Patch #79031 by jvandyck: corrections to robots.txt.
2006-08-16 22:03:56 +00:00
Neil Drumm
a9080f70ed
#78652 by m3avrck, add CVS ID
2006-08-15 05:18:16 +00:00
Dries Buytaert
937f9099b4
- Patch #77183 by m3vrck: cleaned up some of the CSS mess.
2006-08-14 20:35:11 +00:00
Dries Buytaert
5b455a2e0f
- Patch #75916 by Robert: re-introduced default robot.txt.
2006-08-14 10:41:52 +00:00
Kjartan Mannes
933fd5e7fd
- removing robots.txt and cvs.module
...
- commiting patch to cloud.module from Remco.
2002-04-12 19:17:12 +00:00
Dries Buytaert
c1a88d5d67
Again, a large batch of updates - I'm twisting things around here:
...
1. improved .htaccess to be more "secure": to keep prying
eyes out
2. rewrote the administration section from scratch using a
modular approach
3. improved the information gathered by error.php - we can
now (hopefully) track what bots are crawling us.
4. fixed a bug in submit.php, fixed a bug in theme zaphod,
fixed a bug in theme marvin.
5. rewrote cron from scratch - it now interfaces with
modules as it should have been from the beginning.
Very cool if you ask me - it can use UNIX/Linux
crontabs.
6. updated widget.inc to be module aware - needs more
work though - maybe this afternoon?
7. updated most modules: small bugfixes, improvements, and
even the documentation
8. removed diary.php and made it a module - you can now
run a drop.org site without a diary system if someone
would prefer so
9. updated all themes to use the new modules where
appropriate
10. added a robots.txt because the error message in the
watchdog become annoying.
11. added the new configuration system (mutliple vhosts
on the same source tree) - use hostname.conf instead
of config.inc
12. removed calendar.inc and made it a module
13. added format_interval() to functions.inc (UnConeD)
14. whatever I forgot ...
2000-12-16 08:39:01 +00:00