Commit Graph

28 Commits (9.2.x)

Author SHA1 Message Date
catch eecc9bf2dd Issue #3123285 by Neslee Canil Pinto, amjad1233, shaktik, Chi, xjm, bkosborne, quietone: Actually exclude user register, login, logout, and password pages from search results in robots.txt (current rules are broken) 2020-08-26 09:40:47 +01:00
Alex Pott 4300e616cc
Issue #1137848 by Tor Arne Thune, mgifford, GaëlG, ericjenkins: /filter/tips page is listed by search engines 2018-03-15 15:02:58 +00:00
Nathaniel Catchpole d0ccb7457e Issue #2364343 by damien_vancouver, criz, ksenzee, joegraduate, Neograph734, droplet, pounard, jp.stacey, ciss: Fix robots.txt to allow Google access to CSS, JavaScript and image files 2016-02-29 16:18:01 +09:00
Alex Pott 7d8eb15a2d Issue #2492191 by droplet: Remove "Crawl-delay" in robots.txt 2015-06-08 16:08:49 +01:00
Alex Pott 7bc8b517fa Issue #2446657 by rpayanm: Dead link on robots.txt 2015-03-17 23:59:29 +00:00
Alex Pott d3516ddef5 Issue #2364343 by ksenzee | corbacho: Fixed robots.txt to allow Google access to CSS and JavaScript files. 2014-11-05 09:15:07 +00:00
Jennifer Hodgdon 8a44b5c742 Issue #2290435 by PQ: Fix broken link in robots.txt file 2014-06-25 15:06:24 -07:00
webchick 69e9596c01 Issue #2276469 by decibel.places: Fixed robots.txt syntax checking link broken. 2014-06-01 23:09:07 -05:00
Dries 02750689dd - Patch #1183208 by effulgentsia, Niklas Fiekas, katbailey, no_commit_credit, catch: remove variable_get()('clean_url()') and switch to index.php/path pattern for dirty URL support. 2012-04-29 11:16:27 -04:00
Nathan Haug f434037c0e Issue #22336 by quicksketch, scor, boombatower, and rfay. Move all core Drupal files under a core subdirectory. 2011-11-01 12:48:40 +09:00
webchick af72bb9dba Issue #1249132 by aspilicious: Add INSTALL.sqlite.txt in robots.txt. 2011-08-16 02:04:35 -05:00
webchick 01ac764a2d Issue #1137848 by BrockBoland, tim.plunkett, jensimmons: Disallow /filter/tips page from search engines. 2011-06-01 01:27:15 -07:00
The Great Git Migration 79bcdb8b7d Stripping CVS keywords 2011-02-25 02:06:03 +00:00
Angie Byron 051f470e9e #905576 by idflood: Allow crawling of /contact/ by search engines, don't disallow it in robots.txt 2010-12-29 04:05:07 +00:00
Angie Byron 0fa1e14880 #494462 by z.stolar: Don't disallow crawling of of sites/X/files by search engines in robots.txt. 2009-09-11 04:17:07 +00:00
Dries Buytaert bc719d0c55 - Patch #337820 by Dave Reid, Damien Tournoud, et al: rename menu path 'logout' to 'user/logout'. For real now. 2008-11-29 09:33:51 +00:00
Angie Byron d7f706f291 Reverting #337820 once more, as it causes mysterious test failures. 2008-11-27 07:07:01 +00:00
Dries Buytaert c01f85bc37 - Patch #337820 by Dave Reid: rename menu path logout to user/logout. 2008-11-25 13:16:39 +00:00
Dries Buytaert 84ea54a125 - Patch #299582 by hass: robots.txt maintenance. 2008-08-25 08:13:41 +00:00
Gábor Hojtsy 39e9548f8b #75916 follow up patch by Richard Eriksson: allow aggregator pages to be indexed by default 2007-06-27 22:37:44 +00:00
Dries Buytaert 860313e72b - Patch #130427 by scor: add INSTALL.txt to robots.txt. 2007-03-25 20:05:19 +00:00
Dries Buytaert f416390067 - Patch #75916 by pcwick: block user/login page. 2007-01-08 12:02:18 +00:00
Dries Buytaert a8584f1b18 - Patch #79031 by jvandyck: corrections to robots.txt. 2006-08-16 22:03:56 +00:00
Neil Drumm a9080f70ed #78652 by m3avrck, add CVS ID 2006-08-15 05:18:16 +00:00
Dries Buytaert 937f9099b4 - Patch #77183 by m3vrck: cleaned up some of the CSS mess. 2006-08-14 20:35:11 +00:00
Dries Buytaert 5b455a2e0f - Patch #75916 by Robert: re-introduced default robot.txt. 2006-08-14 10:41:52 +00:00
Kjartan Mannes 933fd5e7fd - removing robots.txt and cvs.module
- commiting patch to cloud.module from Remco.
2002-04-12 19:17:12 +00:00
Dries Buytaert c1a88d5d67 Again, a large batch of updates - I'm twisting things around here:
1. improved .htaccess to be more "secure": to keep prying
    eyes out

 2. rewrote the administration section from scratch using a
    modular approach

 3. improved the information gathered by error.php - we can
    now (hopefully) track what bots are crawling us.

 4. fixed a bug in submit.php, fixed a bug in theme zaphod,
    fixed a bug in theme marvin.

 5. rewrote cron from scratch - it now interfaces with
    modules as it should have been from the beginning.
    Very cool if you ask me - it can use UNIX/Linux
    crontabs.

 6. updated widget.inc to be module aware - needs more
    work though - maybe this afternoon?

 7. updated most modules: small bugfixes, improvements, and
    even the documentation

 8. removed diary.php and made it a module - you can now
    run a drop.org site without a diary system if someone
    would prefer so

 9. updated all themes to use the new modules where
    appropriate

 10. added a robots.txt because the error message in the
     watchdog become annoying.

 11. added the new configuration system (mutliple vhosts
     on the same source tree) - use hostname.conf instead
     of config.inc

 12. removed calendar.inc and made it a module

 13. added format_interval() to functions.inc (UnConeD)

 14. whatever I forgot ...
2000-12-16 08:39:01 +00:00