Last modified: 2010-03-25 20:27:01 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T24040, the corresponding Phabricator task for complete and up-to-date bug report information.
First Last Prev Next    This bug is not in your last search results.
Bug 22040 - MediaWiki:Robots.txt has no effect on Commons
MediaWiki:Robots.txt has no effect on Commons
Status: RESOLVED FIXED
Product: Wikimedia
Classification: Unclassified
General/Unknown (Other open bugs)
unspecified
All All
: Normal normal with 1 vote (vote)
: ---
Assigned To: Nobody - You can work on this!
http://commons.wikimedia.org/robots.txt
: shell
Depends on:
Blocks: robots.txt
  Show dependency tree / graph
 
Reported: 2010-01-07 10:43 UTC by Ilmari Karonen
Modified: 2010-03-25 20:27 UTC (History)
2 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---

Attachments
Add an attachment (proposed patch, testcase, etc.)

Description Ilmari Karonen 2010-01-07 10:43:10 UTC 
The content of [[commons:MediaWiki:Robots.txt]] does not seem to show up at http://commons.wikimedia.org/robots.txt .  It should, shouldn't it?  Is something wrong with the configuration?
Comment 1 Platonides 2010-03-23 17:07:55 UTC 
It seems  [[meta:MediaWiki:Robots.txt]] isn't either. Perhaps because they have a pedia suffix?
Comment 2 Ilmari Karonen 2010-03-24 15:11:16 UTC 
Yeah, looks like the relevant RewriteRules are only present in http://noc.wikimedia.org/conf/main.conf but not in http://noc.wikimedia.org/conf/remnant.conf where Commons and Meta are.  Sprinkling a few suitably placed copies of

    # Make robots.txt editable via Mediawiki:robots.txt
    RewriteRule ^/robots.txt$ /w/robots.php [L]

into that file would seem likely to fix it.  (Also should probably do the same for the other relevant *.conf files.)

CCing JeLuF on this -- he fixed bug 15663, so I assume he knows something about this robots.txt setup. ;)
Comment 3 Platonides 2010-03-25 17:11:24 UTC 
Those files have interesting data, like the non-working wikipedia.geo.blitzed.org ServerAlias, or the robots file name. Why isn't robots.php in svn?
Comment 4 JeLuF 2010-03-25 20:27:01 UTC 
Fixed config for meta and commons.
Added robots.php to SVN.
Note You need to log in before you can comment on or make changes to this bug.
First Last Prev Next    This bug is not in your last search results.

Navigation
Links