Last modified: 2007-10-01 20:06:19 UTC

Wikimedia Bugzilla is closed!

Wikimedia has migrated from Bugzilla to Phabricator. Bug reports should be created and updated in Wikimedia Phabricator instead. Please create an account in Phabricator and add your Bugzilla email address to it.
Wikimedia Bugzilla is read-only. If you try to edit or create any bug report in Bugzilla you will be shown an intentional error message.
In order to access the Phabricator task corresponding to a Bugzilla report, just remove "static-" from its URL.
You could still run searches in Bugzilla or access your list of votes but bug reports will obviously not be up-to-date in Bugzilla.
Bug 11508 - Correct syntax in robots.txt
Correct syntax in robots.txt
Status: RESOLVED FIXED
Product: Wikimedia
Classification: Unclassified
General/Unknown (Other open bugs)
unspecified
All All
: Normal enhancement (vote)
: ---
Assigned To: Nobody - You can work on this!
http://en.wikipedia.org/robots.txt
: shell
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2007-09-30 10:14 UTC by ais523
Modified: 2007-10-01 20:06 UTC (History)
0 users

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments
corrected version of robots.txt (unfortunately with a BOM at the start I couldn't get rid of) (13.44 KB, text/plain)
2007-09-30 10:14 UTC, ais523
Details
patch in the wrong format that suggests adding a BOM at the start (76 bytes, patch)
2007-09-30 10:15 UTC, ais523
Details
patch in the wrong format that suggests adding a BOM at the start (76 bytes, text/plain)
2007-09-30 10:16 UTC, ais523
Details
Patch for robots.txt (7.45 KB, patch)
2007-09-30 11:51 UTC, Jelte (WebBoy)
Details

Description ais523 2007-09-30 10:14:21 UTC
Created attachment 4180 [details]
corrected version of robots.txt (unfortunately with a BOM at the start I couldn't get rid of)

It turns out that there are some syntax errors in Wikimedia's robots.txt file; there are some leading slashes missing, and some misplaced blank lines. I've come up with a corrected version, with the formatting made more consistent, the leading slashes added, and the blank lines commented out.

Unfortunately, I'm on a public computer at the moment on which I can't install software, and that's running Windows. So the diff I created is in the wrong format and shows no context, and both the diff and the new file have a Byte Order Mark. (The diff even shows the addition of the BOM; this needs to be removed before the patch is applied!) Anyone could submit a corrected version of the patch, which would make it easier for shell developers to apply.
Comment 1 ais523 2007-09-30 10:15:04 UTC
Created attachment 4181 [details]
patch in the wrong format that suggests adding a BOM at the start
Comment 2 ais523 2007-09-30 10:16:51 UTC
Created attachment 4182 [details]
patch in the wrong format that suggests adding a BOM at the start

(attachment 4181 [details] didn't upload properly, maybe because it was in the wrong format, trying again with a different content type)
Comment 3 ais523 2007-09-30 10:18:29 UTC
Comment on attachment 4182 [details]
patch in the wrong format that suggests adding a BOM at the start

Sorry, the diffing seemed to go wrong (attachment 4182 [details] is also incorrect, and it seems the same thing happened to my source file); could someone else diff the current robots.txt with my version to produce the patch?
Comment 4 Jelte (WebBoy) 2007-09-30 11:51:00 UTC
Created attachment 4185 [details]
Patch for robots.txt

Diff between http://en.wikipedia.org/robots.txt and attachment 4180 [details]
Comment 5 Brion Vibber 2007-10-01 20:06:19 UTC
Applied, thanks!

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links