Last modified: 2011-11-29 03:20:58 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T6275, the corresponding Phabricator task for complete and up-to-date bug report information.
First Last Prev Next    This bug is not in your last search results.
Bug 4275 - Robots.txt incomplete
Robots.txt incomplete
Status: RESOLVED FIXED
Product: Datasets
Classification: Unclassified
General/Unknown (Other open bugs)
unspecified
All All
: Normal normal (vote)
: ---
Assigned To: Nobody - You can work on this!
http://static.wikimedia.org/robots.txt
:
Depends on:
Blocks:
  Show dependency tree / graph
 
Reported: 2005-12-14 15:37 UTC by 555
Modified: 2011-11-29 03:20 UTC (History)
1 user (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---

Attachments
Add an attachment (proposed patch, testcase, etc.)

Description 555 2005-12-14 15:37:36 UTC 
The file robots.txt to http://static.wikipedia.org/ is incomplete...
Comment 1 Rob Church 2005-12-14 15:48:38 UTC 
...in what way? And what issues does this cause?
Comment 2 555 2005-12-14 15:56:16 UTC 
The domain http://static.wikipedia.org/ have lots of directories listeds in your
main page, but the robots.txt disallow bots to download data only to 9 of them.
Comment 3 Antoine "hashar" Musso (WMF) 2005-12-14 20:32:45 UTC 
Fixed it thanks for the report.
Note You need to log in before you can comment on or make changes to this bug.
First Last Prev Next    This bug is not in your last search results.

Navigation
Links