Last modified: 2011-11-29 03:20:58 UTC

Wikimedia Bugzilla is closed!

Wikimedia has migrated from Bugzilla to Phabricator. Bug reports should be created and updated in Wikimedia Phabricator instead. Please create an account in Phabricator and add your Bugzilla email address to it.
Wikimedia Bugzilla is read-only. If you try to edit or create any bug report in Bugzilla you will be shown an intentional error message.
In order to access the Phabricator task corresponding to a Bugzilla report, just remove "static-" from its URL.
You could still run searches in Bugzilla or access your list of votes but bug reports will obviously not be up-to-date in Bugzilla.
Bug 4275 - Robots.txt incomplete
Robots.txt incomplete
Product: Datasets
Classification: Unclassified
General/Unknown (Other open bugs)
All All
: Normal normal (vote)
: ---
Assigned To: Nobody - You can work on this!
Depends on:
  Show dependency treegraph
Reported: 2005-12-14 15:37 UTC by 555
Modified: 2011-11-29 03:20 UTC (History)
1 user (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Description 555 2005-12-14 15:37:36 UTC
The file robots.txt to is incomplete...
Comment 1 Rob Church 2005-12-14 15:48:38 UTC what way? And what issues does this cause?
Comment 2 555 2005-12-14 15:56:16 UTC
The domain have lots of directories listeds in your
main page, but the robots.txt disallow bots to download data only to 9 of them.
Comment 3 Antoine "hashar" Musso (WMF) 2005-12-14 20:32:45 UTC
Fixed it thanks for the report.

Note You need to log in before you can comment on or make changes to this bug.