Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T6275, the corresponding Phabricator task for complete and up-to-date bug report information.

Bug 4275 - Robots.txt incomplete

Summary:	Robots.txt incomplete

Status: RESOLVED FIXED Product: Datasets Classification: Unclassified Component: General/Unknown (Other open bugs) Version: unspecified Hardware: All All Importance: Normal normal (vote) Target Milestone: --- Assigned To: Nobody - You can work on this! URL: http://static.wikimedia.org/robots.txt Whiteboard: Keywords: Depends on: Blocks:   Show dependency tree / graph		Reported: 2005-12-14 15:37 UTC by 555 Modified: 2011-11-29 03:20 UTC (History) CC List: 1 user (show) tfinc See Also: Web browser: --- Mobile Platform: --- Assignee Huggle Beta Tester: ---

Attachments Add an attachment (proposed patch, testcase, etc.)

Description 555 2005-12-14 15:37:36 UTC The file robots.txt to http://static.wikipedia.org/ is incomplete... Comment 1 Rob Church 2005-12-14 15:48:38 UTC ...in what way? And what issues does this cause? Comment 2 555 2005-12-14 15:56:16 UTC The domain http://static.wikipedia.org/ have lots of directories listeds in your main page, but the robots.txt disallow bots to download data only to 9 of them. Comment 3 Antoine "hashar" Musso (WMF) 2005-12-14 20:32:45 UTC Fixed it thanks for the report.