Last modified: 2010-05-15 15:41:11 UTC

Wikimedia Bugzilla is closed!

Wikimedia has migrated from Bugzilla to Phabricator. Bug reports should be created and updated in Wikimedia Phabricator instead. Please create an account in Phabricator and add your Bugzilla email address to it.
Wikimedia Bugzilla is read-only. If you try to edit or create any bug report in Bugzilla you will be shown an intentional error message.
In order to access the Phabricator task corresponding to a Bugzilla report, just remove "static-" from its URL.
You could still run searches in Bugzilla or access your list of votes but bug reports will obviously not be up-to-date in Bugzilla.
Bug 8338 - spider repellent for boring pages
spider repellent for boring pages
Product: MediaWiki
Classification: Unclassified
Parser (Other open bugs)
PC Linux
: Low minor (vote)
: ---
Assigned To: Nobody - You can work on this!
Depends on:
  Show dependency treegraph
Reported: 2006-12-20 17:23 UTC by Dan Jacobson
Modified: 2010-05-15 15:41 UTC (History)
0 users

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Description Dan Jacobson 2006-12-20 17:23:05 UTC
On a small wiki analyzing web logs shows that 90% of the traffic
is search engines indexing the most useless places, like Allmessages,
old revisions, you name it. Every nook and cranny they've crawled

Therefore please increase nofollow links or whatever. Indeed, perhaps
just exclude all except current pages and categories, and keep them out of
Special: and Mediawiki: namespaces too, etc.

I see there is a $wgNamespaceRobotPolicies etc. but little wiki sysops
would not dare to tinker with these, so there should be better defaults.
Comment 1 Rob Church 2006-12-23 23:33:02 UTC
Read includes/DefaultSettings.php:

 * Robot policies for namespaces
 * e.g. $wgNamespaceRobotPolicies = array( NS_TALK => 'noindex' );
$wgNamespaceRobotPolicies = array();

Doesn't seem all that hard to me.
Comment 2 Darkoneko 2006-12-23 23:36:38 UTC
hmmm, do we have something like a SPECIAL => 'noindex' too ?

Note You need to log in before you can comment on or make changes to this bug.