Last modified: 2008-10-01 09:38:03 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T15890, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 13890 - add user talk namespace of En.Wikipedia to Robots.txt
add user talk namespace of En.Wikipedia to Robots.txt
Status: RESOLVED FIXED
Product: Wikimedia
Classification: Unclassified
Site requests (Other open bugs)
unspecified
All All
: Normal enhancement with 1 vote (vote)
: ---
Assigned To: Nobody - You can work on this!
http://en.wikipedia.org/wiki/Wikipedi...
: shell
: 14333 (view as bug list)
Depends on:
Blocks: robots.txt
  Show dependency treegraph
 
Reported: 2008-04-30 07:15 UTC by Graham87
Modified: 2008-10-01 09:38 UTC (History)
5 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Graham87 2008-04-30 07:15:22 UTC
As discussed in the link above, the user talk namespace should not appear in Google searches for privacy reasons. Also see this Wikimedia blog entry: http://blog.wikimedia.org/2008/04/29/robotstxt/
Comment 1 Brion Vibber 2008-04-30 18:50:34 UTC
[Note that if implemented, they should not be added to robots.txt, but rather the $wgNamespaceRobotPolicies setting changed.]
Comment 2 Brion Vibber 2008-05-29 17:07:13 UTC
*** Bug 14333 has been marked as a duplicate of this bug. ***
Comment 3 JeLuF 2008-09-13 00:15:49 UTC
Done.

    'enwiki' => array(
        NS_USER_TALK => 'noindex,follow',
    ),
Comment 4 Ned Scott 2008-09-26 02:52:07 UTC
Where the hell was the discussion for this? The "cited" url break off on this page, and was originally posted four months ago. The __NOINDEX__ magic word was supposed to solve this, anyways. When you guys see a major gap in time like this, someone needs to go back and probe the community for comment to see if there really was a consensus. This should not have been done.
Comment 5 Graham87 2008-09-26 03:06:31 UTC
The cited URL works for me: go to Wikipedia:Village pump (proposals)/Archive 25 in the English Wikipedia and check the section titled "Stopping search engines from indexing the user talk namespace?" Also see my message at Wikipedia talk:NOINDEX of noticeboards in the section entitled "Noindexing user talk space and other thoughts", where I demonstrated a real case where this could be a problem.
Comment 6 Ned Scott 2008-09-26 03:09:56 UTC
Yes, the url works for me now (it only cut off when I wasn't logged in). While I understand and respect the opinion that user talk shouldn't be indexed, there certainly wasn't any community support for the change. Now seeing that discussion I'm even more surprised that this change occurred. I've now gone ahead and started a formal request to re-include user talk pages at http://en.wikipedia.org/wiki/Wikipedia:VPR#Re-enable_searches_in_the_user_talk_space
Comment 7 Happy-melon 2008-10-01 08:41:22 UTC
Why was this changed to "noindex *follow*"??  Forgive me if I'm talking completely out of my arse, but shouldn't that allow external links on user talk pages to affect the rankings of other sites? Zomg spam, anyone?? 
Comment 8 Gurch 2008-10-01 09:38:03 UTC
It is my personal opinion that anyone in favour of changes like these does not understand the way in which today's World Wide Web functions.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links