Last modified: 2011-03-13 18:05:52 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T24611, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 22611 - Special:External links lets you search 5000
Special:External links lets you search 5000
Status: RESOLVED WONTFIX
Product: Wikimedia
Classification: Unclassified
Site requests (Other open bugs)
unspecified
All All
: Lowest trivial (vote)
: ---
Assigned To: Nobody - You can work on this!
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2010-02-21 17:36 UTC by Smallman
Modified: 2011-03-13 18:05 UTC (History)
1 user (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Smallman 2010-02-21 17:36:15 UTC
Using Special:External links, you can set the limit to 5000 manually and it will work. However, the API seems to enforce that users are allowed only 500 per query.

Is this a bug or a feature?

Example:Special:External links for youtube
https://secure.wikimedia.org/wikipedia/en/w/index.php?title=Special:LinkSearch&target=http%3A%2F%2Fyoutube.com&limit=5000&offset=0

Example:api
http://en.wikipedia.org/w/api.php?action=query&list=exturlusage&euquery=youtube.com&eulimit=5000
Comment 1 Gurch 2010-02-21 21:47:30 UTC
If a user has the right 'apihighlimits', API queries are limited to 5,000 items, otherwise they are limited to 500 items. UI queries are limited to 5,000 items regardless.

This is the case with most queries; for example, user contributions, page history, backlinks. The main exception is category members, the UI for which has a fixed size of 200 items (c.f. bug 11281).

The rationale for this is that the API allows multiple list modules to be invoked in a single request, so the per-request limit is actually at least 17,000 without higher limits and 170,000 with them -- more if extensions are installed (c.f. bug 16781).

Addressing this inconsistency would either mean restricting UI queries to 500 items (for users without 'apihighlimits') or limiting the sum of all API module limits in a single query. Both of these constitute a loss of functionality and break backwards compatibility, so unless a performance issue can be demonstrated things will likely remain as they are.

I agree that this is a little odd -- if one requires 5000 items of some query it is often quicker to scrape the UI than send 10 API requests.

I would suggest the best method of addressing this should one wish to do so would be to ask for 'apihighlimits' to be assigned to all user accounts on Wikimedia wikis. I don't know if the developers would be willing to do that, but I can't imagine the performance implications would be that great. Very few Wikimedia wiki users ever make custom API requests, and while 'apihighlimits' is granted as part of the administrator group, any concerns about giving it to non-privileged users are moot as the bot group also has it, and obtaining a bot account is trivial.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links