Last modified: 2014-04-29 15:00:46 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T20489, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 18489 - MediaWiki needs better throttling for expensive queries
MediaWiki needs better throttling for expensive queries
Status: NEW
Product: MediaWiki
Classification: Unclassified
General/Unknown (Other open bugs)
unspecified
All All
: Lowest minor (vote)
: ---
Assigned To: Nobody - You can work on this!
: performance
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2009-04-17 00:38 UTC by MZMcBride
Modified: 2014-04-29 15:00 UTC (History)
7 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description MZMcBride 2009-04-17 00:38:26 UTC
Currently, I believe the API has little throttling built in (if any). This can cause problems if people or organizations are hitting the API with expensive queries at a fast rate.

Bug filed in response to ExternalStorage issues from &rvprop=content|timestamp being batch queried from the API.

Some sort of sensible options should be implemented to throttle expensive queries with variables to override the defaults for very robust or very weak servers.
Comment 1 Roan Kattouw 2009-04-17 10:14:29 UTC
I don't believe this is a general API issue, but rather a MediaWiki or Wikimedia issue. Batch-querying rvprop=content is one way to cause an ES hiccup, but there are others, like hitting Special:Export at the same rate; the latter would actually be much more effective at killing ES servers, because it'll happily export an unlimited number of revisions of a single page (and an unlimited number of pages too, IIRC, so you could potentially ask Special:Export to try to export the entire wiki at once), whereas the API is limited to 50 content fetches per request (500 for bots/sysops).
Comment 2 Bryan Tong Minh 2009-08-03 17:59:45 UTC
INVALID, not an API bug.
Comment 3 MZMcBride 2009-08-03 21:56:42 UTC
Re-opening with an expanded scope. Changed summary from "API needs better throttling for expensive queries" to "MediaWiki needs better throttling for expensive queries." This is definitely an issue that needs to be addressed at some point.
Comment 4 Quim Gil 2014-04-29 15:00:46 UTC
Bringing in performance-savvy contributors to weigh in in this old request.

Marking as Lowest, since nobody seems to be working or planning to work on this currently.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links