Last modified: 2006-03-07 06:10:59 UTC

Wikimedia Bugzilla is closed!

Wikimedia has migrated from Bugzilla to Phabricator. Bug reports should be created and updated in Wikimedia Phabricator instead. Please create an account in Phabricator and add your Bugzilla email address to it.
Wikimedia Bugzilla is read-only. If you try to edit or create any bug report in Bugzilla you will be shown an intentional error message.
In order to access the Phabricator task corresponding to a Bugzilla report, just remove "static-" from its URL.
You could still run searches in Bugzilla or access your list of votes but bug reports will obviously not be up-to-date in Bugzilla.
Bug 4857 - Page purge queue daemon (for template updates, etc)
Page purge queue daemon (for template updates, etc)
Product: MediaWiki
Classification: Unclassified
Page editing (Other open bugs)
All All
: Normal normal with 5 votes (vote)
: ---
Assigned To: Nobody - You can work on this!
: 2098 (view as bug list)
Depends on:
Blocks: 3843 2331 4713 4902
  Show dependency treegraph
Reported: 2006-02-04 08:18 UTC by Brion Vibber
Modified: 2006-03-07 06:10 UTC (History)
1 user (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Description Brion Vibber 2006-02-04 08:18:31 UTC
Large updates for some things are currently handled sub-ideally or not at all:
* slow: cache purges on creation/deletion
* slow: cache purges on template change
* not at all: link table updates on template change

For large numbers of affected pages, trying to update page_touched records and send squid 
purges during a save operation can be prohibitively slow, leading to transaction failures 
or replication lag due to the serialized nature of MySQL replication.

As the wikis continue to grow, and templates are commonly used for things like 
standardizing categorization, we get requests to manually run refreshLinks to update 
category membership and such. That kinda sucks, so we should think about implementing a 
purge queue, as discussed in past years but never yet gotten to.

The names of pages to purge or re-link can be sucked out of the database and stuffed in a 
queue for processing after the save: generally these operations don't need to be 
_immediate_, they just need to happen soonish.

For Wikimedia and other dedicated sites, we can have a daemon or other regular dedicated 
process churn through this queue. For third-party sites on a default install it could be 
done "in the background" during other page hits or some such, or just left as an 
'advanced' feature.
Comment 1 Rob Church 2006-02-09 20:44:26 UTC
*** Bug 2098 has been marked as a duplicate of this bug. ***
Comment 2 lɛʁi לערי ריינהארט 2006-02-09 21:27:19 UTC
moving dependencies from bug 2098 to this bug
blocks Bug 2331: (FIXED) undeleting pages does not add the pages to categories
blocks Bug 4713: Moved pages dissapear from "Whatlinkshere" of templates they
Comment 3 Tim Starling 2006-03-07 06:10:59 UTC
We have this now.

Note You need to log in before you can comment on or make changes to this bug.