Last modified: 2006-03-07 06:10:59 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T6857, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 4857 - Page purge queue daemon (for template updates, etc)
Page purge queue daemon (for template updates, etc)
Product: MediaWiki
Classification: Unclassified
Page editing (Other open bugs)
All All
: Normal normal with 5 votes (vote)
: ---
Assigned To: Nobody - You can work on this!
: 2098 (view as bug list)
Depends on:
Blocks: 3843 2331 4713 4902
  Show dependency treegraph
Reported: 2006-02-04 08:18 UTC by Brion Vibber
Modified: 2006-03-07 06:10 UTC (History)
1 user (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Description Brion Vibber 2006-02-04 08:18:31 UTC
Large updates for some things are currently handled sub-ideally or not at all:
* slow: cache purges on creation/deletion
* slow: cache purges on template change
* not at all: link table updates on template change

For large numbers of affected pages, trying to update page_touched records and send squid 
purges during a save operation can be prohibitively slow, leading to transaction failures 
or replication lag due to the serialized nature of MySQL replication.

As the wikis continue to grow, and templates are commonly used for things like 
standardizing categorization, we get requests to manually run refreshLinks to update 
category membership and such. That kinda sucks, so we should think about implementing a 
purge queue, as discussed in past years but never yet gotten to.

The names of pages to purge or re-link can be sucked out of the database and stuffed in a 
queue for processing after the save: generally these operations don't need to be 
_immediate_, they just need to happen soonish.

For Wikimedia and other dedicated sites, we can have a daemon or other regular dedicated 
process churn through this queue. For third-party sites on a default install it could be 
done "in the background" during other page hits or some such, or just left as an 
'advanced' feature.
Comment 1 Rob Church 2006-02-09 20:44:26 UTC
*** Bug 2098 has been marked as a duplicate of this bug. ***
Comment 2 lɛʁi לערי ריינהארט 2006-02-09 21:27:19 UTC
moving dependencies from bug 2098 to this bug
blocks Bug 2331: (FIXED) undeleting pages does not add the pages to categories
blocks Bug 4713: Moved pages dissapear from "Whatlinkshere" of templates they
Comment 3 Tim Starling 2006-03-07 06:10:59 UTC
We have this now.

Note You need to log in before you can comment on or make changes to this bug.