Last modified: 2014-06-19 17:46:42 UTC
currently hidden categories are used as major tagging vehicle, some of them including over a million of pages - and changes on them cause extreme high rate of invalidations (enough to saturate squid cpu capacity). we should have category invalidations code to somehow know that category is hidden before invalidating squid pages, or not do any invalidation on category changes at all, or have delayed check if such invalidation has to be done (so that flapping would not be possible).
> currently hidden categories are used as major tagging vehicle, some of them > including over a million of pages - and changes on them cause extreme high > rate of invalidations (enough to saturate squid cpu capacity). In the meantime Squid got superseded by Varnish. Wondering if "enough to saturate squid cpu capacity" is still valid concern nowadays. Ori / Aaron: Does any of you know if this still exposes a problem, or if this can be considered obsolete due to software improvements in the meantime?
The job queue rate-limits the invalidations, so it probably won't hurt CPU much. It still will be wasteful so this is still a bug of sorts.