Last modified: 2014-07-30 23:30:33 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T70757, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 68757 - [Regression] Link tables (categories, file links, templates) are being purged for js/css pages
[Regression] Link tables (categories, file links, templates) are being purged...
Status: RESOLVED FIXED
Product: MediaWiki extensions
Classification: Unclassified
SyntaxHighlight (GeSHi) (Other open bugs)
master
All All
: High major (vote)
: ---
Assigned To: Bartosz Dziewoński
: code-update-regression
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2014-07-28 19:01 UTC by Helder
Modified: 2014-07-30 23:30 UTC (History)
11 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Helder 2014-07-28 19:01:38 UTC
Krinkle added
// {{delete|AjaxPatrolLinks is obsolete, feature is now in MediaWiki core}}
to
https://meta.wikimedia.org/wiki/MediaWiki:Gadget-AjaxPatrolLinks.js
in 13:33, 10 December 2012 and since it was not deleted, I assumed it was because of the template not being parsed, so I added
// [[Category:Deleteme|Category:Deleteme]]
and the page still din't show up in [[meta:Category:Deleteme]].
I confirmed the same problem on ptwikibooks.

This worked previously, per bug 32858 comment 2, so it is a regression (and I assume it is something related to ContentHandler).
Comment 1 Krinkle 2014-07-28 19:11:31 UTC
Yep, GlobalUsage table is rapidly shrinking for script and style pages. Existing entries are there still, but as pages get purged, edited or expire from parser cache, stuff is disappearing.

Aside from wiki workflows where templates are used for deletion requests, and categories for organisation of scripts, this is also affecting tools and gadgets that use file links to delegate tracking of scripts in global usage tables.

For example this query:
https://tools.wmflabs.org/usage/?action=usage&group=Krinkle

Is shrinking continuously (used to have 1000+, now only 890 left)
Comment 2 Krinkle 2014-07-28 19:21:33 UTC
en.wikipedia.org is also affected. So its probably a regression from 1.24wmf14 or 1.24wmf13.

The problem with this bug is that these links are often used to find things. So the bug caused those signals to no longer occur. It takes a while for people to notice it's broken (as opposed to there simply not being any signals). And past signals (current categorisation) only slowly disappears from the database as caches expire. This will become a bigger problem as time goes on.
Comment 3 Brad Jorsch 2014-07-29 12:04:08 UTC
I note that something like api.php?format=jsonfm&action=parse&title=MediaWiki:Common.js&text=[[Category:Foo]] can be used to quickly check the bug.

git bisect against core turns up Gerrit change #67983 as the culprit; the root of the problem seems to be that the hook function enabled in Gerrit change #131447 doesn't bother with the special handling done for $wgTextModelsToParse in includes/content/TextContent.php.

I'd suggest any other patches done to support 67983 should be checked for similar problems.
Comment 4 Sam Reed (reedy) 2014-07-30 17:14:12 UTC
(In reply to Brad Jorsch from comment #3)
> I note that something like
> api.php?format=jsonfm&action=parse&title=MediaWiki:Common.js&text=[[Category:
> Foo]] can be used to quickly check the bug.
> 
> git bisect against core turns up Gerrit change #67983 as the culprit; the
> root of the problem seems to be that the hook function enabled in Gerrit
> change #131447 doesn't bother with the special handling done for
> $wgTextModelsToParse in includes/content/TextContent.php.
> 
> I'd suggest any other patches done to support 67983 should be checked for
> similar problems.

Thanks for digging into this, Brad :)
Comment 5 Bartosz Dziewoński 2014-07-30 18:51:26 UTC
(In reply to Brad Jorsch from comment #3)
> git bisect against core turns up Gerrit change #67983 as the culprit; the
> root of the problem seems to be that the hook function enabled in
> Gerrit change #131447 doesn't bother with the special handling done for
> $wgTextModelsToParse in includes/content/TextContent.php.

Indeed, this is only happening when the SyntaxHighlight_GeSHi extension is installed. Changing component accordingly. Let's see how hard this is to fix…
Comment 6 Gerrit Notification Bot 2014-07-30 19:16:32 UTC
Change 150630 had a related patch set uploaded by Bartosz Dziewoński:
Parse page content using the standard parser first for link tables

https://gerrit.wikimedia.org/r/150630
Comment 7 Bartosz Dziewoński 2014-07-30 19:19:24 UTC
Ha, wasn't that hard. It's a bit silly that we have to reimplement this logic in the extension, though.


(In reply to Brad Jorsch from comment #3)
> I'd suggest any other patches done to support 67983 should be checked for
> similar problems.

I am not aware of any changes to any other extensions related to that.
Comment 8 Sam Reed (reedy) 2014-07-30 19:21:55 UTC
(In reply to Bartosz Dziewoński from comment #7)
> (In reply to Brad Jorsch from comment #3)
> > I'd suggest any other patches done to support 67983 should be checked for
> > similar problems.
> 
> I am not aware of any changes to any other extensions related to that.

Quick grep suggests that ContentGetParserOutput is only used by GeSHi :)
Comment 9 Gerrit Notification Bot 2014-07-30 22:52:52 UTC
Change 150630 merged by jenkins-bot:
Parse page content using the standard parser first for link tables

https://gerrit.wikimedia.org/r/150630
Comment 10 Gerrit Notification Bot 2014-07-30 22:53:52 UTC
Change 150723 had a related patch set uploaded by Legoktm:
Parse page content using the standard parser first for link tables

https://gerrit.wikimedia.org/r/150723
Comment 11 Gerrit Notification Bot 2014-07-30 23:04:37 UTC
Change 150723 merged by jenkins-bot:
Parse page content using the standard parser first for link tables

https://gerrit.wikimedia.org/r/150723
Comment 12 Kunal Mehta (Legoktm) 2014-07-30 23:30:33 UTC
Fix deployed for 1.24wmf15 today (<https://commons.wikimedia.org/w/api.php?format=jsonfm&action=parse&title=MediaWiki:Common.js&text=﷒0﷓>), will hit all other wikis during the 1.24wmf15/16 deployment tomorrow.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links