Last modified: 2014-02-01 19:08:33 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T56680, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 54680 - Set $wgCategoryCollation to 'uca-fr' on the French Wikipedia and rebuild category sort keys
Set $wgCategoryCollation to 'uca-fr' on the French Wikipedia and rebuild cate...
Status: RESOLVED FIXED
Product: Wikimedia
Classification: Unclassified
Site requests (Other open bugs)
unspecified
All All
: Low enhancement (vote)
: ---
Assigned To: Tomasz W. Kozlowski
: shell
Depends on:
Blocks: collations
  Show dependency treegraph
 
Reported: 2013-09-27 08:06 UTC by Bartosz Dziewoński
Modified: 2014-02-01 19:08 UTC (History)
10 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Bartosz Dziewoński 2013-09-27 08:06:43 UTC
Please set $wgCategoryCollation to 'uca-fr' on the French Wikipedia and rebuild category sort keys.

Consensus: https://fr.wikipedia.org/wiki/Wikipédia:Le_Bistro/26_septembre_2013#Ordre_alphab.C3.A9tique_des_lettres_accentu.C3.A9es_dans_les_cat.C3.A9gories
Comment 1 Gerrit Notification Bot 2013-09-27 21:08:24 UTC
Change 86320 had a related patch set uploaded by Odder:
(bug 54680) Set $wgCategoryCollation for the French Wikipedia

https://gerrit.wikimedia.org/r/86320
Comment 2 Gerrit Notification Bot 2013-10-11 18:25:42 UTC
Change 86320 merged by Reedy:
(bug 54680) Set $wgCategoryCollation for the French Wikipedia

https://gerrit.wikimedia.org/r/86320
Comment 4 Bartosz Dziewoński 2013-10-12 15:50:37 UTC
According to Reedy on IRC, 2370000 out of 19615163 page–category pairs processed right now, or about 12%.

(That's a lot of categories per page, by the way.)
Comment 5 Sam Reed (reedy) 2013-10-16 15:57:35 UTC
Selecting next 10000 rows... processing...8010000 done.
Selecting next 10000 rows... processing...A database query error has occurred.
Query: UPDATE  `categorylinks` SET cl_sortkey = '-CS/==9\';/B9\';/-CS/==������  \0',cl_sortkey_prefix = 'Dowell, Jake',cl_collation = 'uca-fr',cl_type = 'page',cl_timestamp = cl_timestamp WHERE cl_from = '4768816' AND cl_to = 'Joueur_des_Stars_de_Dallas'
Function: UpdateCollation::execute
Error: 1290 The MySQL server is running with the --read-only option so it cannot execute this statement (10.64.0.10)


real    3476m52.984s
user    44m27.779s
sys     3m41.506s
Comment 6 Sam Reed (reedy) 2013-10-16 16:32:32 UTC
Error above is from a master switch.

Re-started.
Comment 7 Tomasz W. Kozlowski 2013-10-23 21:04:55 UTC
(In reply to comment #6)

> Re-started.

What's the state of this?
Comment 8 Bartosz Dziewoński 2013-10-23 21:09:14 UTC
According to Reedy – and let me paraphrase here – database stuff broke. (I just asked him today and he promised to elaborate later.)

CC-ing Sean Pringle who apparently had something to do with this somewhere.
Comment 9 Sean Pringle 2013-10-25 01:48:37 UTC
The UpdateCollation job caused concurrency and load issues on the S6 database master. Turning off the InnoDB adaptive hash index allows the job to run sustainably. Not ideal in the long term but the cheapest fix for now.

I've been running the job during S6 off-peak hours (such as they are) and when other things permit. Looks to be around 55% done.
Comment 10 Tomasz W. Kozlowski 2013-10-28 18:16:42 UTC
(In reply to comment #9)

> I've been running the job during S6 off-peak hours (such as they are) and
> when other things permit. Looks to be around 55% done.

Is this finished yet?
Comment 11 Sean Pringle 2013-10-29 10:08:50 UTC
The job is finally finished.
Comment 12 Tomasz W. Kozlowski 2013-10-29 11:38:43 UTC
Marking RESOLVED FIXED per comment 11.
Comment 13 Bartosz Dziewoński 2013-10-29 18:55:54 UTC
(I filed bug 56041 about the troubles here.)
Comment 14 Filipus Klutiero 2014-02-01 18:42:30 UTC
If this change is in production, it looks like it didn't fix sorting (see https://fr.wikipedia.org/w/index.php?title=Sp%C3%A9cial:Cat%C3%A9gories_inutilis%C3%A9es&limit=50&offset=1000 ).
Comment 15 Bartosz Dziewoński 2014-02-01 19:08:33 UTC
It is in production, but the sorting is currently only used for category listings and not for the query special pages listings.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links