Last modified: 2014-07-13 07:05:01 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T69350, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 67350 - Audit centralauth database for inconsistencies
Audit centralauth database for inconsistencies
Status: ASSIGNED
Product: Wikimedia
Classification: Unclassified
General/Unknown (Other open bugs)
unspecified
All All
: High normal (vote)
: ---
Assigned To: Kunal Mehta (Legoktm)
:
Depends on: 67548
Blocks: sulfinalization 39817 61876
  Show dependency treegraph
 
Reported: 2014-07-01 07:47 UTC by Kunal Mehta (Legoktm)
Modified: 2014-07-13 07:05 UTC (History)
4 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments
counts of deletions by of checkLocalNames.php (64.82 KB, application/octet-stream)
2014-07-12 22:14 UTC, Kunal Mehta (Legoktm)
Details
counts of deletions by checkLocalUser.php (63.97 KB, application/octet-stream)
2014-07-12 22:14 UTC, Kunal Mehta (Legoktm)
Details

Description Kunal Mehta (Legoktm) 2014-07-01 07:47:06 UTC
Inspired by bug 66535.

Since we have a checkLocalNames script, I started running it against small.dblist (except for loginwiki, which has a huge user table).

aywiki:  2014-07-01 07:27:48 found 1 invalid localnames, 0 (0.0%) deleted
chrwiki:  2014-07-01 07:29:09 found 2 invalid localnames, 0 (0.0%) deleted
csbwiki:  2014-07-01 07:29:32 found 1 invalid localnames, 0 (0.0%) deleted
furwiki:  2014-07-01 07:31:32 found 1 invalid localnames, 0 (0.0%) deleted
idwikiquote:  2014-07-01 07:32:49 found 1 invalid localnames, 0 (0.0%) deleted
iewiki:  2014-07-01 07:32:57 found 1 invalid localnames, 0 (0.0%) deleted
iuwiki:  2014-07-01 07:33:15 found 1 invalid localnames, 0 (0.0%) deleted
kaawiki:  2014-07-01 07:33:32 found 1 invalid localnames, 0 (0.0%) deleted
kshwiki:  2014-07-01 07:34:17 found 1 invalid localnames, 0 (0.0%) deleted
kswiki:  2014-07-01 07:34:20 found 1 invalid localnames, 0 (0.0%) deleted
lnwiki:  2014-07-01 07:34:51 found 1 invalid localnames, 0 (0.0%) deleted
lowiki:  2014-07-01 07:38:24 found 1 invalid localnames, 0 (0.0%) deleted
pdcwiki:  2014-07-01 07:40:14 found 1 invalid localnames, 0 (0.0%) deleted
sswiki:  2014-07-01 07:42:36 found 1 invalid localnames, 0 (0.0%) deleted
tewikiquote:  2014-07-01 07:43:32 found 1 invalid localnames, 0 (0.0%) deleted
viwikibooks:  2014-07-01 07:44:56 found 1 invalid localnames, 0 (0.0%) deleted
xalwiki:  2014-07-01 07:45:47 found 1 invalid localnames, 0 (0.0%) deleted
xhwiki:  2014-07-01 07:45:50 found 1 invalid localnames, 0 (0.0%) deleted


We will need to optimize the script to run on any larger wikis.
Comment 1 Chris Steipp 2014-07-01 10:50:07 UTC
Thanks! Was it the same username across those wikis that was invalid? It just seems odd that there is exactly 1 invalid name on each wiki you tried.

Are you planning to run migratePass0 to make sure localnames has all of the local names too?
Comment 2 Kunal Mehta (Legoktm) 2014-07-01 21:24:35 UTC
(In reply to Chris Steipp from comment #1)
> Thanks! Was it the same username across those wikis that was invalid? It
> just seems odd that there is exactly 1 invalid name on each wiki you tried.

To clarify, I ran the script on 524 wikis, and the above lines were just the ones that had invalid localnames. I grabbed it manually from the scripts output, and apparently I missed some.

I re-ran it and saved the output this time (/home/legoktm/bad_local_names.txt on terbium). There are 111 entries in total. 

Glancing through it, it looks like most of the users are different except for one which stands out. [[m:Special:CentralAuth/Saerahb]] which has invalid entries on 14 wikis.

> Are you planning to run migratePass0 to make sure localnames has all of the
> local names too?

Yeah, that's a good idea.
Comment 3 Kunal Mehta (Legoktm) 2014-07-07 08:32:26 UTC
542 invalid localnames rows, and 498 invalid localuser rows. 

Most of the bad users in localuser are also present in localnames.
Comment 4 Kunal Mehta (Legoktm) 2014-07-07 08:34:41 UTC
I'll first clean out the bad localnames/localuser rows and then run migratePass0 across all wikis.

We should also check the globalnames table once localnames is fixed.
Comment 5 Kunal Mehta (Legoktm) 2014-07-12 07:40:52 UTC
[12:37:38 AM]  <legoktm>	 !log started running checkLocalNames.php --delete=1 on all CentralAuth wikis for bug 67350
[12:39:20 AM]  <legoktm>	 !log started running checkLocalUser.php --delete=1 on all CentralAuth wikis for bug 67350

I'm guestimating that will take a full day, maybe even the weekend.
Comment 6 Kunal Mehta (Legoktm) 2014-07-12 22:14:17 UTC
Created attachment 15924 [details]
counts of deletions by of checkLocalNames.php
Comment 7 Kunal Mehta (Legoktm) 2014-07-12 22:14:51 UTC
Created attachment 15925 [details]
counts of deletions by checkLocalUser.php
Comment 8 Kunal Mehta (Legoktm) 2014-07-12 22:17:19 UTC
I attached the final counts of how many rows were deleted. I have complete logs including which specific rows were deleted in my home on terbium.

(In reply to Kunal Mehta (Legoktm) from comment #5)
> 
> I'm guestimating that will take a full day, maybe even the weekend.

Or not! I'll start migratePass0 now.
Comment 9 Kunal Mehta (Legoktm) 2014-07-13 02:14:38 UTC
(In reply to Kunal Mehta (Legoktm) from comment #8)

> Or not! I'll start migratePass0 now.

Done.

Now that we know localnames is consistent, we just need to check/fix globalnames. Will need a new script for that.
Comment 10 Nemo 2014-07-13 07:05:01 UTC
Curious that wikidata and nsowiki had so many:

$ grep -E "[0-9]{2,} invalid" attachment.cgi\?id\=15925
enwiki:  2014-07-12 12:08:07 found 50 invalid localuser, 50 (100.0%) deleted
metawiki:  2014-07-12 17:29:59 found 52 invalid localuser, 52 (100.0%) deleted
nsowiki:  2014-07-12 17:43:53 found 84 invalid localuser, 84 (100.0%) deleted
wikidatawiki:  2014-07-12 19:26:20 found 119 invalid localuser, 119 (100.0%) deleted

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links