Last modified: 2011-05-15 10:05:52 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T28529, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 26529 - Run CodeReview repopulateCodePaths maintenance script on mediawiki wiki
Run CodeReview repopulateCodePaths maintenance script on mediawiki wiki
Status: RESOLVED FIXED
Product: Wikimedia
Classification: Unclassified
Site requests (Other open bugs)
unspecified
All All
: Normal enhancement (vote)
: ---
Assigned To: Roan Kattouw
: shell
Depends on: 23720
Blocks:
  Show dependency treegraph
 
Reported: 2011-01-01 00:41 UTC by Sam Reed (reedy)
Modified: 2011-05-15 10:05 UTC (History)
2 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Sam Reed (reedy) 2011-01-01 00:41:39 UTC
Run CodeReview populateFollowupRevisions maintenance script on mediawiki wiki, so we can use the more efficient path searching :)
Comment 1 Roan Kattouw 2011-01-01 23:32:42 UTC
Could you run this on your local DB and report the table size and #rows before and after?
Comment 2 Sam Reed (reedy) 2011-01-01 23:40:52 UTC
See https://bugzilla.wikimedia.org/show_bug.cgi?id=23720#c7 for rough figures

Just re-ran it now after having updated to latest revisions

mysql> select count(*) from mw_code_paths WHERE cp_repo_id = 3;
+----------+
| count(*) |
+----------+
|  1004172 |
+----------+
1 row in set (7.95 sec)


Seems ~double number of paths
Comment 3 Antoine "hashar" Musso (WMF) 2011-01-16 16:44:15 UTC
Is this normal behaviour? If so, what prevent us from running the script?
Comment 4 Sam Reed (reedy) 2011-01-16 20:55:09 UTC
This is normal behaviour.

The only thing sort of "preventing" us from us from running this, is the code not having been scapped live, allowing us to do somewhat more efficient SQL queries to do path searching, whereas before we're doing an SQL like which filesorts/temporary tables.

Which isn't great. So this changes it so we save all path fragments, and can do an equals, rather than like and other crappy stuff

So this goes through and repopulates the path list, to list all fragments as a separate row per path fragment for a revision commited
Comment 5 Sam Reed (reedy) 2011-01-16 20:55:46 UTC
Bah. So this bug exists as basically a TODO/reminder for Roan :)
Comment 6 Antoine "hashar" Musso (WMF) 2011-01-16 21:13:52 UTC
per IRC, this is pending script deployment on live site.

Assigning to Roan
Comment 7 Roan Kattouw 2011-01-21 03:38:30 UTC
Noted as a scaptrap https://secure.wikimedia.org/wikipedia/mediawiki/wiki/Special:Code/MediaWiki/79379#c13295

I'll need to do this some time before deployment, I guess.
Comment 8 Mark A. Hershberger 2011-01-21 20:43:57 UTC
Should this depend on the 1.17 deployment? Or is this another deployment?
Comment 9 Roan Kattouw 2011-01-24 01:35:38 UTC
(In reply to comment #8)
> Should this depend on the 1.17 deployment? Or is this another deployment?
1.17, yes.
Comment 10 Roan Kattouw 2011-01-24 01:36:18 UTC
(In reply to comment #9)
> (In reply to comment #8)
> > Should this depend on the 1.17 deployment? Or is this another deployment?
> 1.17, yes.
...although I guess it wouldn't hurt to do this earlier and get it out of the way.
Comment 11 Sam Reed (reedy) 2011-01-24 07:05:20 UTC
It will obviously need a followup run later on, just to fully update the newer revs, but that really is a minor issue, and we can choose a rev list, so its not a big deal ;)
Comment 12 Sam Reed (reedy) 2011-01-24 07:15:42 UTC
(In reply to comment #9)
> (In reply to comment #8)
> > Should this depend on the 1.17 deployment? Or is this another deployment?
> 1.17, yes.

Are you going to push all the cr revisions post 1.17 into the 1.17 branch?

As I'm sure this was post branching...

And of course it needs running for all repositorys
Comment 13 Roan Kattouw 2011-01-24 18:08:50 UTC
(In reply to comment #12)
> (In reply to comment #9)
> > (In reply to comment #8)
> > > Should this depend on the 1.17 deployment? Or is this another deployment?
> > 1.17, yes.
> 
> Are you going to push all the cr revisions post 1.17 into the 1.17 branch?
> 
> As I'm sure this was post branching...
> 
> And of course it needs running for all repositorys
It's post-branch? Awesome! Then I won't have to worry about it for another few weeks.
Comment 14 Sam Reed (reedy) 2011-01-24 21:20:23 UTC
Looks like I did it 3 weeks or so later post branch
Comment 15 Sam Reed (reedy) 2011-04-14 12:56:12 UTC
Done

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links