Last modified: 2014-05-27 15:16:55 UTC
Wikimedia's sync scripts should be rewritten. Notes about a rewrite are available at <http://wikitech.wikimedia.org/view/Wmsync>.
MZMcBride: I assume this is superseded/obsolete by using git-deploy - see bug 43338 and http://lists.wikimedia.org/pipermail/wikitech-l/2013-January/065664.html Not sure if that's fully sufficient, as there's no actual bugs or goals described in this bug report, just "rewrite". If so, bug 20085 should also be rechecked.
(In reply to comment #1) > I assume this is superseded/obsolete by using git-deploy - see bug 43338 and > http://lists.wikimedia.org/pipermail/wikitech-l/2013-January/065664.html I'm not sure. Copying Tim and Patrick (Rob L. is already CC'd) to find out. > Not sure if that's fully sufficient, as there's no actual bugs or goals > described in this bug report, just "rewrite". > > If so, bug 20085 should also be rechecked. Yeah... I don't know about the current status of any of this. I know that scap and friends have been around forever and that there are constant calls for a rewrite.
I guess that one depends on git-deploy which is bug 43338
Ori rewrote scap in Python (cf. <https://gerrit.wikimedia.org/r/110904>). I suppose the other scripts still need to be rewritten.
Assigning to Bryan as he's taking the dev lead on this right now. Changed the git-deploy dev tasks tracking bug from 'depends' to a 'see also', mostly to reflect current reality: We're planning to 'complete' the rewrite of scap (and support modules) in python which will inform and feed into the trebuchet (nee git-deploy) work.
Here's what's been done thus far: * scap and friends split out from operations/puppet.git to mediawiki/tools/scap.git * scap and scap-1 scripts converted from bash to python * scap-2 and find-nearest-rsync obsoleted by python code changes * scap now reports failures and aborts to SAL via !log * scap not reports partial failures to SAL via !log * scap no longer uses dsh; replaced by python generator and ssh * scap now reports elapsed time for many stages of push: ** rsync common on tin ** mw-update-l10n on tin ** scap-1 to rsync proxies ** scap-1 to apaches ** scap-rebuild-cdbs on apaches) ** update of apaches (scap-1 + scap-rebuild-cdbs) ** wikiversions.cdb sync ** total scap
I believe that this is resolved since the merge of I08ec8e987225b8e7fb1ae2119a4623383cba4db7. The only scripts left in the scap collection that have not been converted to python at this point are refreshCdbJsonFiles, restart-twemproxy and scap-recompile.
