Last modified: 2014-11-19 21:08:48 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T55594, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 53594 - Jenkins: Configure jobs to be runnable on any slaves
Jenkins: Configure jobs to be runnable on any slaves
Status: RESOLVED FIXED
Product: Wikimedia
Classification: Unclassified
Continuous integration (Other open bugs)
wmf-deployment
All All
: High enhancement (vote)
: ---
Assigned To: Antoine "hashar" Musso (WMF)
:
Depends on: 53683 54762 56317
Blocks: 45499
  Show dependency treegraph
 
Reported: 2013-08-30 15:28 UTC by Antoine "hashar" Musso (WMF)
Modified: 2014-11-19 21:08 UTC (History)
4 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Antoine "hashar" Musso (WMF) 2013-08-30 15:28:49 UTC
This is about configuring Jenkins jobs so they can be executed on the Jenkins slaves.

1) update defaults: use-zuul  to defaults: use-remote-zuul

2) reconfigure all impacted jobs

3) on lanthanum apply the labels hasSlaveScripts hasContintPackages productionSlaves
Comment 1 Antoine "hashar" Musso (WMF) 2013-08-30 15:30:04 UTC
migrate python jobs to be runnable by slaves
https://gerrit.wikimedia.org/r/#/c/81936/

Should do the same for all job-templates having defaults: use-zuul
Comment 2 Antoine "hashar" Musso (WMF) 2013-09-03 12:36:55 UTC
The feature rely on using git clone with --reference which is bugged with the git version we have on our server. See bug 53683 which is a blocker.
Comment 3 Antoine "hashar" Musso (WMF) 2013-09-18 22:39:49 UTC
Migrating jobs ...
Comment 4 Antoine "hashar" Musso (WMF) 2013-09-19 02:45:47 UTC
I have migrated much of the jobs over european night.  Still have to update the parsoid and mediawiki one and fix the remaining one.

We will soon be able to let jobs roam freely :-]
Comment 5 Antoine "hashar" Musso (WMF) 2013-10-22 09:37:20 UTC
Still blocked by PHPUnit / pear packages not being available on slaves (bug 54762).

Removing myself as an assignee of this tracking bug to clear up my bugzilla dashboard. Will assign myself to the blocking bug.
Comment 6 Gerrit Notification Bot 2013-10-30 10:23:22 UTC
Change 92625 had a related patch set uploaded by Hashar:
label some jobs needing PHPUnit

https://gerrit.wikimedia.org/r/92625
Comment 7 Gerrit Notification Bot 2013-10-30 10:24:02 UTC
Change 92625 merged by jenkins-bot:
label some jobs needing PHPUnit

https://gerrit.wikimedia.org/r/92625
Comment 8 Gerrit Notification Bot 2013-10-30 10:29:50 UTC
Change 92626 had a related patch set uploaded by Hashar:
/var/lib/jenkins -> /srv/slave-scripts

https://gerrit.wikimedia.org/r/92626
Comment 9 Gerrit Notification Bot 2013-10-30 10:30:26 UTC
Change 92626 merged by jenkins-bot:
/var/lib/jenkins -> /srv/slave-scripts

https://gerrit.wikimedia.org/r/92626
Comment 10 Antoine "hashar" Musso (WMF) 2013-11-05 13:35:57 UTC
PHPUnit got fixed by using integration/phpunit.git  Need to do the same with php code sniffer.
Comment 11 Antoine "hashar" Musso (WMF) 2013-11-13 10:44:04 UTC
phpcs added in a git repository with https://gerrit.wikimedia.org/r/95134
Comment 12 Gerrit Notification Bot 2013-11-13 10:49:29 UTC
Change 95137 had a related patch set uploaded by Hashar:
deployment: integration/phpcs for Jenkins CI slaves

https://gerrit.wikimedia.org/r/95137
Comment 13 Gerrit Notification Bot 2013-11-13 10:54:33 UTC
Change 95137 merged by Mark Bergsma:
deployment: integration/phpcs for Jenkins CI slaves

https://gerrit.wikimedia.org/r/95137
Comment 14 Antoine "hashar" Musso (WMF) 2013-11-13 10:57:35 UTC
Waiting for the phpcs repository to be populated on the deployment server tin.eqiad.wmnet. Once done, one will be able to deploy phpcs on the slaves and then we will have to update the Jenkins jobs and slave scripts to point to that deployed installation.
Comment 15 Antoine "hashar" Musso (WMF) 2013-11-13 16:34:10 UTC
https://gerrit.wikimedia.org/r/#/c/95172/ switched the shell wrapper script around phpcs to use the deployed version.

Nothing left to do :]

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links