Last modified: 2014-11-19 16:06:37 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T57412, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 55412 - Jenkins: report metrics to statsd
Jenkins: report metrics to statsd
Status: RESOLVED FIXED
Product: Wikimedia
Classification: Unclassified
Continuous integration (Other open bugs)
wmf-deployment
All All
: Unprioritized normal (vote)
: ---
Assigned To: Nobody - You can work on this!
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2013-10-07 15:59 UTC by Antoine "hashar" Musso (WMF)
Modified: 2014-11-19 16:06 UTC (History)
3 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Antoine "hashar" Musso (WMF) 2013-10-07 15:59:01 UTC
bug 47884  was requesting some metrics to be reported regarding Jenkins using statsd.  Since it was not possible at that time, the workaround was to use a Ganglia plugin (for gallium, the current Jenkins master: http://ganglia.wikimedia.org/latest/?c=Miscellaneous%20eqiad&h=gallium.wikimedia.org)

We recently reenabled statsd in the infrastructure using tungsten.eqiad.wmnet as an entry point.  Hence I am copy pasting the original bug 47884 request:

----------------------------------------------------
Someone wrote a script to run in a cron that would send metrics about Jenkins
build executors:

http://velohacker.com/2012/01/12/graphing-jenkins-statistics/

https://github.com/katzj/jenkins-to-graphite

Would be nice to use this. We can then display the graph on the integration
portal or zuul status page.
----------------------------------------------------
Comment 1 Antoine "hashar" Musso (WMF) 2013-10-22 09:15:40 UTC
I have deployed the plugin a few days ago. The stats are send to Statsd and available in graphite under:

stats.jenkins.ci
stats.timers.jenkins.ci

Not sure what to do with them now though.
Comment 2 Antoine "hashar" Musso (WMF) 2013-10-22 09:25:19 UTC
Note, I have build the jenkins-statsd-plugin available at https://github.com/joemiller/jenkins-statsd-plugin using the statsd prefix jenkins.ci

There is no informations regarding the jobs executors/queue status as provided by https://github.com/katzj/jenkins-to-graphite  

I have filled https://github.com/joemiller/jenkins-statsd-plugin/issues/5 to ask features from the jenkins-to-graphite script to be ported in the Java plugin.
Comment 3 Antoine "hashar" Musso (WMF) 2013-10-22 09:27:02 UTC
Filled as bug 55988
Comment 4 Antoine "hashar" Musso (WMF) 2014-11-19 16:06:37 UTC
We are no more using this plugin. It was meant to generate graph for the executor queues but the Jenkins plugin does not collect them. Since reporting a metric for each of the jobs overkills Graphite, the plugin has been removed.

See:

https://phabricator.wikimedia.org/T1075 "something (reqstats?) puts many different metrics into graphite, allocating a lot of disk space"
https://phabricator.wikimedia.org/T1278 "Remove statsd plugin from Jenkins"

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links