Last modified: 2014-07-05 08:17:36 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T65939, the corresponding Phabricator task for complete and up-to-date bug report information.
First Last Prev Next    This bug is not in your last search results.
Bug 63939 - Jenkins: write a cronjob to compress old build history console logs
Jenkins: write a cronjob to compress old build history console logs
Status: PATCH_TO_REVIEW
Product: Wikimedia
Classification: Unclassified
Continuous integration (Other open bugs)
wmf-deployment
All All
: Normal enhancement (vote)
: ---
Assigned To: Nobody - You can work on this!
:
Depends on:
Blocks: gallium-backup
  Show dependency tree / graph
 
Reported: 2014-04-15 13:15 UTC by Antoine "hashar" Musso (WMF)
Modified: 2014-07-05 08:17 UTC (History)
4 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---

Attachments
Add an attachment (proposed patch, testcase, etc.)

Description Antoine "hashar" Musso (WMF) 2014-04-15 13:15:59 UTC 
The console logs on gallium are a bit large. Jenkins knows how to read from them when they are compressed using gzip.

Under /var/lib/jenkins/jobs/ we should find any file named "log" which is more than a day old and gzip -9 them.
Comment 1 Gerrit Notification Bot 2014-04-15 14:04:53 UTC 
Change 125991 had a related patch set uploaded by Hashar:
contint: compress Jenkins console logs once per day

https://gerrit.wikimedia.org/r/125991
Comment 2 Antoine "hashar" Musso (WMF) 2014-05-06 15:02:33 UTC 
Need to think about it, the tree traversal is a bit too long.
Comment 3 Gerrit Notification Bot 2014-07-05 08:17:36 UTC 
Change 125991 abandoned by Hashar:
contint: compress Jenkins console logs once per day

Reason:
Abandoning the change. The find command takes 5 hours to traverse the hierarchy and compress a few files.  Meanwhile, that cause high CPU and I/O on the gallium server which has a bunch of interesting side effects such as: Jenkins dieing, jobs timeout etc.

Instead of compressing. I will just kill the job history after a few months.

https://gerrit.wikimedia.org/r/125991
Note You need to log in before you can comment on or make changes to this bug.
First Last Prev Next    This bug is not in your last search results.

Navigation
Links