Last modified: 2014-08-15 15:48:47 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T71602, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 69602 - diamond does not compress its logs
diamond does not compress its logs
Status: RESOLVED WONTFIX
Product: Wikimedia Labs
Classification: Unclassified
Infrastructure (Other open bugs)
unspecified
All All
: Normal normal
: ---
Assigned To: Nobody - You can work on this!
: ops
Depends on:
Blocks: 69601
  Show dependency treegraph
 
Reported: 2014-08-15 12:30 UTC by Antoine "hashar" Musso (WMF)
Modified: 2014-08-15 15:48 UTC (History)
7 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Antoine "hashar" Musso (WMF) 2014-08-15 12:30:11 UTC
The python stats collector diamond does not compress its log under /var/log/diamond/ . That might lead to /var/ filling up entirely (it is only 2GB).

We might need diamond to compress logs, or a cronjob to gzip them if it can't compress them.  Also want to make sure we dont keep too many archives.
Comment 1 Yuvi Panda 2014-08-15 15:48:04 UTC
This used to happen really consistently (see bug 66458). We 'fixed' it by essentially making diamond log only on errors, which shouldn't happen often. The role also realm-branches in labs to only keep one day of logs, vs prod where we keep more. Closing as wontfix for now.
Comment 2 Yuvi Panda 2014-08-15 15:48:47 UTC
You might have leftover archive.log and diamond.log files from before the fixes. If so, feel free to rm -rf them, diamond won't re-create.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links