Last modified: 2014-09-27 07:30:15 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T71976, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 69976 - deployment-mediawiki02 labs instance only has 2GB of disk
deployment-mediawiki02 labs instance only has 2GB of disk
Status: NEW
Product: Wikimedia Labs
Classification: Unclassified
deployment-prep (beta) (Other open bugs)
unspecified
All All
: Unprioritized major
: ---
Assigned To: Nobody - You can work on this!
:
Depends on:
Blocks: 69601
  Show dependency treegraph
 
Reported: 2014-08-25 14:41 UTC by Antoine "hashar" Musso (WMF)
Modified: 2014-09-27 07:30 UTC (History)
9 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Antoine "hashar" Musso (WMF) 2014-08-25 14:41:01 UTC
deployment-mediawiki02 labs instance only has 2GB of disk.  The hhvm upstart process emits log to /var/log/upstart/hhvm.log which contains a bunch of php notices.  That is also send to syslog ( /var/log/syslog/ ) creating a snowball effect that completely fill up /var/.

The hhvm upstart job should probably discard anything that is below the 'error' level and the notices be sent to a central syslog.
Comment 1 Chris McMahon 2014-08-25 14:43:26 UTC
changed importance to "major", this makes beta hard to use for real people and causes a lot of false test failures.
Comment 2 Antoine "hashar" Musso (WMF) 2014-08-25 14:45:39 UTC
Bryan told me the log issue is apparently fixed in production.  Since mediawiki02 does not run puppet, it is not taking in account the recent changes made in operations/puppet.git :-(
Comment 3 Antoine "hashar" Musso (WMF) 2014-09-15 13:55:41 UTC
I think puppet is now passing on the hhvm instances.  I am not sure where the log are written to though.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links