Last modified: 2013-07-24 20:50:22 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T53955, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 51955 - puppet broken on all instances (../private/manifests/passwords.pp does not exist)
puppet broken on all instances (../private/manifests/passwords.pp does not ex...
Status: VERIFIED FIXED
Product: Wikimedia Labs
Classification: Unclassified
Infrastructure (Other open bugs)
unspecified
All All
: Unprioritized critical
: ---
Assigned To: Andrew Bogott
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2013-07-24 11:00 UTC by Antoine "hashar" Musso (WMF)
Modified: 2013-07-24 20:50 UTC (History)
2 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Antoine "hashar" Musso (WMF) 2013-07-24 11:00:09 UTC
Running puppet on any beta instance yield:


err: Could not retrieve catalog from remote server: Error 400 on SERVER: Could not parse for environment production: No file(s) found for import of '../private/manifests/passwords.pp' at /etc/puppet/manifests/base.pp:10 on node i-0000031a.pmtpa.wmflabs
Comment 1 Antoine "hashar" Musso (WMF) 2013-07-24 12:44:52 UTC
The puppet private directory got moved around apparently:

Possible causes:

https://gerrit.wikimedia.org/r/#/c/75503/
https://gerrit.wikimedia.org/r/#/c/75496/
Comment 2 Antoine "hashar" Musso (WMF) 2013-07-24 13:39:15 UTC
https://gerrit.wikimedia.org/r/#/c/75592/ (by Andrew Bogott) sets a symlink
Comment 3 Andrew Bogott 2013-07-24 15:01:17 UTC
The initial problem was that the /etc/puppet symlinks on virt0 were pointing to /var/lib/git/operations/puppet whereas the actual cron-updated repos are in /root/testrepo.  I'd like to standardize on /var/lib/git/operations/ but, for the moment, I've moved the symlinks to point to /root/testrepo.

Alas, now the puppetmaster is doing something altogether new and different:

err: Could not retrieve catalog from remote server: Error 500 on SERVER: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd">

For which the actual error message seems to be:

<dd>Could not prepare for execution: Got 1 failure(s) while initializing: change from absent to directory failed: Could not set 'directory on ensure: File exists - /etc/puppet/manifests
</dd>

Why would the puppetmaster be creating dirs as a result of a query?
Comment 4 Andrew Bogott 2013-07-24 19:28:37 UTC
This mystery is not solved, but vir0 has been rearranged to more-closely resemble the other puppet masters, and is now working properly.
Comment 5 Antoine "hashar" Musso (WMF) 2013-07-24 20:50:16 UTC
Thank you Andrew!

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links