Last modified: 2014-04-25 23:38:07 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T66240, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 64240 - Using puppet's active_nodes or pybal to determine mobile frontend caches
Using puppet's active_nodes or pybal to determine mobile frontend caches
Status: NEW
Product: Analytics
Classification: Unclassified
General/Unknown (Other open bugs)
unspecified
All All
: Normal normal
: ---
Assigned To: Nobody - You can work on this!
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2014-04-22 13:25 UTC by christian
Modified: 2014-04-25 23:38 UTC (History)
5 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description christian 2014-04-22 13:25:26 UTC
To determine which varnishes we consider "mobile" frontend varnishes
and need to be included into the mobile-sampled-100 stream, we
currently use [1] $active_nodes of from puppet's manifests/role/cache.

But it seems that variable holds only those caches that run both
frontend and backend varnishes. But when bringing new caches online,
it might be that they act only as frontend cache for some time
(manually through pybal), and hence are not yet added to
$active_nodes. Thereby, we loose logs of those
new-and-for-some-time-frontend-only machines.
(As it currently happens for bug 64145.)

Is it worth changing the way we detect mobile frontend varnish for
udp2log from puppet's $active_nodes to pybal?

(I guess no, but just wanted to have this documented somewhere. And as
what we currently do is a bug, hence using Bugzilla)



http://git.wikimedia.org/blob/operations%2Fpuppet.git/14357072e8d15e00a8a47306f92c698ab0a42515/templates%2Fudp2log%2Ffilters.oxygen.erb#L18
Comment 1 Andrew Otto 2014-04-22 13:29:09 UTC
Sure, we can change it.  If there is a better more complete list of nodes somewhere in puppet to use, let's use it!
Comment 2 christian 2014-04-22 17:44:49 UTC
Even if it's not in puppet, but only in pybal?

  http://noc.wikimedia.org/pybal/esams/mobile
  http://noc.wikimedia.org/pybal/ulsfo/mobile
  http://noc.wikimedia.org/pybal/eqiad/mobile
 (http://noc.wikimedia.org/pybal/pmtpa/mobile)

Or are those files somewhere/somehow available through puppet?

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links