Last modified: 2014-02-26 12:54:56 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T51723, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 49723 - EventLogging on the beta cluster should work well and match production (tracking)
EventLogging on the beta cluster should work well and match production (track...
Status: RESOLVED FIXED
Product: Analytics
Classification: Unclassified
EventLogging (Other open bugs)
unspecified
All All
: Normal normal
: ---
Assigned To: Ori Livneh
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2013-06-17 23:34 UTC by Ori Livneh
Modified: 2014-02-26 12:54 UTC (History)
13 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Ori Livneh 2013-06-17 23:34:50 UTC
Quick TODOs:
* Make sure back-end works well on labs
* Fix issue with NavigationTiming (awjr reported breakage on test2wiki)
* Sort out test2wiki (it's its own schema wiki, and I don't know if that makes sense.)
Comment 1 Chris McMahon 2013-06-17 23:38:28 UTC
I'd really like to see EL on beta labs, but test2 is a peer node to production wikis and beta labs is entirely separate from production, so this seems confusing.
Comment 2 Ori Livneh 2013-06-17 23:44:24 UTC
(In reply to comment #1)
> I'd really like to see EL on beta labs, but test2 is a peer node to
> production wikis and beta labs is entirely separate from production,
> so this seems confusing.

Yes, you're right -- I'm conflating things. I'll file a separate bug for test2 later. This bug is (or ought to be) about the beta cluster.
Comment 3 Ori Livneh 2013-06-18 23:12:02 UTC
This is mostly done now. The beta cluster will now log client-side events to http://bits.beta.wmflabs.org/event.gif. A varnishncsa instance on that host forwards events to deployment-eventlogging.pmtpa.wmflabs:8422. Server-side events are sent via UDP directly to deployment-eventlogging.pmtpa.wmflabs:8421. You can run 'zsub localhost:8600' on deployment-eventlogging to watch incoming events. (Be mindful of the fact that varnishncsa buffers and delivers events in batches; you may need to generate several events before yours appears.)

Still outstanding: writing event data to MongoDB & MySQL.
Comment 4 Arthur Richards 2013-06-25 00:23:09 UTC
For some reason, we're still getting a JS error on mobile pages (from http://en.m.wikipedia.beta.wmflabs.org/wiki/Main_Page?debug=true):
Uncaught Error: Unknown dependency: ext.eventLogging load.php:10078
sortDependencies load.php:10078
sortDependencies load.php:10110
resolve load.php:10133
mw.loader.load load.php:11023
(anonymous function)  Main_Page:225

What could be causing this? This is blocking mobile web from testing on betalabs.
Comment 5 Arthur Richards 2013-06-25 01:26:41 UTC
$wgMFLogEvents was set to false on betalabs which sets the ext.EventLogging target to desktop. However, NavigationTiming was still calling ext.EventLogging as a dependency. Ori set $wgMFLogEvents = true on betalabs, problem solved. I'll be filing a separate bug for bad behavior in MobileFrontend when $wgMFLogEvents === false.
Comment 6 Arthur Richards 2013-06-25 01:29:19 UTC
Added MobileFrontend bug 50145
Comment 7 Jon 2013-06-26 00:18:11 UTC
Is this done now?
Comment 8 Arthur Richards 2013-06-26 17:17:53 UTC
(In reply to comment #7)
> Is this done now?

Jon, Ori's last comment suggests that there is still a bit more to do.
Comment 9 Jon 2013-07-12 17:44:42 UTC
Ori what is the status of "event data to MongoDB & MySQL." ?
I've posted a fix for bug 50145
Comment 10 Ori Livneh 2013-07-12 20:19:22 UTC
(In reply to comment #9)
> Ori what is the status of "event data to MongoDB & MySQL." ?
> I've posted a fix for bug 50145

https://gerrit.wikimedia.org/r/#/c/71927/ brings us 90% there. It's scheduled to go out Monday at 20:00 UTC. If it goes smoothly I may try to squeeze MongoDB / MySQL configs for labs into the same window.
Comment 11 Gerrit Notification Bot 2013-07-16 22:54:41 UTC
Change 74085 had a related patch set uploaded by Ori.livneh:
Make role::eventlogging realm-aware

https://gerrit.wikimedia.org/r/74085
Comment 12 Gerrit Notification Bot 2013-07-16 23:34:05 UTC
Change 74085 merged by Ryan Lane:
Make role::eventlogging realm-aware

https://gerrit.wikimedia.org/r/74085
Comment 13 Ori Livneh 2013-07-17 04:01:45 UTC
This is now complete; applying 'role::eventlogging' correctly provisions EventLogging. deployment-eventlogging.pmtpa.wmflabs is running the full setup: events logged via //bits.beta.wmflabs.org/event.gif are written to log files in /var/log/eventlogging and to local MySQL and MongoDB instances. Many thanks to MaxSem for getting the ball rolling and doing much of the initial work.
Comment 14 Andre Klapper 2014-02-26 12:54:56 UTC
[moving from MediaWiki extensions to Analytics product - see bug 61946]

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links