Last modified: 2014-10-15 23:22:41 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T74102, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 72102 - Inherent dropping of messages during deployment of webstatscollector on 2014-10-15
Inherent dropping of messages during deployment of webstatscollector on 2014-...
Status: RESOLVED WONTFIX
Product: Analytics
Classification: Unclassified
General/Unknown (Other open bugs)
unspecified
All All
: Unprioritized normal
: ---
Assigned To: Nobody - You can work on this!
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2014-10-15 22:53 UTC by christian
Modified: 2014-10-15 23:22 UTC (History)
5 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description christian 2014-10-15 22:53:42 UTC
In order to redeploy webstatscollector, both the filter and the
collector process need to be restarted, which causes the messages that
have already been collected during this hour to get dropped.

To minimize message loss around the deployment of the fixes for bug
66352 and bug 71790, we waited until

  http://dumps.wikimedia.org/other/pagecounts-raw/2014/2014-10/pagecounts-20141015-190000.gz
  http://dumps.wikimedia.org/other/pagecounts-raw/2014/2014-10/projectcounts-20141015-190000

got written to disk (19:00:30) and then restarted webstatscollector's
filter and collector. On 19:02:30 both filter and collector were
running again.

So total loss is <2 minutes.
Comment 1 christian 2014-10-15 22:54:57 UTC
Note that this only affects the files in 

 http://dumps.wikimedia.org/other/pagecounts-raw

. The files in

 http://dumps.wikimedia.org/other/pagecounts-all-sites

are not affected.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links