Last modified: 2012-02-09 21:13:19 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T27427, the corresponding Phabricator task for complete and up-to-date bug report information.
First Last Prev Next    This bug is not in your last search results.
Bug 25427 - Make squid logger (udp2log) more scalable
Make squid logger (udp2log) more scalable
Status: RESOLVED FIXED
Product: Wikimedia
Classification: Unclassified
General/Unknown (Other open bugs)
unspecified
All All
: Normal enhancement (vote)
: ---
Assigned To: Nimish Gautam
:
Depends on:
Blocks:
  Show dependency tree / graph
 
Reported: 2010-10-05 19:44 UTC by Rob Lanphier
Modified: 2012-02-09 21:13 UTC (History)
4 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---

Attachments
udp2log-domas-multithread-2010-10-05.patch (5.82 KB, patch)
2010-10-05 19:44 UTC, Rob Lanphier 		Details
Add an attachment (proposed patch, testcase, etc.)

Description Rob Lanphier 2010-10-05 19:44:46 UTC 
Created attachment 7716 [details]
udp2log-domas-multithread-2010-10-05.patch

Currently, our squid logging solution (udp2log) will start dropping packets when the configuration gets slightly complicated.  This has limited our ability to log many things we'd like to log.

Given that the machine running udp2log (locke) isn't CPU-bound yet, we believe we can gain some headway by making udp2log multithreaded.

More details about the logger itself can be found here:
http://wikitech.wikimedia.org/view/Squid_logging

More details about this task can be found here:
http://lists.wikimedia.org/pipermail/wikitech-l/2010-August/048844.html

Additionally, Domas has already worked up an initial patch for this, which is attached.
Comment 1 Rob Lanphier 2010-12-01 23:18:51 UTC 
Nimish has a version of this that uses multicast rather than changing to using threading.
Comment 2 Marcin Cieślak 2011-03-12 23:38:25 UTC 
Multicast UDP logging can be built on top frameworks like Spread (http://www.spread.org/docspread.html). Just FYI.
Comment 3 p858snake 2011-04-30 00:10:08 UTC 
*Bulk BZ Change: +Patch to open bugs with patches attached that are missing the keyword*
Comment 4 Rob Lanphier 2012-02-09 21:13:19 UTC 
This work was done a while back
Note You need to log in before you can comment on or make changes to this bug.
First Last Prev Next    This bug is not in your last search results.

Navigation
Links