Last modified: 2014-04-28 15:57:32 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T64836, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 62836 - Make use of twemproxy
Make use of twemproxy
Status: RESOLVED FIXED
Product: Wikimedia Labs
Classification: Unclassified
deployment-prep (beta) (Other open bugs)
unspecified
All All
: Unprioritized enhancement
: ---
Assigned To: Sam Reed (reedy)
:
Depends on:
Blocks: 51494
  Show dependency treegraph
 
Reported: 2014-03-19 15:29 UTC by Antoine "hashar" Musso (WMF)
Modified: 2014-04-28 15:57 UTC (History)
6 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Antoine "hashar" Musso (WMF) 2014-03-19 15:29:30 UTC
The beta cluster application servers are using a list of memcached box. Production uses a local memcached proxy on each of the application server known as twemproxy.


twemproxy is already installed on beta instances but we have to figure out its configuration as well as the MediaWiki configuration parameters.
Comment 1 Sam Reed (reedy) 2014-03-19 21:27:34 UTC
Config https://noc.wikimedia.org/conf/highlight.php?file=twemproxy-eqiad.yaml

modules/generic/files/upstart/twemproxy.conf

exec /usr/local/bin/nutcracker -m 65536 -a 127.0.0.1 -c "/usr/local/apache/common/wmf-config/twemproxy-$(cat /etc/wikimedia-site).yaml"

Just needs a bit more variance, and/or checking like getRealmSpecificFilename() in php
Comment 2 Antoine "hashar" Musso (WMF) 2014-03-21 20:42:22 UTC
Sam would you take care of it ?  twemproxy and our memcached setup are totally unknown to me :-/
Comment 3 Andre Klapper 2014-04-25 05:21:11 UTC
Reedy: ping comment 2?
Comment 4 Gerrit Notification Bot 2014-04-25 07:58:41 UTC
Change 129641 had a related patch set uploaded by Reedy:
WIP: Initial twemproxy configs for labs

https://gerrit.wikimedia.org/r/129641
Comment 5 Sam Reed (reedy) 2014-04-25 08:11:52 UTC
Need variance for -labs, AND for hhvm... Using /etc/wikimedia-realm

For which multiversion/MWRealm.sh exists!

Though, I suspect it won't run 2 versions of twemproxy without some updates. To that extent, I wonder if we should just have it for
Comment 6 Gerrit Notification Bot 2014-04-25 08:22:46 UTC
Change 129644 had a related patch set uploaded by Reedy:
Variable twemproxy config location

https://gerrit.wikimedia.org/r/129644
Comment 7 Gerrit Notification Bot 2014-04-25 09:10:33 UTC
Change 129644 merged by Alexandros Kosiaris:
Vary twemproxy config location based on getRealmSpecificFilename()

https://gerrit.wikimedia.org/r/129644
Comment 8 Gerrit Notification Bot 2014-04-25 09:41:14 UTC
Change 129641 merged by jenkins-bot:
Initial twemproxy configs for labs

https://gerrit.wikimedia.org/r/129641
Comment 9 Gerrit Notification Bot 2014-04-25 10:47:03 UTC
Change 129663 had a related patch set uploaded by Reedy:
Vary twemproxy config location based on getRealmSpecificFilename() (take 2)

https://gerrit.wikimedia.org/r/129663
Comment 10 Gerrit Notification Bot 2014-04-28 14:46:58 UTC
Change 129663 merged by Giuseppe Lavagetto:
Vary twemproxy config location based on getRealmSpecificFilename() (take 2)

https://gerrit.wikimedia.org/r/129663
Comment 11 Sam Reed (reedy) 2014-04-28 15:57:32 UTC
Merged, deployed and tested...

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links