Last modified: 2014-09-02 11:21:21 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T22800, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 20800 - Cronjob setup for LocalisationUpdate
Cronjob setup for LocalisationUpdate
Status: RESOLVED FIXED
Product: Wikimedia
Classification: Unclassified
Deployment systems (Other open bugs)
unspecified
All All
: Normal normal (vote)
: ---
Assigned To: Fred Vassard
https://wikitech.wikimedia.org/view/L...
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2009-09-25 00:16 UTC by Brion Vibber
Modified: 2014-09-02 11:21 UTC (History)
5 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Brion Vibber 2009-09-25 00:16:02 UTC
LocalisationUpdate needs a couple of batch jobs to be set up to get the updates running periodically:

1) /home/wikipedia/bin/l10nupdate needs to run periodically (let's say every 24h initially) on a batch server, let's say hume.

A cron job should be fine there.


2) All mediawiki-installation group boxes need to update their /apache/common/wmf-deployment/cache/l10n directory from the master copy in /home/wikipedia/common/wmf-deployment/cache/l10n after that script runs to update them.

I'm not sure if this would be better to do in puppet, or just a regular cron job... or puppet setting up the cron job. ;)

Anyway without this bit, the localizations won't update until someone does a manual sync of the whole common or PHP deployment dir.
Comment 1 Fred Vassard 2009-09-25 16:28:20 UTC
It looks like the script generate a lot of output. Do you want said output to be emailed to you, logged somewhere or disregarded? 
Setting up puppet to add a cron job to each box should be pretty straightforward :)
Comment 2 Fred Vassard 2009-09-25 16:38:43 UTC
Regarding #2, since most apache server are home-less, I am assuming you meant /usr/local/apache/common/... :) 
So would croning something like "rsync -a --delete 10.0.5.8::common/wmf-deployment/cache/l10n/ /usr/local/apache/common/wmf-deployment/cache/l10n/" on every apache host after the main cron-job is ran suffice?

Comment 3 Brion Vibber 2009-09-25 16:41:01 UTC
We can stick --quiet on the PHP callout in l10nupdate to reduce the output volume. Probably should have it log to a file if there is any output though.

And yes, pulling from the rsync would be ideal. :)

Comment 4 Fred Vassard 2009-09-25 17:25:19 UTC
Both cron jobs have been setup.
The update process will be logged in /var/log/l10nupdate and be over-written at every run.
I have also added a date line in the update script (/home/wikipedia/bin/l10nupdate) so that the log make sense.
Right now, it is setup to run the update on Hume at 2:00am and the cron jobs on the app-server cluster are setup to run at 3:00am (GMT)

Let me know if there is anything else!


Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links