Last modified: 2014-10-29 19:15:06 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T51779, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 49779 - sync articles from production wikis (css/gadgets)
sync articles from production wikis (css/gadgets)
Status: NEW
Product: Wikimedia Labs
Classification: Unclassified
deployment-prep (beta) (Other open bugs)
unspecified
All All
: Lowest enhancement
: ---
Assigned To: Nobody - You can work on this!
:
Depends on: 57117
Blocks: 47205 52382
  Show dependency treegraph
 
Reported: 2013-06-18 22:07 UTC by Antoine "hashar" Musso (WMF)
Modified: 2014-10-29 19:15 UTC (History)
9 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Antoine "hashar" Musso (WMF) 2013-06-18 22:07:30 UTC
MaxSem wrote a small shell script triggered by a cron and maintained in puppet https://gerrit.wikimedia.org/r/#/c/68309/

Given a list of wikis / articles, the script will each day copy them to a beta wiki.


The point of that bug is to migrate that under Jenkins, that will let us tweak the job easily without relying on ops to merge our change and will also let us trigger the sync manually by rerunning the job.
Comment 1 Greg Grossmeier 2013-08-15 17:42:59 UTC
The Parsoid team has a list of about 160,000 pages from various language wikis (largest portion being from English WP) that they test their round tripping on. This list would probably be a great list to have auto-pulled into beta for general purpose testing.

See http://parsoid.wmflabs.org:8001/ for parsoid's use of it.
Comment 2 C. Scott Ananian 2013-08-15 17:55:59 UTC
Alternatively, a small script might spider two or three deep from Main_Page.  That might give a good set of "likely to be high traffic" pages.
Comment 3 Greg Grossmeier 2013-09-18 16:53:09 UTC
Assigning Ariel since we've been talking about how to do this recently and they're working on it.
Comment 4 Greg Grossmeier 2013-09-18 22:14:12 UTC
For a list of high priority languages from Asaf, which I'd just trust blindly since I have no real domain knowledge, see this pdf:
https://commons.wikimedia.org/wiki/File:WMF%27s_New_Global_South_Strategy.pdf
(specifically, page 18)

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links