Last modified: 2014-07-03 13:12:11 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T68402, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 66402 - Import some content on beta.wmflabs.org wikis
Import some content on beta.wmflabs.org wikis
Status: RESOLVED WONTFIX
Product: Wikimedia Labs
Classification: Unclassified
deployment-prep (beta) (Other open bugs)
unspecified
All All
: Low enhancement
: ---
Assigned To: Nobody - You can work on this!
http://dumps.wikimedia.org/
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2014-06-10 06:27 UTC by Nemo
Modified: 2014-07-03 13:12 UTC (History)
9 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Nemo 2014-06-10 06:27:28 UTC
When trying to use beta.wmflabs.org to test (https://www.mediawiki.org/wiki/Thread:Talk:PDF_rendering/Test_instance_and_bug_triage ), I noticed that only simple.wiki got content imported and he.wiki has a partial import (3k pages).

All articles and templates (if not all pages), current version, need to be imported on the following existing wikis: ar de en eo fa hi ja ko ru sq uk zh. Or you could leave en aside as it's so big and we already have simple in English anyway.

https://meta.wikimedia.org/wiki/Data_dumps/Tools_for_importing can be of use. Needs to be done server-side because Special:Import timeouts after few dozens MB.
Comment 1 Antoine "hashar" Musso (WMF) 2014-06-10 08:04:28 UTC
The beta cluster is not powerful enough to be a close copy of the production wikis. En and de would definitely not fit on the small database server.

Moreover, I am not sure there is a point in having the millions of pages imported if they are never going to be accessed / used.

If there is a specific need, one can export pages they are interested in and manually import them on the wikis.


So unless there is a specific testing needs to import all the pages, I am willing to discard this request :D
Comment 2 Nemo 2014-06-10 08:38:13 UTC
(In reply to Antoine "hashar" Musso from comment #1)
> If there is a specific need, one can export pages they are interested in and
> manually import them on the wikis.

This is disproved by reality. The one time I had to import something on a wiki, timeouts disallowed me to. Do you have proposals on how to integrate page + templates import of test cases *during* a bug triage.

If you want to go through https://etherpad.wikimedia.org/p/BugTriage-mwlib and determine all the test cases that need to be produced beforehand, feel free to.
Comment 3 Andre Klapper 2014-06-11 09:58:06 UTC
"Import some content" sounds valid but blocked by beta cluster not powerful enough (comment 1).

Nemo: What is the criteria for "ar de en eo fa hi ja ko ru sq uk zh"? Could that list be shortened && a partial import of some of their pages?
Comment 4 Nemo 2014-06-11 10:04:16 UTC
(In reply to Andre Klapper from comment #3)
> Nemo: What is the criteria for "ar de en eo fa hi ja ko ru sq uk zh"? 

Just the list of existing and empty wikis.

> Could
> that list be shortened 

I have no idea how the wikis to create were chosen, i.e. what are the wikis "we care about" in beta.

> && a partial import of some of their pages?

There is no secure recursive import feature, so at least all templates and modules would need to be imported anyway. Maybe ns0 pages could be randomly selected, but I'm not going to engage in XML surgery.
Comment 5 Antoine "hashar" Musso (WMF) 2014-07-03 13:11:57 UTC
There is no need to import the whole prod wiki on beta.  If there is a need for  a bulk import of some contents, we can use the command line utilities to export from prod and import on beta.

Hence I am closing this bug.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links