Last modified: 2012-10-31 15:15:47 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T34947, the corresponding Phabricator task for complete and up-to-date bug report information.
First Last Prev Next    This bug is not in your last search results.
Bug 32947 - Indexing broken on WMF private wikis
Indexing broken on WMF private wikis
Status: RESOLVED FIXED
Product: Wikimedia
Classification: Unclassified
lucene-search-2 (Other open bugs)
unspecified
All All
: Unprioritized normal with 1 vote (vote)
: ---
Assigned To: Robert Stojnic
:
Depends on:
Blocks:
  Show dependency tree / graph
 
Reported: 2011-12-10 12:22 UTC by billinghurst
Modified: 2012-10-31 15:15 UTC (History)
8 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---

Attachments
Add an attachment (proposed patch, testcase, etc.)

Description billinghurst 2011-12-10 12:22:35 UTC 
The indexing on the wiki for CUs at WMF seems non-functional in more recent times.  Would someone please check to see if there is an issue.
Comment 1 Robert Stojnic 2011-12-10 12:32:43 UTC 
Indexing of private wikis relies on the following script (on searchidx2):

/home/rainman/scripts/search-import-db

Which uses dumpBackup.php to dump wikis:

mwdir=/home/wikipedia/common/php/
cd $mwdir && php maintenance/dumpBackup.php \
  $dbname \
  --current --quiet \
  --server=$slave > $dumpfile

However, currently this produces an error:

No MWMultiVersion instance initialized! MWScript.php wrapper not used?

Can someone please fix this, so that dumpBackup.php works on searchidx2?
Comment 2 Aaron Schulz 2011-12-12 00:13:15 UTC 
It needs a simple change per http://wikitech.wikimedia.org/view/Hetdeploy#Run_a_maintenance_script_on_a_wiki.
Comment 3 Sam Reed (reedy) 2011-12-12 00:16:55 UTC 
You can run this on fenari for the time being with

mwscript dumpBackup.php $dbname --current --quiet --server=$server > $dumpfile

And then import it locally

Or, just use

/home/wikipedia/common/bin/mwscript dumpBackup.php $dbname --current --quiet --server=$server > $dumpfile

on searchidx2


I think one of the wikimedia shell packages puts it into /usr/local/bin/mwscript etc...
Comment 4 Robert Stojnic 2011-12-12 19:59:30 UTC 
Neither works on searchidx2. 

./search-import-db: line 21: /home/wikipedia/common/bin/mwscript: No such file or directory
Comment 5 Sam Reed (reedy) 2011-12-12 20:04:59 UTC 
Drop the common


reedy@searchidx2:/home/wikipedia/bin$ ls -al mwscript
-rwxrwxr-x 1 aaron wikidev 215 2011-09-16 19:19 mwscript
Comment 6 Robert Stojnic 2011-12-12 21:06:33 UTC 
Ah good, seems to work now, thanks!
Comment 7 Trijnstel 2012-05-02 20:51:36 UTC 
It's now not working on the steward wiki, also a private wiki. Could someone take a look at it please? Thanks in advance. :)
Comment 8 Trijnstel 2012-05-02 20:55:34 UTC 
Oops, I guess I made a mistake. My bad...
Comment 9 Trijnstel 2012-09-10 20:16:21 UTC 
It's not properly working on the checkuser wiki again - and I'm not sure about if it's working correctly on other private wikis as the steward wiki either.

Please help.
Comment 10 Peter Youngmeisterarius 2012-09-11 15:22:29 UTC 
in a recent upgrade of this system, filesystem permissions ended up in a broken state. I have fixed the issues and am running the various jobs that were affected, including indexing of private wikis, by hand. This should complete within a couple of hours (logs are looking normal).

I am going to close this now, but if there are any future issues, please let me know.
Note You need to log in before you can comment on or make changes to this bug.
First Last Prev Next    This bug is not in your last search results.

Navigation
Links