Last modified: 2012-04-19 02:09:11 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T28203, the corresponding Phabricator task for complete and up-to-date bug report information.
First Last Prev Next    This bug is not in your last search results.
Bug 26203 - update search index and cached data on de.ws
update search index and cached data on de.ws
Status: RESOLVED FIXED
Product: Wikimedia
Classification: Unclassified
lucene-search-2 (Other open bugs)
unspecified
All All
: High enhancement (vote)
: ---
Assigned To: Robert Stojnic
:
Depends on:
Blocks:
  Show dependency tree / graph
 
Reported: 2010-12-02 14:09 UTC by enomil
Modified: 2012-04-19 02:09 UTC (History)
6 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---

Attachments
Add an attachment (proposed patch, testcase, etc.)

Description enomil 2010-12-02 14:09:27 UTC 
The search index on de.ws is from march 2010. Whit that nobody can really work (since march we have ~20.000 new pages and a few moved pages whit deleted redirects).

So update the Special:Search.

Also Special: pages with the last update from Ocotber 2009:

Special:AncientPages
Special:CrossNamespaceLinks
Special:DeadendPages
Special:FewestRevisions
Special:MostLinkedPages
Special:MostRevisions
Special:WantedPages
Comment 1 Roan Kattouw 2010-12-02 14:17:55 UTC 
(In reply to comment #0)
> The search index on de.ws is from march 2010. Whit that nobody can really work
> (since march we have ~20.000 new pages and a few moved pages whit deleted
> redirects).
> 
> So update the Special:Search.
>
Isn't the search index supposed to update itself?
Comment 2 Robert Stojnic 2010-12-02 14:22:09 UTC 
The indexing seems to be stuck because Special:OAIRepository returns 500 on this request:

http://de.wikisource.org/w/index.php?title=Special:OAIRepository&verb=ListRecords&metadataPrefix=mediawiki&from=2010-03-17T21:09:10Z

I tried other dates, but they seem to work, so maybe it's some kind of strange database problem? I will bump the refresh date forward to continue indexing, but if someone has time could you please check what is wrong? 

You can find the user/pass for OAIRepository in /etc/lsearch.conf on searchidx1

r.
Comment 3 Robert Stojnic 2010-12-11 15:44:04 UTC 
Roan looked at the error logs, and I submitted his findings as bug 26304. 

Skipping forward in time didn't work because the error reoccurred. Instead, I added another cronjob to searchidx1 to specifically handle dewikisource by rebuilding it completely from XML dumps on daily basis. The complete rebuild takes about 1h.

Thus, marking this as fixed.
Comment 4 enomil 2011-10-06 13:48:48 UTC 
It seems like the cronjob does not work anymore since middle/late september, for example "Julius Ailio" from 13:28 (CEST), 29. Sep. 2011 and later new entries cannot be find.
Comment 5 Michail Jungierek 2011-12-10 00:54:11 UTC 
The search index is outdated now since over 3 month. Please rebuild (or whatever you have to do) the search index or fix the bug that the rebuild is not succesfull. All new texts on de-Wikisource since september can't find by anybody.
Comment 6 Robert Stojnic 2011-12-10 12:56:59 UTC 
Probably same issue as Bug 32947
Comment 7 Robert Stojnic 2011-12-13 17:20:19 UTC 
Seems to be fixed now, can you verify?
Comment 8 Michail Jungierek 2011-12-13 18:28:03 UTC 
Thanks, it looks ok now.
Note You need to log in before you can comment on or make changes to this bug.
First Last Prev Next    This bug is not in your last search results.

Navigation
Links