Last modified: 2013-03-26 11:24:09 UTC

Wikimedia Bugzilla is closed!

Wikimedia has migrated from Bugzilla to Phabricator. Bug reports should be created and updated in Wikimedia Phabricator instead. Please create an account in Phabricator and add your Bugzilla email address to it.
Wikimedia Bugzilla is read-only. If you try to edit or create any bug report in Bugzilla you will be shown an intentional error message.
In order to access the Phabricator task corresponding to a Bugzilla report, just remove "static-" from its URL.
You could still run searches in Bugzilla or access your list of votes but bug reports will obviously not be up-to-date in Bugzilla.
Bug 2794 - MWUpdateDaemon doesn't delete old entries properly
MWUpdateDaemon doesn't delete old entries properly
Product: Wikimedia
Classification: Unclassified
lucene-search-2 (Other open bugs)
All All
: Normal normal (vote)
: ---
Assigned To: Brion Vibber
Depends on:
  Show dependency treegraph
Reported: 2005-07-11 04:49 UTC by Brion Vibber
Modified: 2013-03-26 11:24 UTC (History)
2 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Description Brion Vibber 2005-07-11 04:49:59 UTC
When pages get edited multiple times during indexing, duplicate entries end up getting inserted.

Lucene's inability to read and write on the same index makes this unnecessarily difficult to do right. Placing 
updates on our own per-database queues, replacing duplicates during that time, and then applying 
updates direct instead of through an in-memory directory might work reasonably well.
Comment 1 Brion Vibber 2005-07-11 05:23:16 UTC
As a temporary workaround, I've hacked the daemon to skip over duplicate results.
(They need to be adjacent in the results to actually get skipped over.)
Comment 2 Dan Li 2006-08-16 17:30:10 UTC
(In reply to comment #0)
> When pages get edited multiple times during indexing, duplicate entries end up
getting inserted.

Does this still happen?
And does it happen only for -rebuild, since the article is deleted before it's
added again when doing an increment?

Comment 3 Brion Vibber 2007-08-16 15:46:27 UTC
This is all obsolete now.
Comment 4 Andre Klapper 2013-03-26 11:24:09 UTC
[Merging "MediaWiki extensions/Lucene Search" into "Wikimedia/lucene-search2", see bug 46542. You can filter bugmail for: search-component-merge-20130326 ]

Note You need to log in before you can comment on or make changes to this bug.