Last modified: 2014-10-28 23:17:18 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T69535, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 67535 - performance review of WikibaseQueryEngine
performance review of WikibaseQueryEngine
Status: NEW
Product: MediaWiki extensions
Classification: Unclassified
WikibaseQueryEngine (Other open bugs)
master
All All
: Highest normal (vote)
: ---
Assigned To: Wikidata bugs
u=dev c=backend p=0
:
Depends on:
Blocks: 52385
  Show dependency treegraph
 
Reported: 2014-07-04 14:15 UTC by Lydia Pintscher
Modified: 2014-10-28 23:17 UTC (History)
3 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Lydia Pintscher 2014-07-04 14:15:15 UTC
We want to deploy simple query functionality for Wikidata. For this a performance review of WikibaseQueryEngine is needed. The code is at https://github.com/wmde/WikibaseQueryEngine.
Comment 1 Nik Everett 2014-07-23 15:47:58 UTC
Important dependency to also check out:
	"doctrine/dbal": "~2.4"
Comment 2 Nik Everett 2014-07-23 15:53:19 UTC
I'm a bit worried about the update script - it looks like it wants to directly modify the schema.  It'd make more sense in our environment to spit out the SQL that would modify it.

Also, not to be a tool bigot - but it'd be neat to implement an Elasticsearch backed version of this - it'd be simpler in many ways.  Probably more complex in others.
Comment 3 Jeroen De Dauw 2014-07-24 01:50:41 UTC
Re update script: we are aware of this. The CLI can already dump the schema creation code for exactly that purpouse
Comment 4 Jeroen De Dauw 2014-07-24 01:53:19 UTC
Note there is a test in the performance group that is excluded by default. I used this to get a quick idea of how quick inserts are, at least when there is little data in the store. https://github.com/wmde/WikibaseQueryEngine/blob/master/tests/Integration/PerformanceTest.php
Comment 5 Nik Everett 2014-08-27 15:55:06 UTC
Poke for status - I'm really just looking for some general hint on Ori would be able to start the review.  Or if I should bounce to Aaron?
Comment 6 Nik Everett 2014-10-02 16:29:00 UTC
Swapping over to Aaron because Ori is crushed under HHVM.
Comment 7 Nik Everett 2014-10-02 16:33:06 UTC
Some status on this - the tool is being rewritten to remove its dependency on external libraries.  If possible it'd be cool to get started on the review before the rewrite.  It _shouldn't_ be a huge rewrite - just replacing some of it.
Comment 8 Jeroen De Dauw 2014-10-03 10:14:19 UTC
> the tool is being rewritten

It is not being "rewritten" - most of it will remain the same.

> to remove its dependency on external libraries

That is being done, though does not involve rewriting the component.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links