Last modified: 2013-02-05 12:53:02 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T10390, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 8390 - Enable Semantic MediaWiki on WMF projects
Enable Semantic MediaWiki on WMF projects
Status: RESOLVED WONTFIX
Product: Wikimedia
Classification: Unclassified
Extension setup (Other open bugs)
unspecified
All All
: Lowest enhancement with 5 votes (vote)
: ---
Assigned To: Nobody - You can work on this!
:
Depends on: 8010
Blocks: 31235 25410
  Show dependency treegraph
 
Reported: 2006-12-26 14:42 UTC by Emilien ARNAUD
Modified: 2013-02-05 12:53 UTC (History)
12 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Emilien ARNAUD 2006-12-26 14:42:58 UTC
What about include SMW in the core system ?
How about its installation on "official" wikipedia projects ?

Thanks in advance for answers,
Sincerely,

E.
Comment 1 Aryeh Gregor (not reading bugmail, please e-mail directly) 2006-12-26 17:19:32 UTC
Semantic MediaWiki is an extension and will remain an extension for the
foreseeable future.  I don't know if it's ready to be enabled on Wikimedia
Foundation projects.  Possibly a pilot run on one of the smaller wikis wouldn't
be a bad idea, to gauge performance and so forth, but I don't know how far it's
gotten.
Comment 2 Emilien ARNAUD 2006-12-27 23:38:59 UTC
Thank you for your answer. The question is: Does the Semantic MediaWiki Team
thinks that the extension is enough operational to be released as a supported
extension that could be included in all projects ?

In other words, would it be interresting to launch a pool in my langage project
to ask to include it ? Would it be any technical reason to say no ?

Thanks in adavance pfor your answers,
Sincerely,

E.
Comment 3 Emilien ARNAUD 2007-01-03 16:45:45 UTC
Excuse me to insist ... I just would like an answer to know if I can propose
this functionnality to my chapter ...

Thanks me in advance,

E.
Comment 4 Steve Sanbeg 2007-01-03 16:54:22 UTC
Last I checked, the extension breaks the whole regression testing system, since
it makes database queries when the extension is parsed, instead of waiting until
it's loaded. Although it's trivial to fix, I think it would rule out installing
it in most wikis, since you could no longer test upgrades.
Comment 5 Emilien ARNAUD 2007-01-03 17:21:24 UTC
Hum... It seems like that would be never fixed ... But the features are really
interresting !
How many categories in Wikipedia would be replaced by a such extension ! No more
need of bots to check if listings or inclusions are symetrics ...

But wait a minute... Don't understand why it breaks the regression tests when no
modification of mediawiki files is needed to install ... Is it the database
structure ?

E.
Comment 6 Steve Sanbeg 2007-01-03 22:25:32 UTC
(In reply to comment #5)

Yes, the database schema.

The test uses a different database than the normal wiki, so the tests can add
their own articles as they need.

The extension uses some additional tables, which are created by a maintenance
script, rather than automatically, which would cause problems with testing it.

But the real problem here is that it accesses these tables immediately, instead
of waiting for the module to be loaded, via the normal hook.  These means you
can't test anything on a server with the extension installed, because this
module will fail to load, even if it wasn't intended to be.  This is simple to
fix, by moving the initialisation into the appropriate hook, although I can't
say when/if they want to address this; I would hope not never.

> Hum... It seems like that would be never fixed ... But the features are really
> interresting !
> How many categories in Wikipedia would be replaced by a such extension ! No more
> need of bots to check if listings or inclusions are symetrics ...
> 
> But wait a minute... Don't understand why it breaks the regression tests when no
> modification of mediawiki files is needed to install ... Is it the database
> structure ?
> 
> E.

Comment 7 Emilien ARNAUD 2007-01-04 12:13:03 UTC
Where this regression could be finded ? I tried to search in meta and mediawiki,
no result :(
Comment 8 Rob Church 2007-01-04 12:20:26 UTC
(In reply to comment #7)
> Where this regression could be finded ? I tried to search in meta and mediawiki,
> no result :(

See bug 8010.

In general, if something breaks our regression testing (such as it is), then it
may well not be installed live, as we absolutely *have* to be able to run these
tests.

However, Steve claims the solution is simple, so it's just a matter of having
someone who's working on Semantic MediaWiki fix the problem.
Comment 9 Emilien ARNAUD 2007-01-04 12:24:02 UTC
I mean, I already read that bug. The question is where is the "official"
regression test ?

I didn't find them ...
Comment 10 Rob Church 2007-01-04 12:53:20 UTC
I'm guessing Steve means the parser test suite, which can be found within the
maintenance/ directory of any current MediaWiki installation.
Comment 11 Steve Sanbeg 2007-01-04 16:43:58 UTC
This is the error I get when I try to run that test suite, with just the
standard parser tests:
---
>php maintenance/parserTests.php -quick -quiet
A database query syntax error has occurred.
The last attempted database query was:
"DELETE FROM `parsertest_smw_relations` WHERE subject_id = '1'"
from within function "SMW::DeleteRelations".
MySQL returned error "1146: Table 'refwikidb.parsertest_smw_relations' doesn't
exist (localhost)"
---
The standard tests don't load the SMW extension hook, but it tries to access the
non-existent table when the the extension is included, so the parser test suite
is completely non-functional. 
Comment 12 Emilien ARNAUD 2007-01-05 00:24:04 UTC
Hum... Then we should:
- not initialize the SMW extension (the thing you've done)
or
- initialize the installation of the extension !

No?
Comment 13 Aryeh Gregor (not reading bugmail, please e-mail directly) 2007-01-05 00:58:43 UTC
We should fix bug 8010.  That's why this depends on that.  Further discussion of
that bug should take place on its page.
Comment 14 Helder 2011-02-10 21:59:34 UTC
Hi!

What is the situation of this?
Would it be feasible to install SMW on Wikimedia projects?
Comment 15 Helder 2011-03-23 04:12:56 UTC
(In reply to comment #14)
> Hi!
> 
> What is the situation of this?
> Would it be feasible to install SMW on Wikimedia projects?

Any updates?
Comment 16 Jon Phillips 2011-04-16 20:47:03 UTC
Hi, we are very interested in using SMW. Our project Acawiki uses this, and we are working to get it added. 

The other option is if there is a better performing extension which WMF prefers.
Comment 17 badon 2012-04-20 18:58:44 UTC
Wikinews might have a need to use this. It would greatly help with the handling of news articles in a structured, queriable manner that goes far beyond the limitations of what categories can do.
Comment 18 SJ 2012-12-14 23:22:33 UTC
See also bug 39843.  Is SMW running on any projects on the cluster?
Comment 19 Bawolff (Brian Wolff) 2012-12-14 23:29:56 UTC
(In reply to comment #18)
> See also bug 39843.  Is SMW running on any projects on the cluster?

SMW is running on labsconsole.

I'm not familar with SMW at all, but I am very doubtful it meets the performance requirements necessary for Wikipedia....
Comment 20 badon 2012-12-18 05:00:02 UTC
Right, that's what WikiData is for. SMW could work on the smaller projects though. From what little I know of WikiData, it should be straightforward to convert mundane SMW usage into WikiData usage if in the future those smaller projects aren't so small anymore.

In general, I suspect that externalizing the semantic data processing load like WikiData is doing is probably the only way to approach the scaling problem. I'd have to study it more to be sure of that, but I'm guessing SMW's poor scaling will still bog down Moore's law in most use cases. Then again, maybe it's possible to externalize SMW itself, but that's useless observer speculation for now.

I know Mozilla uses SMW, and if it's working for them, there's a good chance something like WikiNews can use it too. I'm not sure how "big" Mozilla's usage of SMW is compared to WikiNews, but my impression is that WikiNews is tiny. It's definitely tiny compared to Wikipedia.
Comment 21 Andre Klapper 2013-01-23 12:28:43 UTC
See https://www.mediawiki.org/wiki/Writing_an_extension_for_deployment for information on what is needed to get an extension reviewed before potentially deploying it on a wikisite.
Comment 22 Bawolff (Brian Wolff) 2013-01-23 13:28:52 UTC
(In reply to comment #20)
> Right, that's what WikiData is for. SMW could work on the smaller projects
> though. From what little I know of WikiData, it should be straightforward to
> convert mundane SMW usage into WikiData usage if in the future those smaller
> projects aren't so small anymore.
> 
> In general, I suspect that externalizing the semantic data processing load
> like
> WikiData is doing is probably the only way to approach the scaling problem.
> I'd
> have to study it more to be sure of that, but I'm guessing SMW's poor scaling
> will still bog down Moore's law in most use cases. Then again, maybe it's
> possible to externalize SMW itself, but that's useless observer speculation
> for
> now.
> 
> I know Mozilla uses SMW, and if it's working for them, there's a good chance

There was a fork of wikinews called openglobe. It was tiny compared to wikinews. It tried to use smw but performance was not acceptable (from a user perspective. It was always turned on but it was too slow to be useful) granted that could have been due to issues with how smw was set up, but nonetheless is not a good sign.
> something like WikiNews can use it too. I'm not sure how "big" Mozilla's
> usage
> of SMW is compared to WikiNews, but my impression is that WikiNews is tiny.
> It's definitely tiny compared to Wikipedia.
Comment 23 Jodi Schneider 2013-01-23 13:52:52 UTC
> There was a fork of wikinews called openglobe. It was tiny compared to
> wikinews. It tried to use smw but performance was not acceptable (from a user
> perspective. It was always turned on but it was too slow to be useful) granted
> that could have been due to issues with how smw was set up, but nonetheless is
> not a good sign.

Sounds to me like issues with the setup. Offhand a few SMW instances I've used, which do have good performance:
http://acawiki.org/
http://www.discoursedb.org/

The wiki of the month list gives a good idea of capabilities:
http://semantic-mediawiki.org/wiki/Wiki_of_the_Month
Comment 24 Chad H. 2013-01-23 13:58:14 UTC
(In reply to comment #14)
> Hi!
> 
> What is the situation of this?
> Would it be feasible to install SMW on Wikimedia projects?

I don't think this has ever changed. SMW isn't going to be installed on Wikimedia project wikis.

Labsconsole is a notable exception that uses SMW.

Wikidata is largely going to accomplish a lot of what people have been wanting SMW for over the years (and feature requests for that go elsewhere).

Re-closing this as WONTFIX.
Comment 25 Yaron Koren 2013-01-23 15:02:03 UTC
All of that is mostly true, although, just to clarify, there are a few other Wikimedia wikis where it might make sense to use SMW directly - the most notable, in my opinion, is mediawiki.org. (That counts, right?)
Comment 26 Quim Gil 2013-02-05 06:02:48 UTC
Let's recap:

(In reply to comment #0)
> What about include SMW in the core system ?

No, as discuussed at length.

> How about its installation on "official" wikipedia projects ?

No as a rule, also as discussed at length.

Hence WONTFIX is an apprpriate resolution.



(In reply to comment #25)
> All of that is mostly true, although, just to clarify, there are a few other
> Wikimedia wikis where it might make sense to use SMW directly - the most
> notable, in my opinion, is mediawiki.org. (That counts, right?)

Yes, mediawiki.org counts. But this specific case is far from the generic request of this report opened 6 years ago. Even in that case the first thing would be to define a problem or an enhancement, and then perhaps propose SMW as a solution. Requesting the installation of an extension in mediawiki.org before defining a need for it most probably won't work. If you want to go ahead with this please do it in a new report instead of reopening this one. Thank you.
Comment 27 badon 2013-02-05 10:24:21 UTC
If a new report gets opened, please post a link to it here.
Comment 28 Yaron Koren 2013-02-05 12:53:02 UTC
Quim - yes, of course. I wasn't trying to make a larger point, just correcting an error.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links