Last modified: 2014-09-27 01:59:49 UTC
When installing all the MediaWiki extensions currently deployed on the Wikimedia cluster with a dummy LocalSettings.php, we end up with a lot of failures, bad interactions between extensions or core tests broken via hooks. Some extensions even end up throwing fatal errors. To help migrate to HHVM, we would need to be able to run the unit tests of core and of all the extensions and have them pass. Ori has worked on this a bit for HHVM and already reported a fair amount of bugs. Antoine has been working on an experimental Jenkins Job that run all wmf extensions tests. Lets join the effort, fill bug and track them there. Then reach out to the other developers and get everything fixed.
Add bugs Ori and I filled.
Relabel per discussion.
A few more extension that can pass the installer / fail tests.
Thanks a bunch for working on this. Those who shouted for help on wikitech-l and have been unable for years to run tests on their own environment / with their own configuration will be enthusiastic.
I am merely feeling bugs and we will attempt to fix as many possible. But we could use some help :-) Please spread the word to wikitech-l! New bugs would be specially appreciated. The aim is to have core + all wmf extensions to pass the PHPUnit test suite.
This is awesome :) Thanks for pushing this, Antoine.
Status as of today. I have commented out the following extensions for various reasons mentioned in the commit message https://git.wikimedia.org/commit/integration%2Fjenkins-job-builder-config/50d2cda7ffca7655889a48b25fccd3ce15977ff6 #mediawiki/extensions/CentralAuth #mediawiki/extensions/Math #mediawiki/extensions/OAI #mediawiki/extensions/Oversight #mediawiki/extensions/RandomRootPage #mediawiki/extensions/SemanticForms #mediawiki/extensions/SemanticMediaWiki #mediawiki/extensions/SemanticResultFormats #mediawiki/extensions/Translate #mediawiki/extensions/Validator #mediawiki/extensions/ZeroRatedMobileAccess #mediawiki/extensions/timeline There are bug filled for most of them. The complete list from the Jenkins configuration: https://git.wikimedia.org/blob/integration%2Fjenkins-job-builder-config/50d2cda7ffca7655889a48b25fccd3ce15977ff6/mediawiki-extensions.yaml#L147 A test report can be find at: https://integration.wikimedia.org/ci/job/mediawiki-core-extensions-integration/68/testReport/ Almost all of the failures are parser tests which hardcode expected HTML output. But since some extensions register hooks that further adjust the HTML output, that does not play well. Bug 67302 - ""MultimediaViewer breaks Cite extension parser tests"" has some more details.
Created attachment 16044 [details] php5 phpunit.php I run php5 phpunit.php after enabling all gerrit extension having unit tests and almost all MediaWiki-Vagrant roles (http://paste.debian.net/111811/ minus roles globalcssjs math mathsearch cirrussearch) and there's quite some output to process...
(In reply to Nemo from comment #8) > Created attachment 16044 [details] > php5 phpunit.php > > I run php5 phpunit.php after enabling all gerrit extension having unit tests > and almost all MediaWiki-Vagrant roles (http://paste.debian.net/111811/ > minus roles globalcssjs math mathsearch cirrussearch) and there's quite some > output to process... I am going to have a Jenkins job triggered for all extensions. Gotta polish up some details but I have a working base to make it happen soon ™