Last modified: 2012-11-09 22:24:37 UTC
I've discovered a single revision_id that, when requested from en.wikipedia.org, causes an error that causes an "Internal Error" and crashes an API query. When making an API query, the problem only happens when I try to request the content. The error is out of the ordinary and that is why I am reporting. Revision id: 186704908 Problem observed for: 3 days Error Message: LBFactory_Multi::newExternalLB: Unknown cluster "cluster16" Backtrace: #0 /usr/local/apache/common-local/wmf-deployment/includes/db/LBFactory_Multi.php(139): LBFactory_Multi->newExternalLB('cluster16', false) #1 /usr/local/apache/common-local/wmf-deployment/includes/ExternalStoreDB.php(42): LBFactory_Multi->getExternalLB('cluster16', false) #2 /usr/local/apache/common-local/wmf-deployment/includes/ExternalStoreDB.php(53): ExternalStoreDB->getLoadBalancer('cluster16') #3 /usr/local/apache/common-local/wmf-deployment/includes/ExternalStoreDB.php(125): ExternalStoreDB->getSlave('cluster16') #4 /usr/local/apache/common-local/wmf-deployment/includes/ExternalStoreDB.php(97): ExternalStoreDB->fetchBlob('cluster16', '3970273', false) #5 /usr/local/apache/common-local/wmf-deployment/includes/ExternalStore.php(43): ExternalStoreDB->fetchFromURL('DB://cluster16/...') #6 /usr/local/apache/common-local/wmf-deployment/includes/Revision.php(732): ExternalStore::fetchFromURL('DB://cluster16/...') #7 /usr/local/apache/common-local/wmf-deployment/includes/Revision.php(920): Revision::getRevisionText(Object(stdClass)) #8 /usr/local/apache/common-local/wmf-deployment/includes/Revision.php(621): Revision->loadText() #9 /usr/local/apache/common-local/wmf-deployment/includes/Revision.php(600): Revision->getRawText() #10 /usr/local/apache/common-local/wmf-deployment/includes/Article.php(481): Revision->getText(2) #11 /usr/local/apache/common-local/wmf-deployment/includes/Article.php(343): Article->fetchContent(186704908) #12 /usr/local/apache/common-local/wmf-deployment/includes/Article.php(230): Article->loadContent() #13 /usr/local/apache/common-local/wmf-deployment/includes/Article.php(832): Article->getContent() #14 /usr/local/apache/common-local/wmf-deployment/includes/Wiki.php(493): Article->view() #15 /usr/local/apache/common-local/wmf-deployment/includes/Wiki.php(70): MediaWiki->performAction(Object(OutputPage), Object(Article), Object(Title), Object(User), Object(WebRequest)) #16 /usr/local/apache/common-local/wmf-deployment/index.php(117): MediaWiki->performRequestForTitle(Object(Title), Object(Article), Object(OutputPage), Object(User), Object(WebRequest)) #17 /usr/local/apache/common-local/live-1.5/index.php(3): require('/usr/local/apac...') #18 {main} Example #1: http://en.wikipedia.org/w/index.php?title=Wikipedia:WikiProject_Fungi/fungus_articles_by_size&oldid=186704908 Example #2: http://en.wikipedia.org/w/api.php?action=query&prop=revisions&revids=186704908&rvprop=content|ids Example #3 (no content, should work): http://en.wikipedia.org/w/api.php?action=query&prop=revisions&revids=186704908&rvprop=ids|timestamp
Cluster 16 is marked as "Obsolete ex-fedora clusters"
I just tested Example #1 and Example #2. They both still fail as described above. I hope I'm not acting out of step by re-opening this ticket, but this is still an issue.
And it's still like that except that we now are provided only the adorable clueless "Fatal exception of type MWException". Roan, who knows enough about external storage and could investigate this?
Thanks for your detailed report, Aaron. There's no cluster16 in the config. The revision timestamp is 2008-01-25T00:11:44Z. You can't simply disappear an ES cluster leaving references to it. What happened with its contents? Given these are 2008 events, I'd pass this to Tim.
By the way, same error if you try to export it: you get an invalid XML file which ends with <!doctype html> <html><head><title>Internal error</title></head><body> <div class="errorbox">[7aae7e6a] 2012-08-24 19:09:20: Fatal exception of type MWException</div> <!-- Set $wgShowExceptionDetails = true; at the bottom of LocalSettings.php to show detailed debugging information. --></body></html>
(In reply to comment #4) > Thanks for your detailed report, Aaron. > > There's no cluster16 in the config. The revision timestamp is > 2008-01-25T00:11:44Z. You can't simply disappear an ES cluster leaving > references to it. What happened with its contents? > Given these are 2008 events, I'd pass this to Tim. CC Tim.
Example number 3 works http://en.wikipedia.org/w/index.php?title=Wikipedia:WikiProject_Fungi/fungus_articles_by_size&oldid=186704908 012-10-21 15:44:32 mw39 enwiki: [6828b293] /w/index.php?title=Wikipedia:WikiProject_Fungi/fungus_articles_by_size&oldid=186704908 Exception from line 162 of /usr/local/apache/common-local/php-1.21wmf1/includes/db/LBFactory_Multi.php: LBFactory_Multi::newExternalLB: Unknown cluster "cluster16" #0 /usr/local/apache/common-local/php-1.21wmf1/includes/db/LBFactory_Multi.php(181): LBFactory_Multi->newExternalLB('cluster16', false) #1 /usr/local/apache/common-local/php-1.21wmf1/includes/ExternalStoreDB.php(42): LBFactory_Multi->getExternalLB('cluster16', false) #2 /usr/local/apache/common-local/php-1.21wmf1/includes/ExternalStoreDB.php(55): ExternalStoreDB->getLoadBalancer('cluster16') #3 /usr/local/apache/common-local/php-1.21wmf1/includes/ExternalStoreDB.php(143): ExternalStoreDB->getSlave('cluster16') #4 /usr/local/apache/common-local/php-1.21wmf1/includes/ExternalStoreDB.php(108): ExternalStoreDB->fetchBlob('cluster16', '3970273', false) #5 /usr/local/apache/common-local/php-1.21wmf1/includes/ExternalStore.php(74): ExternalStoreDB->fetchFromURL('DB://cluster16/...') #6 /usr/local/apache/common-local/php-1.21wmf1/includes/Revision.php(934): ExternalStore::fetchFromURL('DB://cluster16/...') #7 /usr/local/apache/common-local/php-1.21wmf1/includes/Revision.php(1135): Revision::getRevisionText(Object(stdClass)) #8 /usr/local/apache/common-local/php-1.21wmf1/includes/Revision.php(823): Revision->loadText() #9 /usr/local/apache/common-local/php-1.21wmf1/includes/Revision.php(800): Revision->getRawText() #10 /usr/local/apache/common-local/php-1.21wmf1/includes/Article.php(383): Revision->getText(2) #11 /usr/local/apache/common-local/php-1.21wmf1/includes/Article.php(583): Article->fetchContent() #12 /usr/local/apache/common-local/php-1.21wmf1/includes/actions/ViewAction.php(37): Article->view() #13 /usr/local/apache/common-local/php-1.21wmf1/includes/Wiki.php(427): ViewAction->show() #14 /usr/local/apache/common-local/php-1.21wmf1/includes/Wiki.php(304): MediaWiki->performAction(Object(Article)) #15 /usr/local/apache/common-local/php-1.21wmf1/includes/Wiki.php(553): MediaWiki->performRequest() #16 /usr/local/apache/common-local/php-1.21wmf1/includes/Wiki.php(446): MediaWiki->main() #17 /usr/local/apache/common-local/php-1.21wmf1/index.php(59): MediaWiki->run() #18 /usr/local/apache/common-local/live-1.5/index.php(3): require('/usr/local/apac...') #19 {main} http://en.wikipedia.org/w/api.php?action=query&prop=revisions&revids=186704908&rvprop=content|ids 2012-10-21 15:45:33 mw70 enwiki: [7b1060ef] /w/api.php?action=query&prop=revisions&revids=186704908&rvprop=content|ids Exception from line 162 of /usr/local/apache/common-local/php-1.21wmf1/includes/db/LBFactory_Multi.php: LBFactory_Multi::newExternalLB: Unknown cluster "cluster16"
