Last modified: 2014-05-26 17:05:18 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T55768, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 53768 - increase of internal_api_error_DBQueryError, internal_api_error_FileBackendError at Wikimedia Commons
increase of internal_api_error_DBQueryError, internal_api_error_FileBackendEr...
Status: RESOLVED DUPLICATE of bug 37519
Product: Wikimedia
Classification: Unclassified
Media storage (Other open bugs)
wmf-deployment
All All
: High major (vote)
: ---
Assigned To: Nobody - You can work on this!
:
Depends on:
Blocks: commons
  Show dependency treegraph
 
Reported: 2013-09-04 18:36 UTC by Rainer Rillke @commons.wikimedia
Modified: 2014-05-26 17:05 UTC (History)
6 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments
exceptions on wikimedia server (5.83 KB, text/plain)
2013-09-05 08:35 UTC, Antoine "hashar" Musso (WMF)
Details

Description Rainer Rillke @commons.wikimedia 2013-09-04 18:36:31 UTC
Original Bug Title:
increase of internal_api_error_DBQueryError (moving files), internal_api_error_FileBackendError (deleting files) (all via API) at Wikimedia Commons
----

References: 
* https://commons.wikimedia.org/wiki/MediaWiki_talk:Gadget-AjaxQuickDelete.js/auto-errors#Autoreport_by_AjaxQuickDelete_1059957175808 (moving files)
* https://commons.wikimedia.org/w/index.php?title=User_talk%3ARillke%2FDiscuss%2F2013%2F2&diff=103432781&oldid=103312491 (deleting files)

Possibly related:
* https://commons.wikimedia.org/wiki/Commons:Village_pump#Something_went_wrong_at_upload
 ( perma: https://commons.wikimedia.org/w/index.php?title=Commons:Village_pump&oldid=103436925#Something_went_wrong_at_upload )
Comment 2 Rainer Rillke @commons.wikimedia 2013-09-05 08:03:59 UTC
"This happened with about a dozen files. I had to do alot of refreshing and delete button clicking to finally get them to delete. It only happened for a short time, and then I was able to delete 50+ further images with no issues."

We would be glad if you could give us (the community) a notice in case there are serious hickups. I know there are ganglia [1] and other monitors but I, for example do not understand how it could have a Current Load Avg of 108% (>100%). Does it mean that 8% of the operations fail?

[1] https://ganglia.wikimedia.org/latest/?r=hour&cs=&ce=&s=by+name&c=Swift%2520pmtpa&tab=m&vn=
Comment 3 Antoine "hashar" Musso (WMF) 2013-09-05 08:35:33 UTC
Created attachment 13245 [details]
exceptions on wikimedia server

The autoreport https://commons.wikimedia.org/wiki/MediaWiki_talk:Gadget-AjaxQuickDelete.js/auto-errors/5#Autoreport_by_AjaxQuickDelete_1059957175808
 shows:

API request failed (internal_api_error_DBQueryError): Database query error at Wed, 04 Sep 2013 17:10:14 GMT served by mw1205 ++++
Task: movePage
NextTask: removeTemplate
LastTask: reloadPage
Page: File:Rue_Général-Nouvion.JPG (hist • logs • abuse log)
Skin: vector
Contribs Log before error
Comment 4 Andre Klapper 2013-09-05 15:09:48 UTC
(In reply to comment #2)
> We would be glad if you could give us (the community) a notice in case there
> are serious hickups.

https://wikitech.wikimedia.org/wiki/Server_admin_log is probably a good first place to check (though very technical, and not helpful in this case). 

According to ops there was a "Swift outage at about 18:00 UTC yesterday (Sep 04). As far as the backlog indicates, Swift processes were running at 100% CPU;  restarted all of the daemons at the same time."
Comment 5 Andre Klapper 2013-11-08 18:18:17 UTC
Rainer: Do you know if this is still (occasionally?) an issue, or can be this considered obsolete (RESOLVED WORKSFORME) nowadays?
Comment 6 Bawolff (Brian Wolff) 2013-11-08 20:17:23 UTC
(In reply to comment #2)
> "This happened with about a dozen files. I had to do alot of refreshing and
> delete button clicking to finally get them to delete. It only happened for a
> short time, and then I was able to delete 50+ further images with no issues."
> 
> We would be glad if you could give us (the community) a notice in case there
> are serious hickups. I know there are ganglia [1] and other monitors but I,
> for
> example do not understand how it could have a Current Load Avg of 108%
> (>100%).
> Does it mean that 8% of the operations fail?
> 

I imagine that means something along the line of the server has multiple core, and the sum of the loads on all the cores. So on a dual core system 108% might 54% on each core (That is just a guess, don't quote me on it, it might be wrong).
Comment 7 Andre Klapper 2014-05-20 10:46:00 UTC
Rainer: Do you know if this is still (occasionally?) an issue, or can be this considered obsolete (RESOLVED WORKSFORME) nowadays?
Comment 8 Rainer Rillke @commons.wikimedia 2014-05-20 11:27:48 UTC
(In reply to Andre Klapper from comment #7)
internal_api_error_FileBackendError does not occur anymore
internal_api_error_DBQueryError still happens while moving files or creating file pages shortly after deleting the file (and file description page)

according to https://commons.wikimedia.org/w/index.php?title=MediaWiki_talk:Gadget-AjaxQuickDelete.js/auto-errors

I think there was another bug report about internal_api_error_DBQueryError ? Can you verify this Andre? If that's the case, please close this one. Thank you.
Comment 9 Andre Klapper 2014-05-26 15:18:31 UTC
(In reply to Rainer Rillke @commons.wikimedia from comment #8)
> internal_api_error_DBQueryError still happens while moving files or creating
> file pages shortly after deleting the file (and file description page)
> 
> I think there was another bug report about internal_api_error_DBQueryError ?

Rainer: https://bugzilla.wikimedia.org/show_bug.cgi?id=37519 ?
https://bugzilla.wikimedia.org/show_bug.cgi?id=40927 might be a dup?
Comment 10 Bawolff (Brian Wolff) 2014-05-26 17:05:18 UTC
> Rainer: https://bugzilla.wikimedia.org/show_bug.cgi?id=37519 ?

Definitely a dupe. Marking as a dupe for that one.

> https://bugzilla.wikimedia.org/show_bug.cgi?id=40927 might be a dup?


bug 40927 comment 6 indicates these may be dupes. I'm not 100% sure.

*** This bug has been marked as a duplicate of bug 37519 ***

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links