Last modified: 2014-02-10 09:13:02 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T26647, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 24647 - Job queue memory usage
Job queue memory usage
Status: NEW
Product: MediaWiki
Classification: Unclassified
JobQueue (Other open bugs)
1.17.x
All All
: Low normal (vote)
: ---
Assigned To: Nobody - You can work on this!
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2010-08-03 18:57 UTC by Siebrand Mazeland
Modified: 2014-02-10 09:13 UTC (History)
5 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Siebrand Mazeland 2010-08-03 18:57:52 UTC
I haven't been able to pinpoint this exactly, but something is wrong with the job queue. I've experienced this for example while it's processing edit jobs for ReplaceText, but also when changing a template that's used for a few hundred times, as well as when using the Translate extension script 'fuzzy.php'.

In the cases of Translate and ReplaceText actual edits are made, for a template change, other stuff happens that I'm not really up to speed with (link table updates?).

Generally at some point in time the script will exit with "Allowed memory size exhausted" (at translatewiki.net about 150M), even though, as far as I know, command line scripts shouldn't have a default memory limit (?).

I've once looked into this, and found that memory usage of the job queue keeps growing with each job that it handles. I forgot about the actual number, but it was many megabytes per job then (12M comes to mind - probably depends on the exact wiki properties). All attempts to do "garbage collection" setting references to null to reduce memory usage failed.
Comment 1 Siebrand Mazeland 2010-08-03 19:03:30 UTC
The 150M memory limit is hard coded in runJobs.php, but that's not really the issue, obviously. It's the growing memory usage.
Comment 2 Max Semenik 2012-12-21 21:44:41 UTC
Is this still an issue? As far as I remember TWN used PHP 5.2 then while PHP 5.3 should have much better memory management.
Comment 3 Nemo 2014-02-10 09:13:02 UTC
(In reply to comment #0)
> Generally at some point in time the script will exit with "Allowed memory
> size
> exhausted" (at translatewiki.net about 150M)

Heh, good old times. Nowadays, even 550M is not enough: see bug 58969, bug 60844. No idea what to do with this bug, it's now superseded by MediaWiki's memory hogs being standard it seems?

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links