Last modified: 2014-09-23 19:59:33 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T38166, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 36166 - OOM when generating 6000px wide thumb of large (baseline) jpeg
OOM when generating 6000px wide thumb of large (baseline) jpeg
Status: NEW
Product: Wikimedia
Classification: Unclassified
Media storage (Other open bugs)
wmf-deployment
All All
: Lowest normal (vote)
: ---
Assigned To: Nobody - You can work on this!
:
Depends on:
Blocks: 41371
  Show dependency treegraph
 
Reported: 2012-04-23 01:19 UTC by Jasper Deng
Modified: 2014-09-23 19:59 UTC (History)
6 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Comment 1 Mark A. Hershberger 2012-04-23 20:48:05 UTC
XID: 1391948384
Comment 2 MZMcBride 2012-04-23 23:00:24 UTC
(In reply to comment #1)
> XID: 1391948384

This XID value seems to change on page refresh, by the way.
Comment 3 Ben Hartshorne 2012-05-02 21:51:19 UTC
my guess is that it's failing to resize to a thumbnail that is 6565 pixels wide.  It works for smaller images.  fwiw, convert is failing with exit code 153.
Comment 4 Nemo 2012-08-16 18:20:53 UTC
(In reply to comment #3)
> my guess is that it's failing to resize to a thumbnail that is 6565 pixels
> wide.  It works for smaller images.  

Is it a Wikimedia or a MediaWiki issue then? (Still happening.)
Comment 5 Sumana Harihareswara 2012-10-25 07:14:17 UTC
Still reproducible at

http://upload.wikimedia.org/wikipedia/commons/thumb/f/f6/Carbon_River_pano_01A.jpg/6565px-Carbon_River_pano_01A.jpg

When I change the width:

https://upload.wikimedia.org/wikipedia/commons/thumb/f/f6/Carbon_River_pano_01A.jpg/72px-Carbon_River_pano_01A.jpg

then it's fine.

This may be related to bug 13493 ("Can't create thumbnail of images with a peculiar aspect ratio") and bug 20312 ("Error creating thumbnail: Image was not scaled, is the requested width bigger than the source?").
Comment 6 EK 2013-01-17 19:06:59 UTC
I am getting a similar error when trying to download any size larger than 2048px for this van Gogh:

http://commons.wikimedia.org/wiki/File:Vincent_van_Gogh_-_De_slaapkamer_-_Google_Art_Project.jpg#file
Comment 7 Andre Klapper 2013-01-18 09:16:13 UTC
(In reply to comment #6)
> I am getting a similar error when trying to download van Gogh:

That's covered in bug 44071 instead.
Comment 8 Andre Klapper 2014-02-28 21:12:45 UTC
I get "Error code: 137" nowadays.
Comment 9 earthsound 2014-03-04 17:41:34 UTC
I have been seeing this error (as mentioned in comment 8, it's generating "Error code:137" now) for this particular image: 

https://commons.wikimedia.org/wiki/File:Aerial_drawing,_1885,_of_Birmingham,_Alabama.jpg

The preview on that page (1280px width) is broken:

https://upload.wikimedia.org/wikipedia/commons/thumb/6/66/Aerial_drawing%2C_1885%2C_of_Birmingham%2C_Alabama.jpg/1280px-Aerial_drawing%2C_1885%2C_of_Birmingham%2C_Alabama.jpg

After a few failed attempts, it will generate this error: "Error generating thumbnail - There have been too many recent failed attempts (5 or more) to render this thumbnail. Please try again later."

I have found that any size thumbnail up to a width of 1234px will generate OK, but anything 1235px width or larger fails 100% of the time, even though the full resolution image is OK.
Comment 10 earthsound 2014-03-04 18:18:12 UTC
I determined that I'd hit bug 17645, saved the file as a baseline optimized JPEG rather than progressive and now the thumbnails work. Sorry for the noise. 

Perhaps the images reported in this bug are saved similarly (progressive)?
Comment 11 Nemo 2014-03-04 21:26:17 UTC
(In reply to earthsound from comment #10)
> Perhaps the images reported in this bug are saved similarly (progressive)?

Ouch. We have lists of progressive images, attachment 11220 [details] and attachment 11500 [details], and you can easily test the cases above with exiftools or whatever. I think we've replaced by bot (most) of the bigger ones, but there may be other factors beyond size that make them fail: in that case, it would be nice to determine what they are, to fix them by bot.
It's also possible that whatever you did (a null "convert" run?) fixed *other* things.
Comment 12 Bawolff (Brian Wolff) 2014-05-17 18:32:00 UTC
Error code 137 = out of memory.

(In reply to Jasper Deng from comment #0)
> http://upload.wikimedia.org/wikipedia/commons/thumb/f/f6/
> Carbon_River_pano_01A.jpg/6565px-Carbon_River_pano_01A.jpg
> 
> Some sort of Guru meditation.

What's the use case for generating a 6000px wide thumbnail?

(In reply to earthsound from comment #10)
> I determined that I'd hit bug 17645, saved the file as a baseline optimized
> JPEG rather than progressive and now the thumbnails work. Sorry for the
> noise. 
> 
> Perhaps the images reported in this bug are saved similarly (progressive)?

Yep, that would do it. Progressive images are much more memory intensive to scale.

----
Note: the Carbon river file is a baseline jpeg.

Honestly I don't find it that surprising that it runs out of memory when you try to make a 66 megapixel thumbnail. I feel like this bug should be wontfixed unless people have a compelling reason to need such huge thumbnails.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links