Last modified: 2014-08-10 10:45:07 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T41615, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 39615 - 404 error for all revisions of some files
404 error for all revisions of some files
Status: RESOLVED FIXED
Product: Wikimedia
Classification: Unclassified
Media storage (Other open bugs)
unspecified
All All
: Normal critical (vote)
: ---
Assigned To: Nobody - You can work on this!
https://commons.wikimedia.org/wiki/Ca...
:
: 41361 (view as bug list)
Depends on:
Blocks: 35367 41371
  Show dependency treegraph
 
Reported: 2012-08-24 11:45 UTC by Marco
Modified: 2014-08-10 10:45 UTC (History)
11 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Marco 2012-08-24 11:45:17 UTC
See https://commons.wikimedia.org/wiki/Category:Files_with_404_errors

Error retrieved from the server:

 404 error: File not found

 The URL you requested was not found. Maybe you would like to look at:

    The main page
    The list of Wikimedia downloads

 A project of the Wikimedia foundation. 

Files were not deleted by admins. The got lost by some technical defect?
Comment 1 Sam Reed (reedy) 2012-08-24 12:22:22 UTC
The simplest fix in most cases is to get the original uploader/author to upload it again...
Comment 2 Marco 2012-08-24 13:02:11 UTC
(In reply to comment #1)
> The simplest fix in most cases is to get the original uploader/author to upload
> it again...

Notified all users. Some of them seem inactive btw.
Comment 3 Marco 2012-09-10 08:42:08 UTC
Maybe bug #39221 is related to this one?
Comment 5 Marco 2012-09-13 08:10:53 UTC
https://commons.wikimedia.org/wiki/File:%D0%92%D0%BE%D1%81%D1%82%D0%BE%D1%87%D0%BD%D0%B0%D1%8F_%D0%BA%D0%BE%D0%BC%D0%BD%D0%B0%D1%82%D0%B0_%D0%9D%D0%BE%D0%B2%D0%BE-%D0%9C%D0%B8%D1%85%D0%B0%D0%B9%D0%BB%D0%BE%D0%B2%D1%81%D0%BA%D0%BE%D0%B3%D0%BE_%D0%B4%D0%B2%D0%BE%D1%80%D1%86%D0%B0.jpg

The  file got deleted instantly after I uploaded the wmr-version! Previously the file was affected by the bug #39221 (inconsistent state)...
So this is a very high indicator that those two bugs are related somehow
Comment 6 Derk-Jan Hartman 2012-09-13 14:15:55 UTC
https://en.wikipedia.org/wiki/File:Polygon_types.svg

Deleted to make way for https://commons.wikimedia.org/wiki/File:Polygon_types.svg, but the File entry remains. The actual delete gives: 

Error deleting file: Polygon types.svg

Error deleting file: Could not delete file "mwstore://local-swift/local-public/archive/e/eb/20070511103813!Polygon_types.svg".

And the page now gives 404s for the image thumbs.
Comment 8 Marco 2012-10-25 07:55:42 UTC
(In reply to comment #7)
See my link to the Category "Category:Files with 404 errors" in the URL tag. All instances should be in this one.

https://commons.wikimedia.org/wiki/Category:Files_with_404_errors
Comment 9 Nemo 2012-10-25 07:59:32 UTC
Sure, but we're experiencing several wildly different 404 errors, so some vetting helps I think.
Comment 10 Marco 2012-10-25 11:40:35 UTC
Could you please give a example of two widely different 404 errors from the Category?
Comment 11 Marco 2012-10-25 16:16:53 UTC
Hundreds of files already got restored and thus removed from the 404 category. To still keep track of them I created the https://commons.wikimedia.org/wiki/Category:Files_with_404_errors_%28restored%29 category.
Comment 12 Rob Lanphier 2012-10-25 23:52:48 UTC
There's a very small number of images for which this problem applies.  Aaron has been looking at this problem off-and-on for a little while, and will continue to poke at this until he solves it, but may multitask with other things.
Comment 13 Rob Lanphier 2012-10-25 23:56:58 UTC
*** Bug 41361 has been marked as a duplicate of this bug. ***
Comment 14 Aaron Schulz 2012-10-27 00:12:52 UTC
So for https://commons.wikimedia.org/wiki/File:Road_E22_Latvia.svg the first upload was at 20121015070818. At 20121015080748 it was evicted to mwstore://local-swift/local-public/archive/e/e0/20121015080734!Road_E22_Latvia.svg (an "archive" location). This normally happens on re-upload (except the `image` table row is also moved to an `oldimage` row and a new file is created, taking over the `image` row entry).
Comment 15 Rob Lanphier 2012-11-16 19:35:50 UTC
Aaron is running a script to gather up a list of affected files (which takes a *long* time, and then it stops and he has to restart it, etc)  He'll go through and fix everything on the list when that process completes.
Comment 16 Aaron Schulz 2012-11-29 20:03:32 UTC
Fixed 35 (/home/aaron/output/bug39615/commonswiki) files on commons via script (such as Леонид_Станиславович_Маевский.JPG).

I don't think there is much else for me to do here. The cause was fixed already in commit 1e9fd01 and the previously affected files that can be efficiently fixed have been.

Remaining 404 files should be re-uploaded (or deleted).
Comment 17 Aaron Schulz 2012-12-17 18:40:58 UTC
Another 21 fixed by scanning back further.
Comment 18 Marco 2012-12-17 18:57:34 UTC
Thank you for the effort.
Comment 19 Yann Forget 2012-12-24 03:25:13 UTC
The category is not empty, there are still 76 files with this issue.
Comment 20 Andre Klapper 2012-12-31 11:22:34 UTC
Yann: Please see last sentence of comment 16. Reclosing this report.
Comment 21 Marco 2013-03-12 20:07:04 UTC
(In reply to comment #19)
> The category is not empty, there are still 76 files with this issue.
I could fix 9 more...

(In reply to comment #16)
> I don't think there is much else for me to do here. The cause was fixed
> already
> in commit 1e9fd01 and the previously affected files that can be efficiently
> fixed have been.

There is a new instance:
File:Jon Agust fran Marorka- vinnare av Nordiska radets miljopris ar 2008 vid prisutdelningen i Helsingfors 2008-10-28.jpg
from 16:16, 10 March 2013. The file already got reuploaded and I am not even sure if this is related. Just letting you know.
Comment 22 Nemo 2013-09-29 09:00:16 UTC
(In reply to comment #16)
> Remaining 404 files should be re-uploaded (or deleted).

Was a bug filed for the followups (cleanup)?
Comment 23 Marco 2013-09-29 11:21:15 UTC
No bug needed. I already contacted all uploaders but some did not yet re-upload the old version.
Feel free to nominate those files for mass deletion.
Comment 24 Nemo 2013-09-29 11:28:45 UTC
(In reply to comment #23)
> No bug needed. I already contacted all uploaders but some did not yet
> re-upload
> the old version.
> Feel free to nominate those files for mass deletion.

What files? Is the category a full list? Your categorisation and cleanup work is truly amazing, but I think we should have some more "stable" way to identify such images.
Comment 25 Marco 2013-09-29 11:42:03 UTC
That's true. Of course the cat only contains the files that were affected by the 404 in the latest version (current version) as of Aug. 2012.
[Someone did a thumbnail search to find those]
Comment 26 Nemo 2013-09-30 02:53:13 UTC
(In reply to comment #25)
> [Someone did a thumbnail search to find those]

It seems Dispenser discontinued that?
Comment 27 Nemo 2013-10-02 21:59:42 UTC
(In reply to comment #26)
> (In reply to comment #25)
> > [Someone did a thumbnail search to find those]
> 
> It seems Dispenser discontinued that?

Nope. :D
https://toolserver.org/~dispenser/view/File_viewer#dispenser:temp:logs:cache_thumbs_errors.log
have fun!

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links