Last modified: 2014-05-06 12:15:48 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T44979, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 42979 - Upload from Flickr only fetches the first 50 items of a set
Upload from Flickr only fetches the first 50 items of a set
Status: PATCH_TO_REVIEW
Product: MediaWiki extensions
Classification: Unclassified
UploadWizard (Other open bugs)
master
All All
: Normal normal with 1 vote (vote)
: ---
Assigned To: Nischay Nahata
:
Depends on:
Blocks: 43450
  Show dependency treegraph
 
Reported: 2012-12-12 03:52 UTC by Waldir
Modified: 2014-05-06 12:15 UTC (History)
5 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Waldir 2012-12-12 03:52:35 UTC
Passing a flickr set (album) with more than 50 items only loads the first 50 items. It possibly makes sense to set a maximum of images a user can upload at once, but if we want to select only a few of the set's images, we can't access those past the 50 mark.

Besides, no message is presented to the user to tell them that only 50 of the set's images have been loaded.
Comment 1 Nischay Nahata 2013-01-05 17:57:01 UTC
50 is hardcoded (not sure why?)
If there are problems uploading more than 50 images at once the user should be provided with a pop-up asking for the limits eg. 1-50, 51-100..
Comment 2 Nischay Nahata 2013-01-05 18:14:54 UTC
Something like http://jqueryui.com/slider/#range seems plausible
Comment 3 Nischay Nahata 2013-01-05 18:47:56 UTC
On rethinking I figured that we can simply limit the selectable images to 50.
https://gerrit.wikimedia.org/r/#/c/42385/ does this. However, a small message is needed that informs the user that he can select only 50 images at one go.
Comment 4 Ryan Kaldari 2013-01-07 18:58:56 UTC
Actually, it turns out we may need to reduce the number rather than increasing it. The Flickr API ToS say that 3rd party applications can only display up to 30 images per page. I guess what we need to do is implement some sort of pagination system which shows 30 images at a time.
Comment 5 Nischay Nahata 2013-01-08 08:29:26 UTC
(In reply to comment #4)
> I guess what we need to do is implement some sort of
> pagination system which shows 30 images at a time.

I don't completely get how the pagination should be done.. after entering the URL can the user select more than 30 images?
Any particular reason why 50 has been set as the upload limit?
Comment 6 Waldir 2013-01-08 14:49:50 UTC
(In reply to comment #5)
> after entering the URL can the user select more than 30 images?

There definitely should be a way to access the images of a 30+ set past the 30th mark! The limit of 30 images from the Flickr API ToS [1] seems to be for display only; as I see it, the user should be able to select more than 30 images if he does so from subsets (pages) of 30 images each.

That said, there should indeed be a (conceptually different) upload limit for commons, which should be set based on software limitations and community consensus (we don't want users uploading thousands of images at once erroneously or maliciously, and in fact the ToS also say that we shouldn't "use an unreasonable amount of bandwidth")

1. http://www.flickr.com/services/api/tos/ -- section 1.b.iii
Comment 7 Ryan Kaldari 2013-01-10 22:15:35 UTC
The 50 number was a completely arbitrary choice. It was just a number to start with for testing purposes. Ideally, we should allow the user to browse through all the images of a photoset with some sort of pagination or infinite scrolling system. I also think we shouldn't allow the user to actually upload more than 100 images at a time, as the chances of something going wrong with uploads larger than that is rather high. If we allow them to paginate though the set, they can always continue uploading where they left off.
Comment 8 Nischay Nahata 2013-01-26 17:51:45 UTC
Attempt 2 with infinite scrolling
https://gerrit.wikimedia.org/r/#/c/45951/
Comment 9 Ryan Kaldari 2013-03-13 18:50:05 UTC
Just got a reply back from Ross Harmes, an engineering manager at Flickr/Yahoo:

"I think that it would be fine to display more than 30 images in your tool (as thumbnails). It does technically violate the ToS, but not in a way that is likely to get your API key deactivated. Use your best judgement as to how many images to show here."

So it sounds like we would be OK with an infinite scrolling or client-side pagination interface. I would still like to limit the number of images you can select for uploading at one time to some arbitrary number (50? 100?), but allow the user to choose from all the photos in the set.
Comment 10 Nischay Nahata 2013-03-13 20:30:38 UTC
(In reply to comment #9)
> Just got a reply back from Ross Harmes, an engineering manager at
> Flickr/Yahoo:

That's great, I will rework the change a bit.
Comment 11 Nemo 2013-06-19 09:18:51 UTC
(In reply to comment #10)
> (In reply to comment #9)
> > Just got a reply back from Ross Harmes, an engineering manager at
> > Flickr/Yahoo:
> 
> That's great, I will rework the change a bit.

Any update? The problem here is not the limit in itself, rather the inability to give an offset. I'd be fine selecting the first 50 items, then selecting from 51 on etc.; but I can't, so all sets with more than 50 images are unusable and one has to use [[m:flickr2commons]] or PWB.
I'd even call this a major bug.
Comment 12 Nischay Nahata 2013-06-19 13:29:45 UTC
(In reply to comment #11)
> Any update?

Still waiting for review :/
Comment 13 Jarek Tuszynski 2014-05-06 12:15:48 UTC
I just come here to report the same issue, but I guess Waldir, beat me to it (by 2 years). Any progress?

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links