Last modified: 2011-11-29 03:21:02 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T16584, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 14584 - New API to give latest dump file release
New API to give latest dump file release
Status: RESOLVED INVALID
Product: Datasets
Classification: Unclassified
General/Unknown (Other open bugs)
unspecified
All All
: Normal enhancement with 1 vote (vote)
: ---
Assigned To: Roan Kattouw
http://download.wikipedia.org/enwikip...
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2008-06-18 16:23 UTC by Andrew Dunbar
Modified: 2011-11-29 03:21 UTC (History)
3 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Andrew Dunbar 2008-06-18 16:23:53 UTC
It is beyond what the API currently does but it's also on topic and might be worthwhile.

Currently to programatically check whether a new dump file is available you need to resort to screen scraping. To do so from JavaScript is even tricker because of the cross-domain policy.

The minimum requirement of the API would just return the ASCII date of the most recent fully successful dump for the wiki. For example the dump file I'm currently using for en.wiktionary is "20080613".
Comment 1 Roan Kattouw 2008-06-18 19:34:55 UTC
I assume this is about http://download.wikipedia.org/backup-index.html ? In my opinion, download.wikipedia.org itself is responsible for offering a proper bot interface. There's no communication from enwiktionary to download.wikipedia.org, only the latter grabbing data from the former and tarballing it, so there's not really a way for enwiktionary to know when it was last successfully dumped (other than screenscraping behind the scenes, which would just move the problem).

Moving this bug to the Wikimedia product, as it's for Wikimedia's dump facility to address, not the MediaWiki software itself.
Comment 2 Brion Vibber 2008-07-05 00:20:29 UTC
Use the RSS feeds for this; they're in the latest dirs alongside the symlinks.
Comment 3 Andrew Dunbar 2008-07-05 13:53:19 UTC
Adding URL to the "latest" dir for enwikipedia since they are not publicized or linked to from anywhere and thus very hard to find.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links