Last modified: 2014-01-30 15:09:28 UTC
Basic smoke tests for the UploadWizard have been created, they need to be run for the following use cases: 0) Sanity checks before deployment of a release to any of our environments (alpha, beta, prod). These and other integration/end-to-end tests should be run and if failures found the deployment stops. 1) These tests and other end-to-end tests can be run continuously against production to check the sanity of the UploadWizard functionality, once/twice a day.
First step will be to run this agains production every 6h and notify 'multimedia@lists.wikimedia.org' and #wikimedia-multimedia if something goes wrong.
Hi Aaron, I think it's good to figure out some visible place for these alerts, but please don't use the multimedia@ mailing list (or any mailing list primarily focused on human discussion) for automated alerts. There are 120 subscribers to the mailing list right now, most of which can't do anything about the alerts, and some of which don't particularly care about production issues on our sites because they're interested in multimedia features in MediaWiki on their sites. If we need to use a currently existing mailing list, we should ask about using operations@, since that one already has ample precedent for automated alerts of system health.
Cloudbees Python documentation: http://developer.cloudbees.com/bin/view/DEV/Python
Change 108924 had a related patch set uploaded by Zfilipin: WIP Run UploadWizard API tests at CloudBees https://gerrit.wikimedia.org/r/108924
For related discussion on QA mailing list, search for "Run UploadWizard API integration test against production" at http://lists.wikimedia.org/pipermail/qa/2014-January/date.html#start
I have started working on this[1][2]. Looks like there is a problem[3]: ... + DEV/bin/pip install -rtest/api/requirements.txt Downloading/unpacking wikitools>=1.1 (from -r test/api/requirements.txt (line 1)) Downloading wikitools-1.1.1.tar.gz Running setup.py (path:/scratch/jenkins/workspace/UploadWizard-commons.wikimedia.org/DEV/build/wikitools/setup.py) egg_info for package wikitools Downloading/unpacking poster>=0.8 (from -r test/api/requirements.txt (line 2)) Downloading poster-0.8.1.tar.gz Running setup.py (path:/scratch/jenkins/workspace/UploadWizard-commons.wikimedia.org/DEV/build/poster/setup.py) egg_info for package poster Downloading/unpacking PIL>=1.1.7 (from -r test/api/requirements.txt (line 3)) Could not find any downloads that satisfy the requirement PIL>=1.1.7 (from -r test/api/requirements.txt (line 3)) Some externally hosted files were ignored (use --allow-external PIL to allow). Cleaning up... No distributions at all found for PIL>=1.1.7 (from -r test/api/requirements.txt (line 3)) ... 1: https://wmf.ci.cloudbees.com/view/r-uw/ 2: https://gerrit.wikimedia.org/r/#/c/108924/ 3: https://wmf.ci.cloudbees.com/view/r-uw/job/UploadWizard-commons.wikimedia.org/2/console
Change 109080 had a related patch set uploaded by Zfilipin: WIP Using PIL 1.1.6 instead of 1.1.7 https://gerrit.wikimedia.org/r/109080
I not familiar with python at all. I did my best, but it still does not work. Jenkins job configuration: https://gerrit.wikimedia.org/r/#/c/108924/ requirements.txt: https://gerrit.wikimedia.org/r/#/c/109080/ Jenkins job log: https://wmf.ci.cloudbees.com/job/UploadWizard-commons.wikimedia.org/13/console
Change 109080 merged by jenkins-bot: Change requirements.txt so that PIL actually installs on Cloudbees https://gerrit.wikimedia.org/r/109080
Change 109661 had a related patch set uploaded by Zfilipin: MEDIAWIKI_PASSWORD_VARIABLE environment variable points to the variable that contains the password https://gerrit.wikimedia.org/r/109661
Change 109680 had a related patch set uploaded by Zfilipin: WIP Run UploadWizard API integration test https://gerrit.wikimedia.org/r/109680
Change 108924 abandoned by Zfilipin: WIP Run UploadWizard API tests at CloudBees Reason: moved to https://gerrit.wikimedia.org/r/#/c/109680/ https://gerrit.wikimedia.org/r/108924
Change 109680 merged by Cmcmahon: WIP Run UploadWizard API integration test https://gerrit.wikimedia.org/r/109680
Change 109871 had a related patch set uploaded by Zfilipin: WIP Run UploadWizard API integration test https://gerrit.wikimedia.org/r/109871
Change 109661 merged by jenkins-bot: Add functionality to specify the MEDIAWIKI_PASSWORD_VARIABLE environment variable that points to the variable that contains the password https://gerrit.wikimedia.org/r/109661
Marked as resolved. Please reopen is something still needs to be done.
Change 109871 merged by jenkins-bot: Run UploadWizard API integration test https://gerrit.wikimedia.org/r/109871
