Last modified: 2013-12-29 04:31:23 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T54692, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 52692 - Migrate Pywikibot bugs from Sourceforge to Bugzilla (set up product etc)
Migrate Pywikibot bugs from Sourceforge to Bugzilla (set up product etc)
Status: RESOLVED FIXED
Product: Wikimedia
Classification: Unclassified
Bugzilla (Other open bugs)
wmf-deployment
All All
: High normal with 1 vote (vote)
: ---
Assigned To: Kunal Mehta (Legoktm)
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2013-08-10 06:42 UTC by Andre Klapper
Modified: 2013-12-29 04:31 UTC (History)
13 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Comment 1 Andre Klapper 2013-08-10 06:47:45 UTC
Required information: https://www.mediawiki.org/wiki/Bug_management/Project_Maintainers#To_add_a_project_or_component

Please agree on the components you would like to have (plus descriptions for them, and default CCs for them).
Comment 2 Andre Klapper 2013-08-10 06:54:35 UTC
For mailing list configuration: Bugmail will be sent
          From: bugzilla-daemon@wikimedia.org
Comment 3 Amir Ladsgroup 2013-08-10 07:02:49 UTC
"Pywikipedia-bugs@lists.wikimedia.org" it's the mailing list
Comment 4 Andre Klapper 2013-08-13 12:59:53 UTC
Account created in Bugzilla. Set to "disabled" so nobody can log in via it (or trigger a password reset request that would end up on the public mailing list), but it will still receive bugmail once in use.

Next step is to agree on a list of components to create in Bugzilla, under the new product, and defining default assignees (one email address per component, could be the default "Nobody") and default CC (can be several email addresses  per component).
Comment 5 Amir Ladsgroup 2013-08-14 10:24:47 UTC
Good, I am going to talk to people and start to discuss on components
Comment 6 Merlijn van Deen (test) 2013-08-19 08:15:58 UTC
Legoktm started work on a migration script here: https://github.com/pywikibot/sf-export

André, if I remember correctly, your preferred way of importing bugs was to just use the API and create new bugs, instead of (for example) using an XML import. Did I remember that correctly? :-)
Comment 7 Andre Klapper 2013-08-19 10:05:19 UTC
If the JSON/XML-RPC API allows what you plan to do, this would definitely be the prefered way to interact with Bugzilla.

For WebService related stuff see http://www.bugzilla.org/docs/4.2/en/html/api/index.html however I'm afraid I won't be a big help with that (only got basic knowledge).
Comment 8 Andre Klapper 2013-08-31 14:53:04 UTC
I'm basically waiting for anybody to tell me "Go ahead and create the components in Bugzilla, here is the list that we agreed on". Just for your info. :)
Comment 9 Amir Ladsgroup 2013-08-31 15:06:43 UTC
Dear Andre, Legoktm made a repository for migration to bugzilla, you can see the codes and make some comments: https://git.wikimedia.org/summary/pywikibot%2Fsf-export.git;jsessionid=15o181f6ixjjm1tiqekojib2l1
we are discussing on some aspects of the migration here:
https://gerrit.wikimedia.org/r/81176

we talk about the migration almost every day in IRC

Be sure we'll do it :)

best
Comment 10 Merlijn van Deen (test) 2013-08-31 16:30:46 UTC
Basically, the initial components would be:

    components = [	
        'category.py',	
        'copyright.py',	
        'Cosmetic changes',	
        'General',	
        'i18n',	
        'interwiki.py',	
        'login.py',	
        'network',	
        'redirect.py',	
        'solve_disambiguation.py',	
        'weblinkchecker.py',	
        'Wikidata',	
    ]

I think it would be good to create the project and these components already, as that would allow testing the migration etc.
Comment 11 Amir Ladsgroup 2013-09-01 03:30:10 UTC
(In reply to comment #10)
> Basically, the initial components would be:
> 
>     components = [    
>         'category.py',    
>         'copyright.py',    
>         'Cosmetic changes',    
>         'General',    
>         'i18n',    
>         'interwiki.py',    
>         'login.py',    
>         'network',    
>         'redirect.py',    
>         'solve_disambiguation.py',    
>         'weblinkchecker.py',    
>         'Wikidata',    
>     ]
> 
> I think it would be good to create the project and these components already,
> as
> that would allow testing the migration etc.

Agreed (I wish we could like comments here :D)
Comment 12 Andre Klapper 2013-09-02 14:24:09 UTC
Product and initial components created:
   https://bugzilla.wikimedia.org/describecomponents.cgi?product=Pywikipedia
with Pywikipedia-bugs@ as default assignee, and nobody in the default CC.

I still need descriptions for the components. Did not find out how to get a list of existing labels for a project in SourceForge.net's tracker. :(
Comment 13 Merlijn van Deen (test) 2013-09-02 14:53:54 UTC
{1}.py: 'bugs related to the {1}.py script'
cosmetic changes: 'bugs related to cosmetic changes applied during edits'
i18n: 'bugs related to localization/internationalization: for example templates used on different sites and translatewiki integration'
network: 'bugs related to the communication between the bot and the server - for example HTTP or API errors'
wikidata: 'bugs related to the wikidata implementation or wikidata-related scripts'

It's pretty hard to come up with good descriptions, though, so I can imagine someone else being able to think of something better.
Comment 14 Andre Klapper 2013-09-02 15:05:55 UTC
Thanks; updated.
Comment 15 Amir Ladsgroup 2013-09-02 17:32:17 UTC
Per some discussions in the mailing list the official name of the project is Pywikibot, can you change it?

Best
Comment 16 Andre Klapper 2013-09-02 17:36:55 UTC
(In reply to comment #15)
> the official name of the project is Pywikibot

Fixed. Sorry, got confused. :-/
Comment 17 Amir Ladsgroup 2013-09-02 18:26:06 UTC
(In reply to comment #16)
> (In reply to comment #15)
> > the official name of the project is Pywikibot
> 
> Fixed. Sorry, got confused. :-/

Thank you :)
Comment 18 Maarten Dammers 2013-09-17 22:01:18 UTC
Any news on the import?
Andre, can you please set the emailformat to text only?
Comment 19 Andre Klapper 2013-09-18 10:46:57 UTC
(In reply to comment #18)
> Any news on the import?

I myself cannot offer any news as I don't know the Sourceforge API and as I only know a little bit the Bugzilla API. I've pointed to http://www.bugzilla.org/docs/4.2/en/html/api/Bugzilla/WebService for anybody who would like to try writing a script, or https://github.com/awjrichards/bingle for an example of interacting with Bugzilla's API. 
If this is overkill (I honestly don't know about how many tickets we talk, e.g. also closed ones?) I'm also happy to help transfering tickets manually.

> Andre, can you please set the emailformat to text only?

That's a user setting, see section "Preferred email format" on https://bugzilla.wikimedia.org/userprefs.cgi?tab=settings
Comment 20 Maarten Dammers 2013-09-18 10:59:50 UTC
Hi Andre,

(In reply to comment #19)
> > Andre, can you please set the emailformat to text only?
> 
> That's a user setting, see section "Preferred email format" on
> https://bugzilla.wikimedia.org/userprefs.cgi?tab=settings

I know, but I can't change it for emails send to Pywikipedia-bugs@lists.wikimedia.org . I believe you're the owner of that account.
Comment 21 Merlijn van Deen (test) 2013-09-18 11:26:23 UTC
legoktm is working on the export - see https://github.com/wikimedia/pywikibot-sf-export for the repository.

The number of bugs is relatively small (100, maybe a few 100) as we are not transferring closed bugs. We could therefore choose to fix the metadata afterwards manually, instead of trying to get it right in the bot.
Comment 22 Andre Klapper 2013-09-18 12:36:59 UTC
(In reply to comment #20)
> I know, but I can't change it for emails send to
> Pywikipedia-bugs@lists.wikimedia.org

Oops, I misunderstood. It should be fixed now.
Comment 23 Kunal Mehta (Legoktm) 2013-09-21 03:41:48 UTC
Ok, script is all ready, tried importing a bug (bug 54415!) which basically worked until I ran into bug 54416. Once that is taken care of, it should be reasonably simple to import the rest. I already have the OAuth keys for sf.net set up, so I'll take care of running the script.
Comment 24 Andre Klapper 2013-09-24 15:18:31 UTC
dzahn has merged Legoktm's patch so a SourceForge URL can be set if they do not end in a slash /.
Comment 25 Kunal Mehta (Legoktm) 2013-09-24 23:02:20 UTC
Update:

I imported all of the patches from sourceforge. It mainly worked, except that it didn't add a comment on the sf tickets pointing to bugzilla. Not sure why...

Some patches failed fetching, but it should be possible for us to pull which ones from the log...worst case we have to check the sourceforge link and get the patch from there manually.
Comment 26 DrTrigon 2013-09-28 19:15:27 UTC
Has somebody experience of doing the same with JIRA tickets?
Comment 27 Kunal Mehta (Legoktm) 2013-10-05 05:48:11 UTC
Done!

I sent an email to the list as well: http://lists.wikimedia.org/pipermail/pywikipedia-l/2013-October/008393.html

I have a 1.6MB debug log file if anyone wants ;-)
Comment 28 Andre Klapper 2013-10-05 07:41:23 UTC
Thanks everybody, great work!
Comment 29 Merlijn van Deen (test) 2013-10-05 10:16:31 UTC
One last thing that would be nice: could we get a version selector, to select between 'core (2.0)', 'compat (1.0)' and 'unspecified'?
Comment 30 Nemo 2013-10-05 10:33:56 UTC
(In reply to comment #27)
> I have a 1.6MB debug log file if anyone wants ;-)

Any private information in there? If not, please attach it here for reference.
Comment 31 Nemo 2013-10-05 10:36:52 UTC
By the way Legoktm you're a crazy martyr, why didn't you use an alternate account for filing? :O Luckily with 5.0 you'll be able to ignore all those bugs when you get tired of them https://bugzilla.mozilla.org/show_bug.cgi?id=148564
Comment 32 Nemo 2013-10-05 23:47:40 UTC
The escaping on comments is rather awful, but not a tragedy.

Is the project on sourceforge going to stay forever? Many bugs originally had patches and other stuff necessary to understand or act on the report, but the attachments have not been imported.

Also, where should I propose new components? Maybe a wiki page for the first bunch?
Comment 33 Andre Klapper 2013-10-06 10:14:40 UTC
(In reply to comment #29)
> could we get a version selector, to select between 'core (2.0)', 
> 'compat (1.0)' and 'unspecified'?

Added.
Comment 34 Andre Klapper 2013-10-15 14:07:44 UTC
Migration has been finished; closing as FIXED. Followup issues can be handled in separate reports and/or talk pages, mailing lists.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links