Last modified: 2014-05-12 21:48:38 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T60796, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 58796 - Tool Labs: Provide working mail addresses for users and service groups
Tool Labs: Provide working mail addresses for users and service groups
Status: RESOLVED FIXED
Product: Wikimedia Labs
Classification: Unclassified
tools (Other open bugs)
unspecified
All All
: High major
: ---
Assigned To: Marc A. Pelletier
:
Depends on: 63702
Blocks: tool-missing-ts-feat
  Show dependency treegraph
 
Reported: 2013-12-21 13:41 UTC by Merlijn van Deen (test)
Modified: 2014-05-12 21:48 UTC (History)
9 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Merlijn van Deen (test) 2013-12-21 13:41:56 UTC
From https://www.mediawiki.org/wiki/Wikimedia_Labs/Tool_Labs/Needed_Toolserver_features

"Uncertain how this is going to happen, but planned to find a way. For WMF, this is a legal question rather than a technical one. Main question: Which domain?" -- Silke WMDE (talk) 10:27, 7 April 2013 (UTC)

What is needed?
 - Mail-address for users.  (e.g. valhallasw@tools.wmflabs.org)
 - Mail-address for projects. (e.g. nlwikibots@tools.wmflabs.org)
 - Configurable Mail-forwarding for both. (using .forward or equivalent)

The default destination for projects could be a project-local mail box or all project users.


As a workaround, project mailing lists can be created as normal mailing lists. However, this takes a while...
Comment 1 Tim Landscheidt 2013-12-24 14:39:35 UTC
MZMcBride, please be careful with mass changes.  This bug is about mail addresses for users and tools in the Tools/Tool Labs/whatever project, not a general solution for all projects in Wikimedia Labs.
Comment 2 Silke Meyer (WMDE) 2014-01-23 17:28:54 UTC
Hi WMF, any status update on this?
Comment 3 DrTrigon 2014-01-26 09:54:21 UTC
I need mail for DrTrigonBot and I would be happy if we could test this at some point BEFORE shutting down the toolserver. Thanks
Comment 4 Tim Landscheidt 2014-01-26 18:27:44 UTC
(In reply to comment #3)
> I need mail for DrTrigonBot and I would be happy if we could test this at
> some
> point BEFORE shutting down the toolserver. Thanks

Just to clarify the scope of this bug: Outgoing mail is already working perfectly, this bug is about providing incoming mail addresses/forwarders that are reachable from the InterNet.
Comment 5 Marc A. Pelletier 2014-01-29 17:34:36 UTC
To update matters:

This has been cleared by legal, and we now have a definite architecture.  Incoming mail should arrive shortly after the migration of Labs to eqiad with the following functionality:

mail to <shelluser>@<project>.wmflabs.org will be forwarded to the email address of the user specified on Wikitech (as in 'email this user').

mail to <servicegroup>-maintainers@<project>.wmflabs.org will be forwarded to the email addresses of all the service group members as above.

Future functionality (soon after) will be to provide a per-service-group forwarding address through Wikitech (for redirecting to mailing lists, etc).
Comment 6 Silke Meyer (WMDE) 2014-02-05 08:59:01 UTC
Supporting DrTrigon - this has high priority after the migration of Labs.
Comment 7 DrTrigon 2014-02-15 21:14:42 UTC
Thanks for all comments!

I have following scenario: on TS (according to [1]) configuration involves the file '$HOME/.forward+subster' that contains:
 > ~/data/subster/mail_inbox
in order to enable mail (mbox style) storage in given file for address:
 drtrigon+subster@toolserver.org
Can I do the same here (already)? What would be the mail address? drtrigon+subster@tools.wmflabs.org, right? Is there a manual?

[1] https://wiki.toolserver.org/view/Mail

Another question is what happens to TS mail addresses after official shutdown? I think they should stay valid (forever), resp. be delivered or forwarded to users here. We need a transition period of appropriate duration - I think at least a year - in order to inform all involved external users and update all configurations.
Comment 8 DrTrigon 2014-03-09 09:54:47 UTC
What is the current status?

I REALLY NEED THIS BEFORE TS goes down! Since today I not able to login to TS anymore and the cgi interface is down, see e.g. [1]. What happens here???

[1] http://toolserver.org/~drtrigon/cgi-bin/panel.py
Comment 9 Marc A. Pelletier 2014-03-09 13:44:10 UTC
This should be coming, I expect, in a week or so.
Comment 10 Tim Landscheidt 2014-03-23 18:39:26 UTC
(In reply to DrTrigon from comment #7)
> I have following scenario: on TS (according to [1]) configuration involves
> the file '$HOME/.forward+subster' that contains:
>  > ~/data/subster/mail_inbox
> in order to enable mail (mbox style) storage in given file for address:
>  drtrigon+subster@toolserver.org
> Can I do the same here (already)? What would be the mail address?
> drtrigon+subster@tools.wmflabs.org, right? Is there a manual?
> [...]

The basic mail system seems to have been set up (cf. labs-l), but AFAIUI local storage is neither allowed nor possible.  I have seen some talk about a grid-enabled procmail, but no code yet.

What is your use case for drtrigon+subster@toolserver.org?
Comment 11 Marc A. Pelletier 2014-03-23 19:35:46 UTC
There is now support for sending incoming mail to a process.  I'm debugging an issue with it, and will document it shortly.
Comment 12 Silke Meyer (WMDE) 2014-04-01 17:49:28 UTC
ETA first week of April, according to office hour.
Comment 13 Marc A. Pelletier 2014-04-02 13:46:08 UTC
This is now working, as documented at:

https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help#Email
Comment 14 DrTrigon 2014-04-08 18:58:29 UTC
(In reply to Marc A. Pelletier from comment #13)
> This is now working, as documented at:
> 
> https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help#Email

It tried it yesterday by setting up ~/.forward.subster containing:
|jmail cat > ~/data/subster/mail_inbox_test

This does not seam to work - if I try to send a mail to drtrigonbot.subster@tools.wmflabs.org I do not receive the mail but it bounces with following error:
Diagnostic-Code: smtp;400 4.4.7 Message delayed

Is the mail server running? What am I doing wrong?
Comment 15 Tim Landscheidt 2014-04-08 21:25:30 UTC
Opened bug #63702 for the issue in comment #14.
Comment 16 DrTrigon 2014-04-09 20:29:26 UTC
(In reply to Tim Landscheidt from comment #15)
> Opened bug #63702 for the issue in comment #14.

Thanks!
Comment 17 DrTrigon 2014-04-12 10:19:15 UTC
I re-opened this bug since for me it was NEVER solved: "Provide WORKING mail addresses ..." this system was never working for me - just because it is supposed to be working does not mean it works.
Comment 18 Tim Landscheidt 2014-04-12 14:21:20 UTC
(In reply to DrTrigon from comment #17)
> I re-opened this bug since for me it was NEVER solved: "Provide WORKING mail
> addresses ..." this system was never working for me - just because it is
> supposed to be working does not mean it works.

I'm not going to engage in an edit war here, but mail addresses *are* working.  I wrote in comment #10:

> [...]
> The basic mail system seems to have been set up (cf. labs-l), but AFAIUI
> local storage is neither allowed nor possible.  I have seen some talk about
  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> a grid-enabled procmail, but no code yet.

And I did not receive any answer for my question:

> What is your use case for drtrigon+subster@toolserver.org?

But despite (!) this, using "|jmail cat > /data/project/wikilint/mailbox" as /data/project/wikilint/.forward.subster perfectly stores incoming mail to wikilint.subster@tools.wmflabs.org at the specified location (though I didn't assume that it would even work as it uses a shell redirection and [[wikitech:Nova Resource:Tools/Help#Processing email programatically]] spoke only of "program" without any shell syntax or arguments).

So by all accounts, this bug is fixed for me.
Comment 19 jeremyb 2014-04-12 15:43:25 UTC
Reclosing, let's just use the other bug for the remaining issue.
Comment 20 DrTrigon 2014-04-13 17:30:25 UTC
(In reply to Tim Landscheidt from comment #18)
> (In reply to DrTrigon from comment #17)
> > I re-opened this bug since for me it was NEVER solved: "Provide WORKING mail
> > addresses ..." this system was never working for me - just because it is
> > supposed to be working does not mean it works.
> 
> I'm not going to engage in an edit war here, but mail addresses *are*
> working.  I wrote in comment #10:
> 
> > [...]
> > The basic mail system seems to have been set up (cf. labs-l), but AFAIUI
> > local storage is neither allowed nor possible.  I have seen some talk about
>   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> > a grid-enabled procmail, but no code yet.
> 
> And I did not receive any answer for my question:
> 
> > What is your use case for drtrigon+subster@toolserver.org?

It's a pitty but the mail adresses are not working for me, as written in bug 63702 neither the tool nor the user addresses work for me.

The question you asked got overseen by my - sorry for that. On the toolserver I have drtrigon+subster@toolserver.org as a mail address where every mail gets piped to ~/data/subster/mail_inbox in order to serve as an additional data source to be processed by some distinct bot later on. (As this works on the toolserver this has to work here too! ;)
The "use case" is that people, organistations, institutions, etc. that do not want to share some data (like world rankings etc.) in the puplic are still able to share the data with us.

> But despite (!) this, using "|jmail cat > /data/project/wikilint/mailbox" as
> /data/project/wikilint/.forward.subster perfectly stores incoming mail to
> wikilint.subster@tools.wmflabs.org at the specified location (though I
> didn't assume that it would even work as it uses a shell redirection and
> [[wikitech:Nova Resource:Tools/Help#Processing email programatically]] spoke
> only of "program" without any shell syntax or arguments).

'cat' is a programm that is supposed to take the standard input and pipe it then to a file (I would love to do this more directly if possible). That fits exactly in to the explanation on [[wikitech:Nova Resource:Tools/Help#Processing email programatically]].

But let's continue in bug 63702 I am very thankful for any help on this - even more as this feature DOES NOT WORK as on toolserver yet and is therefore NO APPROPRIATE REPLACMENT NOR SOLUTION TO TOOLSERVER YET.
Comment 21 Tim Landscheidt 2014-04-13 18:07:55 UTC
(In reply to DrTrigon from comment #20)
> [...]

> 'cat' is a programm that is supposed to take the standard input and pipe it
> then to a file (I would love to do this more directly if possible). That
> fits exactly in to the explanation on [[wikitech:Nova
> Resource:Tools/Help#Processing email programatically]].

> [...]

cat always outputs to standard output; cf. cat(1):

| DESCRIPTION
|        Concatenate FILE(s), or standard input, to standard
|        output.
Comment 22 DrTrigon 2014-04-13 18:43:29 UTC
(In reply to Tim Landscheidt from comment #21)
> (In reply to DrTrigon from comment #20)
> > [...]
> 
> > 'cat' is a programm that is supposed to take the standard input and pipe it
> > then to a file (I would love to do this more directly if possible). That
> > fits exactly in to the explanation on [[wikitech:Nova
> > Resource:Tools/Help#Processing email programatically]].
> 
> > [...]
> 
> cat always outputs to standard output; cf. cat(1):
> 
> | DESCRIPTION
> |        Concatenate FILE(s), or standard input, to standard
> |        output.

...and from there through pipe into file, right?
Comment 23 Tim Landscheidt 2014-05-12 21:48:38 UTC
(In reply to DrTrigon from comment #22)
> > > [...]
> > 
> > > 'cat' is a programm that is supposed to take the standard input and pipe it
> > > then to a file (I would love to do this more directly if possible). That
> > > fits exactly in to the explanation on [[wikitech:Nova
> > > Resource:Tools/Help#Processing email programatically]].

> > > [...]

> > cat always outputs to standard output; cf. cat(1):

> > | DESCRIPTION
> > |        Concatenate FILE(s), or standard input, to standard
> > |        output.

> ...and from there through pipe into file, right?

No, that is set up by the shell.  cat does not know which file (or pipe) its output is redirected to.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links