Last modified: 2014-09-17 08:50:22 UTC
X-YahooFilteredBulk: 208.80.152.133 (from https://en.wikipedia.org/?oldid=579580929#WMF_notification_email_marked_as_spam_by_Yahoo ) According to several comments, this means that our mail is currently blacklisted by Yahoo!, so it's sent in the "Bulk" folder for users who have it enabled (if not to spam?). WMF needs to send a "Bulk sender application for whitelisting" http://help.yahoo.com/kb/index?page=content&id=SLN9042 but first their guidelines have to be respected: http://help.yahoo.com/kb/index?y=PROD_MAIL_ML&page=content&id=SLN3435 There are several things in there that we don't do; let's add each of them to blockers when we're sure there's something to do. * "Use email authentication such as DKIM": low-hanging fruit, let's do it as soon as possible (bug 56413). * "Be CAN-SPAM compliant": it's USA law, I assume we're respecting it. :) It seems very lenient, from a quick skimming we're ok. http://business.ftc.gov/documents/bus61-can-spam-act-compliance-guide-business * "Consistently manage your lists": no idea, but MediaWiki surely doesn't remove/disable addresses which bounce: I remember Brion mentioning this in some 2005 bug comment or something like that, I don't know if there's an open bug but I'd say it's something worth doing. * "Segregate your mail streams by IP address and/or domain": in theory we do, I can't judge if well enough. * "Using your domain consistently": no idea, is it consistent to send from wiki@wikimedia.org but then use @wikipedia.org, @mediawiki.org and so on to From headers etc.? * "Publish reverse DNS (PTR) records for your sending IPs": looks ok. $ dig -x 208.80.152.133 ;; ANSWER SECTION: 133.152.80.208.in-addr.arpa. 3552 IN PTR wiki-mail.wikimedia.org. * "Secure your mail servers": I hope so. * "Use common-sense settings": it would be nice to track this (Ori, do you know something?), but Echo sends only few thousands notifications per day on en.wiki (https://toolserver.org/~dartar/en/echo/ ) and standard enotif (talk and watchlist) on all wikis is probably only one or two order of magnitudes bigger, it's still a ridiculously low amount of emails, we're not DoS'ing Yahoo!. It's possible that we have peaks, for instance an edit to a heavily watchlisted pages could cause a peak of thousands enotifs in a single second, but I doubt it's relevant. When we enabled enotifwatchlist on all wikis, the increased network activity of mchenry wasn't even visible at all in ganglia.
RT tracking: https://rt.wikimedia.org/Ticket/Display.html?id=6151
What's the status of the RT?
(In reply to comment #2) > What's the status of the RT? No activity, and no owner set.
I have upped the importance, because these delayed emails are causing major issues, and mailman is stalling as a result. Just 2 days ago, when mailman kicked back up, I received a flood of almost 50 emails from various lists. Please get this fixed ASAP. I don't want to listen to music and have my email client make incoming mail noises 47 times during one song.
What's the status of the RT now?
(In reply to comment #4) > I don't want to listen to music and have my email client make incoming mail > noises 47 times during one song. Whether it's IRC pings or SMS dings, a happier life is quieter things. :-)
Need to find out which exact guidelines are violated. (Re comment 4: I rather recommend to fix your email client.)
Uhm, I hadn't realized this is blocking bug 59731. I'm sorry; resetting to high priority again.
Updates?
My email client flooded again just now and a few hours ago.
(In reply to comment #10) > My email client flooded again just now and a few hours ago. https://ganglia.wikimedia.org/latest/?r=custom&cs=02%2F08%2F2014+23%3A00+&ce=02%2F09%2F2014+02%3A00+&c=Miscellaneous+eqiad&h=sodium.wikimedia.org&tab=m&vn=&hide-hf=false&mc=2&z=medium&metric_group=ALLGROUPS the exim_queued_messages graph seems to support that.
I'm seeing this issue getting worse, and there is nothing more annoying than leaving for 15 minutes and coming back to a flooded inbox, containing newly received emails sent from as far back as 7 days ago. This is also blocking another bug where sodium tends to fail to send messages as a result of this. I have therefore upped this bug's severity to blocker.
Please read [[mw:Bugzilla/Fields#Severity]] before changes. Apparently mail is not lost, but just delayed.
(In reply to comment #13) > Please read [[mw:Bugzilla/Fields#Severity]] before changes. Apparently mail > is > not lost, but just delayed. Well in that case restoring to what it was.
Any updates? I'm getting really close to unsubscribing.
(In reply to comment #15) > Any updates? I'm getting really close to unsubscribing. Did you write to Yahoo!'s customer service too, out of curiosity? If you can do something without WMF, just do it!
I tries clicking contact us and I just went in circles.
You should see my ISP's! It's easy: https://io.help.yahoo.com/contact/index?page=contact&locale=en_US&y=PROD_MAIL_ML -> Sending and receiving messages (last) -> Unable to receive messages (third last) -> Email
Note however that nowadays it's easier to receive support from email providers on Twitter, I see they're very active there: https://twitter.com/YahooCare You can also do some lobbying on their uservoice board; the only relevant topic I found is https://yahoo.uservoice.com/forums/210695-yahoo-mail/suggestions/5361666-final-solution-to-prevent-spam which proposes to whitelist wikipedia.org among other things. And of course I assume you went through https://help.yahoo.com/kb/mail/SLN3517.html
On a related note, I just ran into German article about the problems of people with a Yahoo mail account on http://www.heise.de/newsticker/meldung/DMARC-Policy-Yahoo-killt-Mailinglisten-Mitgliedschaften-2168857.html (and Google Translate to English pretty much works). For the records, Mailman 2.1.16 (which will be in Ubuntu Trusty) allows setting "FROM_IS_LIST=yes" to "replace the sender with the list address to conform with policies like ADSP and DMARC".
(In reply to Andre Klapper from comment #20) > On a related note, I just ran into German article about the problems of > people with a Yahoo mail account That's a new thing though, technical explanation at http://www.ietf.org/mail-archive/web/ietf/current/msg87153.html
I currently study the Yahoo and AOL’s recent change to DMARC, and the problem is pretty different than the one described here, basically because this one doesn’t relay emails (as do a mailing list) but sends original mails. Possibly it could be implemented DMARC(+DKIM+SPF) on wikimedia.org to improve delivrability for this bug, *BUT* this could lead to heavy consequences on other @wikimedia.org emails (like non-delivery) so it must be carefully thought before action.
(In reply to Nemo from comment #21) > (In reply to Andre Klapper from comment #20) > > On a related note, I just ran into German article about the problems of > > people with a Yahoo mail account > > That's a new thing though, technical explanation at > http://www.ietf.org/mail-archive/web/ietf/current/msg87153.html That was split to bug 64795.
Bug 56413 was fixed, so I'm told this is currently waiting for bug 46640 and mailman 2.1.17+ (for MediaWiki mailer's and mailman's IPs respectively).
*** Bug 70930 has been marked as a duplicate of this bug. ***
