Discussion:
Realistic responses to DMARC
John Levine
2016-12-18 02:28:23 UTC
Permalink
+1. FWIW, I have to agree with Ted here. When a large mail
provider knowingly and unrepentantly does something that
violates well-established and well-defined standards and fouls
up mailing lists for others, especially when that provider also,
within their business model, pushes a "forum" service that is an
alternative to those mailing lists, ...
While I am no fan of what Yahoo has done, I think we should limit the
conspiracy theorizing. I have it on excellent authority that the
reason Yahoo turned on DMARC was entirely the user complaints about
spam with forged addresses taken from stolen address books. It had
nothing to do with Yahoo Groups.

Yahoo management knew this would screw up every mailing list in the
world, and they explicitly didn't care. I'm reasonably sure that the
people who run Yahoo Mail had different opinions but they didn't get
to make the decision. While it is true that it would not be hard to
circumvent DMARC, crooks are as lazy as the rest of us and I continue
to be surprised at the amount of phish stopped by DMARC's simplistic
checks.

I hear that the amount of legit mail that DMARC breaks is well under
1% of the total non-spam mail at large providers, and even though they
know it is mail that the recipients are very interested in, it's hard
to make a business case for doing something for that 0.5 % unless they
are very sure it won't let a lot of the phish back in. That's the
rationale for ARC, which is a complicated crock, but lets the
provlders make a reasoanble guess about what's non-spam from mailing
lists. (FYI, they also tell me that legit lists leak spam all the
time due to compromised or forged subscriber accounts, so it has to be
more than just whitelisting the lists.)
If the net effect is that users of that provider's systems have
to find another mechanism to participate in IETF work, that is
the fault of the provider, not the IETF. ...
I appreciate the theory, but we also need to consider how much blood
loss we are willing to accept to cut off our noses to spite our faces.
It is pretty clear that within the next year Gmail will turn on a
DMARC policy, too, and I expect other large mail providers to turn it
on, too.

If we tell people, sorry, you can't participate in the IETF using the
giant mail providers you use for everything else, what do you expect
the response to be? Wow, what a bunch of noble principled idealists,
or wow, I don't have time for this nonsense, maybe I'll go work on
some open source stuff on github instead. We have enough trouble
recruiting people now without putting more roadblocks in their way.

A few of us have been doing some experiments on DMARC avoidance,
looking to see if there's something we can do that will survive DMARC,
not screw up the mail too badly so it's legible and recipients can
reply reasonably, while uglifying it to remind people whose fault it
is. Some of the possibilities involve wrapping the real message in an
outer one, some involve changing the From: address to a mutated
version of the sender's address (*not* the list's address.)

Maybe ARC will work well enough that we won't have to do anything, but
I expect ARC will be a half solution at best, since it assumes
recipient MTAs have a rather sophisticated filter system that can
handle all the stuff in the ARC chain of forwarding headers.

R's,
John
Theodore Ts'o
2016-12-18 05:58:34 UTC
Permalink
Post by John Levine
If we tell people, sorry, you can't participate in the IETF using the
giant mail providers you use for everything else, what do you expect
the response to be? Wow, what a bunch of noble principled idealists,
or wow, I don't have time for this nonsense, maybe I'll go work on
some open source stuff on github instead. We have enough trouble
recruiting people now without putting more roadblocks in their way.
Um, you're assuming that mailing lists serving open source projects
will either (a) knuckle under to the demands of DMARC, or (b) be
willing to inflict the pain caused by DMARC-workarounds on their
users, aren't you?

I can think of one major open source project (namely, the Linux
kernel) which has refused to do either.

- Ted
John R Levine
2016-12-18 06:04:14 UTC
Permalink
Post by Theodore Ts'o
Um, you're assuming that mailing lists serving open source projects
will either (a) knuckle under to the demands of DMARC, or (b) be
willing to inflict the pain caused by DMARC-workarounds on their
users, aren't you?
Yes, those are the only choices at this point.
Post by Theodore Ts'o
I can think of one major open source project (namely, the Linux
kernel) which has refused to do either.
I'm reasonably sure you're mistaken here. Don't they rewrite From:
headers?

R's,
John
Theodore Ts'o
2016-12-18 06:59:05 UTC
Permalink
Post by John R Levine
Yes, those are the only choices at this point.
Post by Theodore Ts'o
I can think of one major open source project (namely, the Linux
kernel) which has refused to do either.
I'm reasonably sure you're mistaken here. Don't they rewrite From: headers?
Nope, vger.kernel.org doesn't rewrite from headers. An example of a
recent e-mail I received from the linux-fsdevel maliing list:

Date: Tue, 6 Dec 2016 23:53:57 +0100
From: David Gstir <***@sigma-star.at>
To: linux-***@lists.infradead.org
CC: ***@mit.edu, ***@gmail.com, ***@google.com,
***@google.com, ***@intel.com,
linux-***@vger.kernel.org, ***@infradead.org,
linux-***@vger.kernel.org, ***@kernel.org,
***@linutronix.de, ***@denx.de, ***@denx.de,
***@nod.at, David Gstir <***@sigma-star.at>
Subject: [PATCH v2 5/6] fscrypt: Delay bounce page pool allocation until needed
X-Mailer: git-send-email 2.10.1

The fact that the from field is not rewritten is *IMPORTANT* because
rewriting the from field would break the "git am" command[1], since it
uses the From: field to fill in the git commit's from field, and it
would be sad if all of the git commits had an authorship of
linux-***@vger.kernel.org or ***@ietf.org. :-)

[1] https://www.kernel.org/pub/software/scm/git/docs/git-am.html

This is what allows the above mail headers to result in a git commit
which looks like this when applied using "git am":

commit f32d7ac20a5864483c1f96e4970daa083e18bfd1
Author: David Gstir <***@sigma-star.at>
AuthorDate: Tue Dec 6 23:53:57 2016 +0100
Commit: Theodore Ts'o <***@mit.edu>
CommitDate: Sun Dec 11 16:33:11 2016 -0500

fscrypt: Delay bounce page pool allocation until needed

----

I will note that at least some people with ***@google.com addresses
have reported *not* having DMARC problems when using mailing lists at
vger.kernel.org, despite the fact that google.com has a dmarc p=REJECT
policy. I can only guess (from external observation; I haven't looked
at any of the gmail anti-spam algorithms, nor do I have any interest
in looking at them) that even a DMARC p=reject is probably only
resulting in a very high spam score, but using either machine learning
or a manual setting, mail from vger.kernel.org (with perhaps certain
text features from the body of the e-mail very clearly not offering
the sale of pharmaceuticals or making money fast) is given a
sufficiently high score to offset the p=reject score. And so
apparently mail sent from ***@google.com via a vger.kernel.org mailing
list, is apparently still reaching ***@gmail.com, even though
google.com has a p=reject policy, and even though gmail.com purports
to honor the DMARC spec.

Which brings up something interesting/important about DMARC --- what's
important is not just the DMARC policy of the sender's domain, but
also how the recipient domain is handling the DMARC policy. It's
pretty clear that some recipient domains are not following the DMARC
specification strictly with respect to rejecting p=reject e-mail addresses.
So while mail sent by a sender who's domain has a p=reject via a
vger.kernel.org mailing list might get accepted by a recipient at
gmail.com, it might not be accepted by a recipient at yahoo.com ---
and that bounce might cause the yahoo.com recipient to get
automatically unsubscribed from the mailing list.

But that's probably fine, because no there are very few developers
using yahoo.com (and probably up to a billion fewer now :-). And so
as we can see, even honoring DMARC policies can cause mailing list
participants pain; it's not just sending from p=reject domains that
cause pain in terms of possibly unreceived e-mail (and possibly
bumping people in the first category off the list due to
auto-unsubscription policies).

Therefore, a developer-friendly mail service MUST NOT have a p=reject
or p=quarantee DMARC policy, and MUST also ignore DMARC policies on
the receiving end. Fortunately, these mail services do exist, even if
they aren't the big, free consumer ones.

Cheers,

- Ted
John R Levine
2016-12-18 07:24:03 UTC
Permalink
Post by Theodore Ts'o
Therefore, a developer-friendly mail service MUST NOT have a p=reject
or p=quarantee DMARC policy, and MUST also ignore DMARC policies on
the receiving end. Fortunately, these mail services do exist, even if
they aren't the big, free consumer ones.
Linux may be enough of a cult that developers will put up with having to
use a mail account different from the one they use for everything else,
but as I've said a couple of times already, I don't think the IETF can
stand the blood loss.

There are some workarounds, maybe ARC, maybe message wrapping, maybe some
kind of From: munging. We're looking at them and scratching our heads.

R's,
John

Loading...