[SAC] [OSGeo] #2475: OSGeo mail server on DNS Blacklist

#2475: OSGeo mail server on DNS Blacklist
---------------------------+-----------------------
Reporter: Jeff McKenna | Owner: jsanz
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Mailing Lists | Keywords:
---------------------------+-----------------------
I noticed that on June 17th I stopped receiving all OSGeo mails from all
OSGeo mailing lists (I must be on over 200 lists). Zero since June 17th.

(someone somewhere must be laughing at this though, as one of the only
mails to still make it to me are from the geoserver-devel list, as it is
of course through !SourceForge, ha, someone must be laughing at how ironic
that is for me)

I realize that this must be regarding my own email host/provider. I have
checked the osgeo6 mail logs, and the logs are littered with entries
similar to:

{{{
Jun 22 06:05:49 osgeo6 postfix/smtp[14162]: 887506143EA5:
to=<jmckenna@gatewaygeomatics.com>,
relay=mailroot3.namespro.ca[169.55.177.75]:25, delay=2.9,
delays=0.1/1.8/0.43/0.58, dsn=5.0.0, status=bounced (host
mailroot3.namespro.ca[169.55.177.75] said: 554 The IP address of the
sender (140.211.15.3) was found in a DNS blacklist database and was
therefore refused. (in reply to RCPT TO command))
}}}

I have contacted my email provider, and will file a request to remove the
blacklist ban on the OSGeo6 mail server (140.211.15.3).

I guess this ticket has not much to do with OSGeo-SAC, but maybe someday
someone else out there will face something similar, and this ticket's
archive may help someone.

I'll update this ticket when the DNS blacklist entry is removed.

Short story: I'm now an expert on recent !GeoServer activity :slight_smile:

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2475&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2475: OSGeo mail server on DNS Blacklist
---------------------------+------------------------
Reporter: Jeff McKenna | Owner: jsanz
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Mailing Lists | Resolution:
Keywords: |
---------------------------+------------------------

Comment (by Jeff McKenna):

Updates:

  - osgeo6 mail server IP address is listed in the Barracuda blacklist:
https://mxtoolbox.com/SuperTool.aspx?action=blacklist%3A140.211.15.3

  - I have filed a request with Barracuda to remove the entry through
http://www.barracudanetworks.com/reputation/?pr=1&ip=140.211.15.3 . The
response is:
    {{{
Request Received
Thank you for submitting your request. If this is your first request, your
IP address will have its reputation increased to "normal" for 48 hours
while we investigate. It may take up to 1 hour for the reputation increase
to propagate to all Barracuda Spam Firewalls globally. We appreciate your
patience and apologize for any inconvenience.

Your confirmation number is XXXX.
}}}

/me Heart's 70's song lyrics "oooo barracuda" plays in my head now,
unfortunately

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2475#comment:1&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2475: OSGeo mail server on DNS Blacklist
---------------------------+------------------------
Reporter: Jeff McKenna | Owner: jsanz
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Mailing Lists | Resolution:
Keywords: |
---------------------------+------------------------

Comment (by Jeff McKenna):

update: Barracuda has removed the blacklist entry, for 48 hours as they
investigate. Will keep you posted here on the response (especially as
this ban affects many users, as I see in the log entries on the server).

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2475#comment:2&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2475: OSGeo mail server on DNS Blacklist
---------------------------+------------------------
Reporter: Jeff McKenna | Owner: jsanz
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Mailing Lists | Resolution:
Keywords: |
---------------------------+------------------------

Comment (by Jeff McKenna):

update: reports from the QGIS community on others not receiving emails for
a few days (likely the same June 17th day). This is obviously affecting
thousands of OSGeo users on various mailing lists, although most won't
realize.

Will keep you updated here on the status, I'm still waiting to hear back
from the "Barracuda" blacklist people.

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2475#comment:3&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2475: OSGeo mail server on DNS Blacklist
---------------------------+------------------------
Reporter: Jeff McKenna | Owner: jsanz
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Mailing Lists | Resolution:
Keywords: |
---------------------------+------------------------

Comment (by rduivenvoorde):

I had a look into the admin interface for QGIS dev and users list, and
conclude that problably a lot of users have this 'nomail[reason]' checkbox
checked now.

Would it be a possibility to do an update query in the db (/me just
guessing this is in a db....)?
(AFTER we are assured that we/OSGEO are not on any spam list anymore...)

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2475#comment:4&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2475: OSGeo mail server on DNS Blacklist
---------------------------+------------------------
Reporter: Jeff McKenna | Owner: jsanz
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Mailing Lists | Resolution:
Keywords: mailman |
---------------------------+------------------------
Changes (by neteler):

* keywords: => mailman

Comment:

As it affects users across many OSGeo mailing lists:

Here a script **candidate** from https://www.msapiro.net/scripts/ which
could be used as a basis for an automated user reactivation:

  * set_nomail.py: Sets a list member's delivery to 'disabled by admin' or
optionally sets to 'disabled by bounce' and starts the notification and
deletion process.
    * https://www.msapiro.net/scripts/set_nomail.py

The script would require some changes as it has the opposite purpose
(AFAIK).

Also interesting

  * get_bounce_info.py: Prints the bounce information for all list members
that have any.
    * https://www.msapiro.net/scripts/get_bounce_info.py

However, careful with subscribers who set "nomail" on purpose (unless
that's different from a bounce based "nomail", I don't know enough about
these mailman details.).

Importantly, be sure that there is a fresh backup in place before
modifying any mailman subscriptions.

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2475#comment:5&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2475: OSGeo mail server on DNS Blacklist
---------------------------+------------------------
Reporter: Jeff McKenna | Owner: jsanz
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Mailing Lists | Resolution:
Keywords: mailman |
---------------------------+------------------------

Comment (by neteler):

Ah I just see we addressed something similar 13 years ago :slight_smile:

https://trac.osgeo.org/osgeo/ticket/175#comment:5

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2475#comment:6&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2475: OSGeo mail server on DNS Blacklist
---------------------------+------------------------
Reporter: Jeff McKenna | Owner: jsanz
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Mailing Lists | Resolution:
Keywords: mailman |
---------------------------+------------------------

Comment (by Jeff McKenna):

Just now received this message:
{{{
140.211.15.3
Removed from BARRACUDA at 6/27/2020 7:25:47 AM (UTC-04:00) Atlantic Time
(Canada)
}}}

This is good news.

I think this affected many users, including the Nabble forums.

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2475#comment:7&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2475: OSGeo mail server on DNS Blacklist
---------------------------+------------------------
Reporter: Jeff McKenna | Owner: jsanz
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Mailing Lists | Resolution:
Keywords: mailman |
---------------------------+------------------------

Comment (by andreaerdna):

Replying to [comment:7 Jeff McKenna]:

> I think this affected many users, including the Nabble forums.

In the [http://osgeo-org.1560.x6.nabble.com/QGIS-f4099105.html QGIS
directory of Nabble forums] there are some strange that shouldn't be
there:

[http://osgeo-org.1560.x6.nabble.com/Buy-US-UK-German-drivers-license-ID-
card-passport-online-www-migrantdocuments-com-tp5442014.html Buy
US/UK/German drivers license, ID card, passport online.] Jul 12

[http://osgeo-org.1560.x6.nabble.com/How-I-can-earn-money-online-
tp5440128.html How I can earn money online?] Jun 15

[http://osgeo-org.1560.x6.nabble.com/Writing-an-article-tp5440313.html
Writing an article] Jun 17

[http://osgeo-org.1560.x6.nabble.com/Error-adding-point-properties-
tp5440270.html Error adding point properties] Jun 17

Could these be part of the issue?

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2475#comment:8&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2475: OSGeo mail server on DNS Blacklist
---------------------------+------------------------
Reporter: Jeff McKenna | Owner: jsanz
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Mailing Lists | Resolution:
Keywords: mailman |
---------------------------+------------------------

Comment (by jsanz):

@andreaerdna that's not related. I removed those messages that were posted
because the permissions at the "folder" level allowed to post there. Yet
another target for spammers :frowning:

Thanks for reporting!

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2475#comment:9&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2475: OSGeo mail server on DNS Blacklist
---------------------------+------------------------
Reporter: Jeff McKenna | Owner: jsanz
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Mailing Lists | Resolution:
Keywords: mailman |
---------------------------+------------------------

Comment (by andreaerdna):

Hi Jorge,
thank you for removing the out of place posts and for setting the proper
permissions to the QGIS forums directory.

However, it seems the "QGIS - Developer" forum is again read-only now.

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2475#comment:10&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2475: OSGeo mail server on DNS Blacklist
---------------------------+------------------------
Reporter: Jeff McKenna | Owner: jsanz
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Mailing Lists | Resolution:
Keywords: mailman |
---------------------------+------------------------

Comment (by jsanz):

> However, it seems the "QGIS - Developer" forum is again read-only now.

Fixed

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2475#comment:11&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2475: OSGeo mail server on DNS Blacklist
---------------------------+------------------------
Reporter: Jeff McKenna | Owner: jsanz
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Mailing Lists | Resolution:
Keywords: mailman |
---------------------------+------------------------

Comment (by mbernasocchi):

Hi all, at opengis.ch we had at least 4 subscribers being bounced from
qgis-developer and other lists.
I've the feeling that this could be the case for man more users.
Where any actions (like the ones suggested by @neteler taken on this?

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2475#comment:12&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2475: OSGeo mail server on DNS Blacklist
---------------------------+------------------------
Reporter: Jeff McKenna | Owner: jsanz
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Mailing Lists | Resolution:
Keywords: mailman |
---------------------------+------------------------

Comment (by Jeff McKenna):

Personally I've tried to keep this ticket up-to-date with any actions
related to this spam issue, and tried to point those reporting this on
mailing lists to this ticket. I'm not aware of any other actions.

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2475#comment:13&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2475: OSGeo mail server on DNS Blacklist
---------------------------+------------------------
Reporter: Jeff McKenna | Owner: jsanz
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Mailing Lists | Resolution:
Keywords: mailman |
---------------------------+------------------------

Comment (by darkblueb):

''side note'' - I sent one email to `pka` @ `sourcepole.ch` from
California on 13jul20, through `carrierzone.com` mail servers (not OSGeo
mail servers). The email stalled for days and by Friday had bounced.

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2475#comment:14&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2475: OSGeo mail server on DNS Blacklist
---------------------------+------------------------
Reporter: Jeff McKenna | Owner: jsanz
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Mailing Lists | Resolution:
Keywords: mailman |
---------------------------+------------------------

Comment (by neteler):

As per old experience (https://trac.osgeo.org/osgeo/ticket/175#comment:7),
I have now reset all bounce rates to avoid that more ppl get unsubscribed:

{{{
withlist -a -r reset_bounce --
Importing reset_bounce...
Running reset_bounce.reset_bounce()...
Loading list africa (unlocked)
Loading list alberta (unlocked)
Loading list announce (unlocked)
Loading list argentina (unlocked)
Loading list atlanticcanada (unlocked)
Loading list board-ar (unlocked)
...
Loading list oceania-board (unlocked)
Loading list geonode-psc (unlocked)
Loading list mapproxy-dev (unlocked)
Loading list mobilitydb-dev (unlocked)
Loading list mobilitydb-users (unlocked)
Finalizing
}}}

Apparently the affected users got an email

"Your membership in the mailing list XXXXX has been disabled due to
excessive bounces..."

OK, I think I have an idea how to get the unsubscribed members back:

{{{
root@osgeo6: zgrep BYBOUNCE /var/log/mailman/subscribe* | wc -l
832
}}}

This list contains the emails and list names in this style:

{{{

/var/log/mailman/subscribe:Jul 13 09:00:02 2020 (30244) grass-user:
xxxx@example.com auto-unsubscribed [reason: BYBOUNCE]
}}}

Using it we could re-enable all lost members.

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2475#comment:15&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2475: OSGeo mail server on DNS Blacklist
---------------------------+------------------------
Reporter: Jeff McKenna | Owner: jsanz
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Mailing Lists | Resolution:
Keywords: mailman |
---------------------------+------------------------

Comment (by mkuhn):

Hi, I just re-subscribed manually.

Is this the recommended procedure and should a nice reminder be sent out
to those having been auto-unsubscribed with a link to reactivate the
account or should they better be re-enabled in an automated fashion as
proposed by neteler in the last comment?

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2475#comment:16&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2475: OSGeo mail server on DNS Blacklist
---------------------------+------------------------
Reporter: Jeff McKenna | Owner: jsanz
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Mailing Lists | Resolution:
Keywords: mailman |
---------------------------+------------------------

Comment (by neteler):

IMHO we need to find a volunteer who write to all unsubscribed folks (for
the email list, see comment:15 above) or run the re-subscribe operation.

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2475#comment:17&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2475: OSGeo mail server on DNS Blacklist
---------------------------+------------------------
Reporter: Jeff McKenna | Owner: jsanz
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Mailing Lists | Resolution:
Keywords: mailman |
---------------------------+------------------------

Comment (by mkuhn):

IMHO we should assess the lazy option "re-subscribe operation" first. Is
there anything holding us back from running it? Technical risks, Scripts
not up to date, Risks that we resubscribe users that have been
unsubscribed for a good reason?

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2475#comment:18&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2475: OSGeo mail server on DNS Blacklist
---------------------------+------------------------
Reporter: Jeff McKenna | Owner: jsanz
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Mailing Lists | Resolution:
Keywords: mailman |
---------------------------+------------------------

Comment (by mkuhn):

I currently have some time to devote into community projects. I am
available to invest some time here if I know what, where and the
priorities. Feel free to contact me here or directly by mail.

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2475#comment:19&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.