Migration of mailman2 mailing lists to discourse.osgeo.org

@cvvergara is experimenting with migrating mailing lists on our staging instance of discourse to see how the process works. I know @rhaubourg already expressed interest in moving over the QGIS-fr. Once we’ve done these tests, we’ll be ready to do that.

@cvvergara found this plugin mailman2discourse HOWTO migrate from mailman2 to discourse - support - Discourse Meta which she has installed on osgeo6. She is testing it out. If anyone has any advice on the matter, feel free to post on this topic

@cvvergara @robe also Italian community is interested to move to it, as soon as possible. Our server is out of life, new are getting backup of some mailing list we are interested to maintain.

It could be possible get private channels for the association board and members?

Yes discourse supports private channels. I’ve made you an admin, so if you want to experiment with making a category and a group, feel free to try.

So where is your mailing list?

We decided not to use mailman2discourse plugin.
Was failing, so we are going to use the following instructions:

Currently we are testing here:

A small mailing list (osgeolive-doc) and a medium size mailing list (sac) is been improted which took Done (00h 47min 37sec) for 16200 messages…
There are some issues we still need to figure out, because the messages from the trac tickets are incomplete.
Also we need to experiment on how to merge accounts, like if someone signed up with a different email from ldap account mail, it will show as different people.
Merging key personalities from OSGeo will be necessary.
Instructions for merging:

Also the merging needs to be done after all the (active) lists have been transferred to discourse.
The original archives will be kept.
We will try to do this transfer during a holiday. Because when this transfer is happening it shutdown discourse’s incoming and outgoing mails.

@rhaubourg
We imported qgis-fr-users

Maybe you want to check it out on how it looks.
Please don’t hesitate to mention any problem you might see.

Forgot to mention, its on staging its not yet on production.

Hi Régina and Vicky,

thanks a lot for this. I’m starting to play with the qgis-fr category with some advanced users. I already received very welcoming feedback.

I’ll keep you posted of my tests. I particularly will test the “mailing list” access to discourse. We have have those kind of users still on IRC that will keep on claiming for mailing lists. I’d like them to be happy.

Cheers
Régis

1 Like

Okay just a note that the mailing list feature does not work on the staging server, just this production server since staging can’t receive incoming mails.

I mean the staging will send mail but can’t receive like this production one.

Also if you could encourage all the QGIS-fr folks to register here, that would be great. They should add any email addresses they use to send to their profile.

One thing @cvvergara observed when bringing over the data is that it brings over users with no matching email address as staged users. Since you were already registered, all your emails got mapped to your account. That would save us the pain of having to convert staged accounts to real accounts or merging accounts later.

Example mail that does not show body

Contents in the mbox file

From trac_osgeo@osgeo.org  Sat Dec 16 13:33:09 2023
Return-Path: <trac_osgeo@osgeo.org>
Received: from trac.osgeo.org (secure.osgeo.osuosl.org [140.211.15.57])
 by lists.osgeo.org (Postfix) with ESMTP id 0D0006146809
 for <sac@lists.osgeo.org>; Sat, 16 Dec 2023 13:33:09 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=osgeo.org; s=mail;
 t=1702762389; bh=3auJR1DAuFeP3rOWnokmCOAS3O9iz3E6/axb745KbB0=;
 h=From:Cc:To:Date:Reply-To:Subject:From;
 b=g7QtguCcvO1zhnZHgkHpsQskBGYFZgHIpcpRH9SWy+4VIJWmv5sVE6AGR481B2Yjd
 TMMKyOMzb2YpYCwiIhI6USrVLaD2b5SfoG/tE12bKQspGgkopidVX6fTrGTOz8F6ho
 sQZ6jz7+Gn6Yoad4KoyGmr/cSYHGyY8ZTIetjnCZzORuYpk0cub6RMIlrpx75h3/lF
 IK3DZayyvR5up03H+AgRygy3oWLPY/eYGgldLejkHt3hM2bFy+N8M0rqsuOoK7ZGLy
 0dFoG/mHhY6xDCMfqAfNZHVlxvGi7fr0jguikPyn+TqZkBTJBKEbUvr8cntVO5fFtD
 B1fo9rWj/ld3A==
Received: from [127.0.0.1] (localhost [127.0.0.1])
 by trac.osgeo.org (Postfix) with ESMTP id A604317D726
 for <sac@lists.osgeo.org>; Sat, 16 Dec 2023 13:33:08 -0800 (PST)
Content-Type: multipart/related;
 boundary="===============0115443114123754895=="
MIME-Version: 1.0
X-Trac-Realm: ticket
From: "OSGeo" <trac_osgeo@osgeo.org>
X-Trac-Version: 1.4.3
Precedence: bulk
Cc: sac@lists.osgeo.org
Auto-Submitted: auto-generated
X-Mailer: Trac 1.4.3, by Edgewall Software
To: undisclosed-recipients: ;
X-Trac-Project: OSGeo
Date: Sat, 16 Dec 2023 21:33:08 -0000
Reply-To: sac@lists.osgeo.org
Message-ID: <034.b9781e8cf1422a76c30f9320c6fe6a03@osgeo.org>
X-URL: https://osgeo.org/
X-Trac-Ticket-ID: 3053
X-Trac-Ticket-URL: https://trac.osgeo.org/osgeo/ticket/3053
Subject: [OSGeo] #3053: tracsvn out of disk space again
X-BeenThere: sac@lists.osgeo.org
X-Mailman-Version: 2.1.34
List-Id: System Administration Committee Discussion/OSGeo <sac.lists.osgeo.org>
List-Unsubscribe: <https://lists.osgeo.org/mailman/options/sac>,
 <mailto:sac-request@lists.osgeo.org?subject=unsubscribe>
List-Archive: <http://lists.osgeo.org/pipermail/sac/>
List-Post: <mailto:sac@lists.osgeo.org>
List-Help: <mailto:sac-request@lists.osgeo.org?subject=help>
List-Subscribe: <https://lists.osgeo.org/mailman/listinfo/sac>,
 <mailto:sac-request@lists.osgeo.org?subject=subscribe>
X-List-Received-Date: Sat, 16 Dec 2023 21:33:09 -0000
Status: RO
Content-Length: 1469
Lines: 24

--===============0115443114123754895==
MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64

IzMwNTM6IHRyYWNzdm4gb3V0IG9mIGRpc2sgc3BhY2UgYWdhaW4KLS0tLS0tLS0tLS0tLS0tLS0t
LS0tLSstLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQogUmVwb3J0ZXI6ICBy
b2JlICAgICAgfCAgICAgIE93bmVyOiAgc2FjQOKApgogICAgIFR5cGU6ICB0YXNrICAgICAgfCAg
ICAgU3RhdHVzOiAgbmV3CiBQcmlvcml0eTogIG5vcm1hbCAgICB8ICBNaWxlc3RvbmU6ICBTeXNh
ZG1pbiBDb250cmFjdCAyMDIzLUkKQ29tcG9uZW50OiAgU3lzQWRtaW4gIHwgICBLZXl3b3JkczoK
LS0tLS0tLS0tLS0tLS0tLS0tLS0tLSstLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t
LS0tLQogQVMgdXN1YWwgZ2l0ZWEgdGFyYmFsbHMgd2VyZSB0YWtpbmcgdXAgYWJvdXQgMTAwR0Ig
b2Ygc3BhY2UuCgogSG93ZXZlciBpdCBoYXMgYSB3aG9sZSAxVEIgZGVkaWNhdGVkIHRvIGl0IGFu
ZCBldmVuIGRlbGV0aW5nIG1hbnkgb2YgdGhlCiBzeXN0ZW0gc25hcHNob3RzIEkgbm90aWNlZCBv
bmx5IGJyb3VnaHQgaXQgdG8gNDAwRyBhdmFpbGFibGUuCgogVGhlIHJzeW5jIGpvYiB0byBvc2dl
bzQgc2VlbWVkIHRvIGJlIHN0dWNrIGZyb20gbGFzdCBydW4sIGFuZCBJIHN1c3BlY3QKIHRoYXQg
aG9sZCwgd2FzIHByZXZlbnRpbmcgdGVtcCBzdHVmZiBmcm9tIGNsZWFyaW5nLgoKIE9TR2VvNyBp
cyBkdWUgZm9yIGEgcmVib290IHNvIGhvcGVmdWxseSB0aGF0IHdpbGwgY2xlYXIgb3V0IHNvbWUg
b3RoZXIKIGxvY2tlZCBzbmFwc2hvdHMgbGlrZSB0aGUgb2xkIGRyb25pZS1zZXJ2ZXIgY29udGFp
bmVyIEkgY2FuJ3QgZGVsZXRlLgotLSAKVGlja2V0IFVSTDogPGh0dHBzOi8vdHJhYy5vc2dlby5v
cmcvb3NnZW8vdGlja2V0LzMwNTM+Ck9TR2VvIDxodHRwczovL29zZ2VvLm9yZy8+Ck9TR2VvIGNv
bW1pdHRlZSBhbmQgZ2VuZXJhbCBmb3VuZGF0aW9uIGlzc3VlIHRyYWNrZXIu

--===============0115443114123754895==--

Body can be seen using mutt:

Date: Sat, 16 Dec 2023 21:33:08 -0000
From: OSGeo <trac_osgeo@osgeo.org>
To: undisclosed-recipients: ;
Cc: sac@lists.osgeo.org
Subject: [OSGeo] #3053: tracsvn out of disk space again
X-Mailer: Trac 1.4.3, by Edgewall Software
X-URL: https://osgeo.org/

[-- Attachment #1 --]
[-- Type: text/plain, Encoding: base64, Size: 1.3K --]

#3053: tracsvn out of disk space again
----------------------+--------------------------------------
 Reporter:  robe      |      Owner:  sac@…
     Type:  task      |     Status:  new
 Priority:  normal    |  Milestone:  Sysadmin Contract 2023-I
Component:  SysAdmin  |   Keywords:
----------------------+--------------------------------------
 AS usual gitea tarballs were taking up about 100GB of space.

 However it has a whole 1TB dedicated to it and even deleting many of the
 system snapshots I noticed only brought it to 400G available.

 The rsync job to osgeo4 seemed to be stuck from last run, and I suspect
 that hold, was preventing temp stuff from clearing.

 OSGeo7 is due for a reboot so hopefully that will clear out some other
 locked snapshots like the old dronie-server container I can't delete.
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/3053>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.

Hi Vicky,
I checked the staging server and the imported threads look really nice!
Users are mapped correctly, I can reply. So far so good!

qgis-fr-user is converted in production.

Please review.
Regards

It’s actually an attachment, not body, if I interpret the mail correctly. Why Trac sends mail as an attachment I don’t know

Are mailing list subscriptions somehow mapped to write access in categories? In the threads in QGIS-fr-user - OSGeo I do not have a Reply option.

Perfect !

Le ven. 22 déc. 2023 à 22:25, Celia Virginia Vergara Castillo via OSGeo <noreply@discourse.osgeo.org> a écrit :

cvvergara
December 22

qgis-fr-user is converted in production.

[QGIS-fr-user] Test de migration de la mailing list vers discourse.osgeo.fr QGIS-fr-user

Message from system administrators for OSGeo. We have migrated the old listings over to https://discourse.osgeo.org If you want to send a message by email, first make sure you have registered at https://discourse.osgeo.org and then you can send email to: qgis-fr-user@discourse.osgeo.org You can use discourse directly by login in. Starting from today, any mail sent to the mailman mailing list will not be included into discourse. The mailman mailing list is going to be disabled before the en…

Please review.
Regards


Visit Topic or reply to this email to respond.

To unsubscribe from these emails, click here.

Are you still having the same issue. Might have been blogged because we were in middle of import.

Okay I see the issue now. Yah it was because only people in the QGIS-fr-user group were allowed to reply. I might have put that in when I set it up. I just changed so everyone registered can post and reply. @rhaubourg feel free to change it back if that is an issue.

Our mailing list are here http://lists.gfoss.it/mailman/listinfo.

We need to keep only three mailing list (Gfoss is the public one, Consiglio is private for the board and Gfoss-soci is private for GFOSS association members)

1 Like

Is it possible for you to grab the mboxes of that. @cvvergara can give you direction on that if you need it or can help out with that if she has access to the server. If you are ready to go we could just import and invite everyone in the list over to the new system. Or we could just mirror the lists for a bit until you are ready for a cut over.

Yes it is possible, we can use scp but I need to send our private key so it can be added to their server ssh service.
Will contact @lucadelu privaletly