[OSGeo] #3052: Upgrade pretalx to latest version

#3052: Upgrade pretalx to latest version
----------------------+--------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Sysadmin Contract 2023-I
Component: SysAdmin | Keywords:
----------------------+--------------------------------------
Current version is pretalx — Releasing pretalx v2023.1.3 (bugfix release)

Our last release was about a year ago.

I'll test on staging first.
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/3052&gt;
OSGeo <Gter - OSGeo;
OSGeo committee and general foundation issue tracker.

#3052: Upgrade pretalx to latest version
----------------------+---------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Sysadmin Contract 2023-I
Component: SysAdmin | Resolution:
Keywords: |
----------------------+---------------------------------------
Comment (by robe):

Looks like now pretalx supports PostgreSQL as a database platform and is
now stated as the preferred platform instead of MySQL/mariaDb.

I'm having a bit of difficulty building the new docker images for these,
so will take a bit of time for me to resolve.

It's mostly an issue with adding in the extensions we are using.
Also for some reason I got an error some application error trying to pull
the 2023.1.3/latest base image from docker hub:

{{{
failed to register layer: ApplyLayer exit status 1 stdout: stderr: lchown
/pretalx/src/pretalx/frontend/schedule-editor/node_modules/character-
parser/.npmignore: invalid argument
}}}

  so I ended up rebuilding from the github docker-repo. That seemed to
work fine, so it's just the pretalx-pages and public-voting extension I'm
struggling with.
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/3052#comment:1&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#3052: Upgrade pretalx to latest version
----------------------+---------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Sysadmin Contract 2023-I
Component: SysAdmin | Resolution:
Keywords: |
----------------------+---------------------------------------
Comment (by lucadelu):

Thanks Robe to look on it, pretalx-pages plugin is not really important,
instead we need public-voting one.
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/3052#comment:2&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#3052: Upgrade pretalx to latest version
----------------------+---------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Sysadmin Contract 2024-I
Component: SysAdmin | Resolution:
Keywords: |
----------------------+---------------------------------------
Comment (by robe):

I was able to building the package with the two plugins we had pretalx-
pages, public-voting upgrade staging to 2024.1.0 and also the ubuntu from
20.04 to 22.04.

To do so, I built the base image instead of pulling it from
hub.docker.com. For some reason, when I tried to pull from
hub.docker.com, I got an error about subguids (I think a limitation of
running docker within a container). Not sure why I never have had the
issue with other docker images. But building the base image from scratch,
using that to install the plugins, and pushing to docker.osgeo.org worked
fine and I was able to pull and install.

At a glance it seems okay but not much data in staging to tell. I'll
upgrade production later today.

I'm going to upgrade
--
Ticket URL: <#3052 (Upgrade pretalx to latest version) – OSGeo;
OSGeo <Gter - OSGeo;
OSGeo committee and general foundation issue tracker.

#3052: Upgrade pretalx to latest version
----------------------+---------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Sysadmin Contract 2024-I
Component: SysAdmin | Resolution:
Keywords: |
----------------------+---------------------------------------
Comment (by robe):

Starting the upgrade process first with the OS from Ubuntu 20.04 to 22.04.
--
Ticket URL: <#3052 (Upgrade pretalx to latest version) – OSGeo;
OSGeo <Gter - OSGeo;
OSGeo committee and general foundation issue tracker.

#3052: Upgrade pretalx to latest version
----------------------+---------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: closed
Priority: normal | Milestone: Sysadmin Contract 2024-I
Component: SysAdmin | Resolution: fixed
Keywords: |
----------------------+---------------------------------------
Changes (by robe):

* status: new => closed
* resolution: => fixed

Comment:

Done with upgrade. Now talks.osgeo.org is at preltalx version 2024.1.

I didn't switch the database to postgresql, but did upgrade from MySQL 5
to MySQL 8 as is needed to run 2024.1.
--
Ticket URL: <#3052 (Upgrade pretalx to latest version) – OSGeo;
OSGeo <Gter - OSGeo;
OSGeo committee and general foundation issue tracker.

#3052: Upgrade pretalx to latest version
----------------------+---------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: reopened
Priority: normal | Milestone: Sysadmin Contract 2024-I
Component: SysAdmin | Resolution:
Keywords: |
----------------------+---------------------------------------
Changes (by robe):

* status: closed => reopened
* resolution: fixed =>

Comment:

Oops just noticed an issue, the media is not showing like images of people
and css.

e.g.

An overview of Cloud-Native Geospatial :: FOSS4G 2023 :: pretalx

Going to check what's wrong there.
--
Ticket URL: <#3052 (Upgrade pretalx to latest version) – OSGeo;
OSGeo <Gter - OSGeo;
OSGeo committee and general foundation issue tracker.

#3052: Upgrade pretalx to latest version
----------------------+---------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: reopened
Priority: normal | Milestone: Sysadmin Contract 2024-I
Component: SysAdmin | Resolution:
Keywords: |
----------------------+---------------------------------------
Comment (by robe):

I've rolled back to old pretalx until I figure out why it is not reading
the volume folders.

Issue is it's not reading the /data/media folder, though if I upload a
file, it does put it in the right place, but for some reason the web app
is not mapping /data/media to url /media

I had thought maybe I wiped out the volume, but all files are there.
--
Ticket URL: <#3052 (Upgrade pretalx to latest version) – OSGeo;
OSGeo <Gter - OSGeo;
OSGeo committee and general foundation issue tracker.

#3052: Upgrade pretalx to latest version
----------------------+---------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: reopened
Priority: normal | Milestone: Sysadmin Contract 2024-I
Component: SysAdmin | Resolution:
Keywords: |
----------------------+---------------------------------------
Comment (by robe):

One more interesting development. I am having the same issue on
talk.staging.osgeo.org, but I noticed if I flip the switch from debug =
False to debug = True, it works properly.

This of course is not desirable, so I'm troubleshooting this some more and
will report upstream if I conclude all my config settings are set
properly.
--
Ticket URL: <#3052 (Upgrade pretalx to latest version) – OSGeo;
OSGeo <Gter - OSGeo;
OSGeo committee and general foundation issue tracker.

#3052: Upgrade pretalx to latest version
----------------------+---------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: reopened
Priority: normal | Milestone: Sysadmin Contract 2024-I
Component: SysAdmin | Resolution:
Keywords: |
----------------------+---------------------------------------
Comment (by robe):

Reported upstream - media folder not accessible when not in debug mode · Issue #62 · pretalx/pretalx-docker · GitHub
--
Ticket URL: <#3052 (Upgrade pretalx to latest version) – OSGeo;
OSGeo <Gter - OSGeo;
OSGeo committee and general foundation issue tracker.

#3052: Upgrade pretalx to latest version
----------------------+---------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: reopened
Priority: normal | Milestone: Sysadmin Contract 2024-I
Component: SysAdmin | Resolution:
Keywords: |
----------------------+---------------------------------------
Comment (by lucadelu):

@robe thanks a lot for your time. Maybe something related to this
improve ux with hints for serve all requests for the `/static/` and `/media/` paths by turbotimon · Pull Request #60 · pretalx/pretalx-docker · GitHub ?
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/3052#comment:11&gt;
OSGeo <Gter - OSGeo;
OSGeo committee and general foundation issue tracker.

#3052: Upgrade pretalx to latest version
----------------------+---------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: reopened
Priority: normal | Milestone: Sysadmin Contract 2024-I
Component: SysAdmin | Resolution:
Keywords: |
----------------------+---------------------------------------
Comment (by robe):

Replying to [comment:11 lucadelu]:
> @robe thanks a lot for your time. Maybe something related to this
improve ux with hints for serve all requests for the `/static/` and `/media/` paths by turbotimon · Pull Request #60 · pretalx/pretalx-docker · GitHub ?

That pull request just seems to edit comments and no logical changes so
don't think that is it.
--
Ticket URL: <#3052 (Upgrade pretalx to latest version) – OSGeo;
OSGeo <Gter - OSGeo;
OSGeo committee and general foundation issue tracker.

#3052: Upgrade pretalx to latest version
----------------------+---------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: reopened
Priority: normal | Milestone: Sysadmin Contract 2024-I
Component: SysAdmin | Resolution:
Keywords: |
----------------------+---------------------------------------
Comment (by lucadelu):

The /media and /static directory are served by the web server?

@robe could you please activate the staging website (also the older
version in the case), I need it for tonight to present it to FOSS4G 2024
team

Best
Luca
--
Ticket URL: <#3052 (Upgrade pretalx to latest version) – OSGeo;
OSGeo <Gter - OSGeo;
OSGeo committee and general foundation issue tracker.

#3052: Upgrade pretalx to latest version
----------------------+---------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: reopened
Priority: normal | Milestone: Sysadmin Contract 2024-I
Component: SysAdmin | Resolution:
Keywords: |
----------------------+---------------------------------------
Comment (by robe):

Replying to [comment:13 lucadelu]:
> The /media and /static directory are served by the web server?
>

Yes except it works in debug mode and has worked before without having to
install a separate webserver.

> @robe could you please activate the staging website (also the older
version in the case), I need it for tonight to present it to FOSS4G 2024
team
>
> Best
> Luca

For this do you want the latest production server data in it?
--
Ticket URL: <#3052 (Upgrade pretalx to latest version) – OSGeo;
OSGeo <Gter - OSGeo;
OSGeo committee and general foundation issue tracker.

#3052: Upgrade pretalx to latest version
----------------------+---------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: reopened
Priority: normal | Milestone: Sysadmin Contract 2024-I
Component: SysAdmin | Resolution:
Keywords: |
----------------------+---------------------------------------
Comment (by robe):

P.S. I was thinking it was the introduction of the
GUNICORN_FORWARDED_ALLOW_IPS cause that would explain why it works in
debug and not production, but setting that didn't seem to make a
difference
--
Ticket URL: <#3052 (Upgrade pretalx to latest version) – OSGeo;
OSGeo <Gter - OSGeo;
OSGeo committee and general foundation issue tracker.

#3052: Upgrade pretalx to latest version
----------------------+---------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: reopened
Priority: normal | Milestone: Sysadmin Contract 2024-I
Component: SysAdmin | Resolution:
Keywords: |
----------------------+---------------------------------------
Comment (by lucadelu):

Replying to [comment:14 robe]:
> Replying to [comment:13 lucadelu]:
> > The /media and /static directory are served by the web server?
> >
>
> Yes except it works in debug mode and has worked before without having
to install a separate webserver.
>

because in debug mode Django get the static and media in a different way

>
> For this do you want the latest production server data in it?

as you prefer (and time to do it), I can create a test event without any
problem
--
Ticket URL: <#3052 (Upgrade pretalx to latest version) – OSGeo;
OSGeo <Gter - OSGeo;
OSGeo committee and general foundation issue tracker.

#3052: Upgrade pretalx to latest version
----------------------+---------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: reopened
Priority: normal | Milestone: Sysadmin Contract 2024-I
Component: SysAdmin | Resolution:
Keywords: |
----------------------+---------------------------------------
Comment (by robe):

@lucadelu,

I've closed out #3162. Staging is now based on yesterday's backup of
production.

Regarding the issue of /media and /static looking at our current
production server I do see that there is an nginx instance that starts up
as part of it, so guess maybe that's what's changed that nginx was built
into the container before.

I'm debating if I should just stick with docker and launch and nginx
container beside, or just go with the supported way of running pretalx
(which is not using docker), Rixx said he doesn't support docker
officially.
--
Ticket URL: <#3052 (Upgrade pretalx to latest version) – OSGeo;
OSGeo <Gter - OSGeo;
OSGeo committee and general foundation issue tracker.

#3052: Upgrade pretalx to latest version
----------------------+---------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: reopened
Priority: normal | Milestone: Sysadmin Contract 2024-I
Component: SysAdmin | Resolution:
Keywords: |
----------------------+---------------------------------------
Comment (by robe):

On further inspection, I see the issue is they removed nginx from the
image.

https://github.com/pretalx/pretalx-
docker/commit/702197a82d924d043dd8ac42cc9491387246d1ce
--
Ticket URL: <#3052 (Upgrade pretalx to latest version) – OSGeo;
OSGeo <Gter - OSGeo;
OSGeo committee and general foundation issue tracker.

#3052: Upgrade pretalx to latest version
----------------------+---------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: reopened
Priority: normal | Milestone: Sysadmin Contract 2024-I
Component: SysAdmin | Resolution:
Keywords: |
----------------------+---------------------------------------
Comment (by lucadelu):

Replying to [comment:17 robe]:
> @lucadelu,
>
> I've closed out #3162. Staging is now based on yesterday's backup of
production.
>
Thanks

> Regarding the issue of /media and /static looking at our current
production server I do see that there is an nginx instance that starts up
as part of it, so guess maybe that's what's changed that nginx was built
into the container before.
>
> I'm debating if I should just stick with docker and launch and nginx
container beside, or just go with the supported way of running pretalx
(which is not using docker), Rixx said he doesn't support docker
officially.
>

I have no clear idea as well, probably having all in docker should be
better, I don't know but maybe you could add a nginx container and provide
media and static with it?
--
Ticket URL: <#3052 (Upgrade pretalx to latest version) – OSGeo;
OSGeo <Gter - OSGeo;
OSGeo committee and general foundation issue tracker.

#3052: Upgrade pretalx to latest version
----------------------+---------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: reopened
Priority: normal | Milestone: Sysadmin Contract 2024-I
Component: SysAdmin | Resolution:
Keywords: |
----------------------+---------------------------------------
Comment (by robe):

@lucadelu,

I've tested on a plain vanilla new version https://talks.dev.osgeo.org

this one has a separate nginx in the docker-compose.

Let me know once you are done with your training today and I'll try to
upgrade https://talks.staging.osgeo.org the same way I did
talks.dev.osgeo.org and have you check it out before I deploy the upgrade
to production.
--
Ticket URL: <#3052 (Upgrade pretalx to latest version) – OSGeo;
OSGeo <Gter - OSGeo;
OSGeo committee and general foundation issue tracker.