[SAC] [OSGeo] #2711: wiki is down at the moment

#2711: wiki is down at the moment
---------------------------+---------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Sysadmin Contract 2022-II
Component: Systems Admin | Keywords:
---------------------------+---------------------------------------
I had issues with backup of it and having issues remounting.

I may need to restart osgeo3

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2711&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2711: wiki is down at the moment
---------------------------+----------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Sysadmin Contract 2022-II
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+----------------------------------------

Comment (by robe):

Okay I'm going to reboot osgeo3 in a bit.

The following will be affected:

{{{
gallery.nextcloud.osgeo.org
repo.osgeo.org
matrix.osgeo.org
grass-wiki
wiki.osgeo.org
limesurvey.osgeo.org
talks.osgeo.org
}}}

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2711#comment:1&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2711: wiki is down at the moment
---------------------------+----------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: closed
Priority: normal | Milestone: Sysadmin Contract 2022-II
Component: Systems Admin | Resolution: fixed
Keywords: |
---------------------------+----------------------------------------
Changes (by robe):

* status: new => closed
* resolution: => fixed

Comment:

Okay back up now including wiki.osgeo.org

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2711#comment:2&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2711: wiki is down at the moment
---------------------------+----------------------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: closed
Priority: normal | Milestone: Sysadmin Contract 2022-II
Component: Systems Admin | Resolution: fixed
Keywords: |
---------------------------+----------------------------------------

Comment (by robe):

POSTMORTEM

Okay looks like the issue with wiki.osgeo.org was caused by lxd update
that for some reason the wiki container got stuck in a mid mounted state,
which allowed it to run fine but caused snapshot failure.

Normally I can do something like below to fix the snapshot issue, but
didn't work this time.

{{{
lxc stop wiki
sudo zfs umount osgeo3_lxd/containers/wiki
sudo rm /var/snap/lxd/common/lxd/storage-
pools/default/containers/wiki/backup.yaml
lxc start wiki #if fails try to mount
sudo zfs mount osgeo3_lxd/containers/wiki
lxc start wiki
}}}

I can tell lxd upgraded because:

{{{
snap info lxd
}}}

shows
{{{
snap-id: J60k4JY0HppjwOjW8dZdYc8obXKxujRu
tracking: latest/stable
refresh-date: today at 10:10 PST
channels:
   latest/stable: 4.22 2022-02-03 (22340) 79MB -
   latest/candidate: 4.22 2022-02-02 (22340) 79MB -
   latest/beta: ↑
   latest/edge: git-0d31b88 2022-02-03 (22345) 80MB -
}}}

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2711#comment:3&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.