#2454: rsync issue on staging.grass.osgeo.org
---------------------------+-----------------------
Reporter: neteler | Owner: sac@…
Type: defect | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Keywords: rsync
---------------------------+-----------------------
In preparation of making the new GRASS GIS website mirror'able via rsync,
I have added rsync support to https://staging.grass.osgeo.org but it
apparently requires something to be done on the host server.
{{{
ssh grasslxd
...
neteler@grass:~$ rsync localhost::
GRASS GIS Website
grass-website GRASS GIS Website
}}}
.. so far so nice.
But from external IP I only get this:
{{{
rsync staging.grass.osgeo.org::
download The whole OSGeo Download Area
bottle Homebrew packages
}}}
Nothing against those entries but I'd like to see the `grass-website` here
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2454>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.
#2454: rsync issue on staging.grass.osgeo.org
---------------------------+------------------------
Reporter: neteler | Owner: sac@…
Type: defect | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: rsync |
---------------------------+------------------------
Comment (by robe):
I'll look at this in a bit
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2454#comment:1>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.
#2454: rsync issue on staging.grass.osgeo.org
---------------------------+------------------------
Reporter: neteler | Owner: sac@…
Type: defect | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: rsync |
---------------------------+------------------------
Comment (by robe):
neteler,
Where are you mirroring too?
The way I rsync from one lxd host to say another host is this way.
Since download.osgeo.org (aka hop.osgeo7.osgeo.org) is the proxy you'll
need to copy keys there as well
Step 1
# in server you are using to mirror
#generate a key for server you want to mirror to
{{{
ssh-keygen -t rsa #accept the defaults
#copy the public key ~/.ssh/id_rsa.pub add it to your hop.osgeo7.osgeo.org
authorized_keys
}}
Step 2
#log into ssh neteler@hop.osgeo7.osgeo.org
{{
echo ssh-rsa --contents-public-key-here- grass@osgeo7 >>
~/.ssh/authorized_keys
}}
Step 3
#in grass container in the account you will be using for rsync
{{
echo ssh-rsa --contents-public-key-here- grass@osgeo7 >>
~/.ssh/authorized_keys
}}
Step 4 in the server you want to use for mirror
Add an entry to your ssh config
{{{
**create in server you want to mirror content ~/.ssh/config file that has
these lines**
Host grass
ProxyCommand ssh neteler@hop.osgeo7.osgeo.org -W %h:%p
}}}
Then to rsync you can do
{{{
#test inspect
rsync -avz --dry-run \
-e ssh root@grass:/var/www/grass-website \
/backups/grass-website
#real run
rsync -avz \
-e ssh root@grass:/var/www/grass-website \
/backups/grass-website
}}}
Other option is I could open a port in osgeo7 and allow grass to be
directly reachable by that port.
If we do that I would like to lock down grass so it's only accessible via
keys and block off password access.
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2454#comment:2>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.
#2454: rsync issue on staging.grass.osgeo.org
---------------------------+------------------------
Reporter: neteler | Owner: sac@…
Type: defect | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: rsync |
---------------------------+------------------------
Comment (by neteler):
I am sorry, I should have mentioned that we wish to have a public mirror
as on the old server (to be phased out): https://grass.osgeo.org/mirrors/
Would that be possible my opening the respective port?
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2454#comment:3>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.
#2454: rsync issue on staging.grass.osgeo.org
---------------------------+------------------------
Reporter: neteler | Owner: sac@…
Type: defect | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: rsync |
---------------------------+------------------------
Changes (by robe):
* cc: jef (added)
Comment:
Yes I think jef had set up an rsync that was public on download for
osuosl. I think it might have used http too. Didn't quite follow what he
did, but that might work here.
I didn't quite follow what he was doing, but I think what he did might not
have used the ssh port at all.
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2454#comment:4>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.
#2454: rsync issue on staging.grass.osgeo.org
---------------------------+------------------------
Reporter: neteler | Owner: sac@…
Type: defect | Status: closed
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution: fixed
Keywords: rsync |
---------------------------+------------------------
Changes (by robe):
* status: new => closed
* resolution: => fixed
Comment:
neteler,
I see that jef set it up the way you did using rsync daemon that runs on
port 873.
I can't easily give you the same one without allocating another ip which
would mean you can't use the same domain. Instead I mapped your 873
container port out to 50026.
So to do your rsync you have to specify the port. See if this works okay.
I tested on one of my servers and see grass website listed now
{{{
rsync --port=50026 staging.grass.osgeo.org::
}}}
Feel free to reopen if this doesn't solve your issue.
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2454#comment:5>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.
#2454: rsync issue on staging.grass.osgeo.org
---------------------------+------------------------
Reporter: neteler | Owner: sac@…
Type: defect | Status: closed
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution: fixed
Keywords: rsync |
---------------------------+------------------------
Comment (by neteler):
Looks good, thanks for your efforts!
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2454#comment:6>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.
#2454: rsync issue on staging.grass.osgeo.org
---------------------------+------------------------
Reporter: neteler | Owner: sac@…
Type: defect | Status: closed
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution: fixed
Keywords: rsync |
---------------------------+------------------------
Comment (by neteler):
Just for the record: this is the command to mirror:
{{{
rsync -az --port=50026 staging.grass.osgeo.org::grass-website grass-
website
}}}
(in the near future the DNS will be changed to grass.osgeo.org)
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2454#comment:7>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.
#2454: rsync issue on staging.grass.osgeo.org
---------------------------+---------------------------------------
Reporter: neteler | Owner: sac@…
Type: defect | Status: closed
Priority: normal | Milestone: Sysadmin Contract 2020-I
Component: Systems Admin | Resolution: fixed
Keywords: rsync |
---------------------------+---------------------------------------
Changes (by robe):
* milestone: Unplanned => Sysadmin Contract 2020-I
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2454#comment:8>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.