#2261: Move download.osgeo.org to OSGEO7
---------------------------+-------------------
Reporter: robe | Owner: sac@…
Type: task | Status: new
Priority: normal | Milestone:
Component: Systems Admin | Keywords:
---------------------------+-------------------
This is to be done as part of SAC 2019 contract to resetup
download.osgeo.org as an LXD container on OSGeo7
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2261>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.
#2261: Move download.osgeo.org to OSGEO7
---------------------------+--------------------
Reporter: robe | Owner: sac@…
Type: task | Status: new
Priority: normal | Milestone:
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+--------------------
Comment (by strk):
Please use a Milestone for this
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2261#comment:1>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.
#2261: Move download.osgeo.org to OSGEO7
---------------------------+---------------------------------------
Reporter: robe | Owner: sac@…
Type: task | Status: new
Priority: normal | Milestone: Sysadmin Contract 2019-I
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+---------------------------------------
Changes (by robe):
* milestone: => Sysadmin Contract 2019-I
Comment:
strk sorry last time I didn't have rights to create milestones so didn't
think I could. I guess I have those rights now, so created a new
Milestone.
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2261#comment:2>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.
#2261: Move download.osgeo.org to OSGEO7
---------------------------+---------------------------------------
Reporter: robe | Owner: sac@…
Type: task | Status: new
Priority: normal | Milestone: Sysadmin Contract 2019-I
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+---------------------------------------
Comment (by robe):
IN meeting now. Jodygarnett said geotools relies on webdav, so we'll need
that on the new box.
I do have a new download countainer running Debian 9 (I couldn't get ldap
to work properly on Debian 10 which is the only reason I didn't go with
that).
I put macoosgeo (Homebrew bottle.download.osgeo.org) on that already since
they were in a rush and I didn't want to put them on the old one and have
them change things twice.
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2261#comment:3>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.
#2261: Move download.osgeo.org to OSGEO7
---------------------------+---------------------------------------
Reporter: robe | Owner: sac@…
Type: task | Status: new
Priority: normal | Milestone: Sysadmin Contract 2019-I
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+---------------------------------------
Comment (by robe):
We had discussions about this at the SAC meeting today with
jodygarnett, markusN, jef, dbb expressing their needs and concerns.
Key takeaways from the meeting about new download
1) Make sure to maintain timestamps and permissions as part of the sync
2) Maintain sudos
3) The size of osgeo4w + qgis (both users of the NFS) together take up
about 100GB, so we could move these back in the folder and dispense with
the NFS
3) Geotools currently relies on WebDav for pushing artifacts so will need
that
OR - an interesting idea Jody Garnett brought up is they would like to
eventually switch to using something like artifactory / nexus
https://jfrog.com/open-source/
and this might be something that would be useful for other projects.
With that said - might be good to keep download.osgeo.org simple with just
the nginx I have installed and no WebDav and setup a separate container
for artifactory use that geotools can use and other projects can
eventually take advantage of.
jodygarnett proposed a domain name of repos.osgeo.org
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2261#comment:4>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.
#2261: Move download.osgeo.org to OSGEO7
---------------------------+---------------------------------------
Reporter: robe | Owner: sac@…
Type: task | Status: closed
Priority: normal | Milestone: Sysadmin Contract 2019-I
Component: Systems Admin | Resolution: fixed
Keywords: |
---------------------------+---------------------------------------
Changes (by robe):
* status: new => closed
* resolution: => fixed
Comment:
did the final resync and changed the dns. So download.osgeo.org and
upload.osgeo.org are officially on osgeo7 now.
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2261#comment:5>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.
#2261: Move download.osgeo.org to OSGEO7
---------------------------+---------------------------------------
Reporter: robe | Owner: sac@…
Type: task | Status: reopened
Priority: normal | Milestone: Sysadmin Contract 2019-I
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+---------------------------------------
Changes (by jive):
* status: closed => reopened
* resolution: fixed =>
Comment:
Looks like we missed something, builds fail with:
> Failed to read artifact descriptor for
org.geotools.data:refdataset-1.0:jar:1.0.7: Could not transfer artifact
org.geotools.data:refdataset-1.0:pom:1.0.7 from/to osgeo
(http://download.osgeo.org/webdav/geotools/): Not authorized -> [Help 1]
Indeed navigating to http://download.osgeo.org/webdav/geotools/ is:
a) redirected to https://download.osgeo.org/webdav/geotools/
b) asked for authorization
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2261#comment:6>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.
#2261: Move download.osgeo.org to OSGEO7
---------------------------+---------------------------------------
Reporter: robe | Owner: sac@…
Type: task | Status: reopened
Priority: normal | Milestone: Sysadmin Contract 2019-I
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+---------------------------------------
Comment (by jef):
Moved the basic auth into limit_except. Please verify that it works.
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2261#comment:7>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.
#2261: Move download.osgeo.org to OSGEO7
---------------------------+---------------------------------------
Reporter: robe | Owner: sac@…
Type: task | Status: reopened
Priority: normal | Milestone: Sysadmin Contract 2019-I
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+---------------------------------------
Comment (by robe):
jive -- did you not get any of my emails? I sent to your gmail account.
I told you I could not implement webdav/ldap so I had set up an htaccess
account for geotools. It does not use the ldap one as I don't know the
password for that one.
Anyway if you can write to me at my lr at pcorp dot us account we can sort
this out.
jef,
I don't seem to be able to get to
https://download.osgeo.org/webdav/geotools/ or
https://download.osgeo.org/geotools/ anymore. I had set up so webdav uses
webdav and geotools is just for download
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2261#comment:8>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.
#2261: Move download.osgeo.org to OSGEO7
---------------------------+---------------------------------------
Reporter: robe | Owner: sac@…
Type: task | Status: reopened
Priority: normal | Milestone: Sysadmin Contract 2019-I
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+---------------------------------------
Comment (by robe):
ah never mind https://dwonload.osgeo.org/geotools still seems to work.
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2261#comment:9>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.
#2261: Move download.osgeo.org to OSGEO7
---------------------------+---------------------------------------
Reporter: robe | Owner: sac@…
Type: task | Status: reopened
Priority: normal | Milestone: Sysadmin Contract 2019-I
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+---------------------------------------
Comment (by jive):
Replying to [comment:9 robe]:
> ah never mind https://dwonload.osgeo.org/geotools still seems to work.
I am not sure what you mean? If I go to
https://download.osgeo.org/geotools it results in a 404 not found.
Please note that the build systems use the following:
{{{
<repository>
<id>osgeo</id>
<name>Open Source Geospatial Foundation Repository</name>
<url>http://download.osgeo.org/webdav/geotools/</url>
<!-- release repository used by geotools (and third-party
dependencies) -->
</repository>
}}}
And there are hundreds of them around the world. If we wish to change
(even from http --> https) we should coordinate.
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2261#comment:10>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.
#2261: Move download.osgeo.org to OSGEO7
---------------------------+---------------------------------------
Reporter: robe | Owner: sac@…
Type: task | Status: reopened
Priority: normal | Milestone: Sysadmin Contract 2019-I
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+---------------------------------------
Comment (by jive):
We are committed to the public URL
http://download.osgeo.org/webdav/geotools/ for consumption only.
The build servers (or deploying) can be a different endpoint and that is
easy to change in one spot.
Here is the GeoTools maven script describing distribution management for
deploying (the credentials are kept in a settings.xml file on the build
server or on the developers machine):
{{{
<distributionManagement>
<repository>
<uniqueVersion>false</uniqueVersion>
<id>osgeo</id>
<name>Open Source Geospatial Foundation - Maven 2 repo</name>
<url>dav:http://download.osgeo.org/webdav/geotools/</url>
</repository>
<snapshotRepository>
<id>boundless</id>
<uniqueVersion>false</uniqueVersion>
<name>Boundless Snapshot Repository</name>
<url>https://repo.boundlessgeo.com/snapshot/</url>
</snapshotRepository>
</distributionManagement>
}}}
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2261#comment:11>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.
#2261: Move download.osgeo.org to OSGEO7
---------------------------+---------------------------------------
Reporter: robe | Owner: sac@…
Type: task | Status: reopened
Priority: normal | Milestone: Sysadmin Contract 2019-I
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+---------------------------------------
Comment (by jive):
Thanks for the help, end of the day:
* http get access via http://download.osgeo.org/webdav/geotools/ (public
endpoint remains unchanged)
* web dev access via http://download.osgeo.org/upload/geotools/ (private
endpoint used by deploy process)
The pull request to fix geotools deploy
https://github.com/geotools/geotools/pull/2385
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2261#comment:12>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.
#2261: Move download.osgeo.org to OSGEO7
---------------------------+---------------------------------------
Reporter: robe | Owner: sac@…
Type: task | Status: closed
Priority: normal | Milestone: Sysadmin Contract 2019-I
Component: Systems Admin | Resolution: fixed
Keywords: |
---------------------------+---------------------------------------
Changes (by jive):
* status: reopened => closed
* resolution: => fixed
--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2261#comment:13>
OSGeo <https://osgeo.org/>
OSGeo committee and general foundation issue tracker.