[SAC] [OSGeo] #2445: Issue with Maven OSGEO (repo.osgeo.org) - no remote packages available

#2445: Issue with Maven OSGEO (repo.osgeo.org) - no remote packages available
---------------------------+-----------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Keywords:
---------------------------+-----------------------
Email thread I got about this

----

The archetype metadata file in the root is empty.
Our Artifactory instance sees no remote packages on the suggested url.
Also Maven Central days there is only 1 java package in the repo.

----

It seems that the OSGeo Nexus Repository is broken. Our Artifactory
instance is no longer correctly mirroring the OSGeo Maven Release Repo.
I couldn’t find any proper group on the mailing list to send a message to,
so I’ve looked at who changed the repository documentation, and it was
you.

If you are not the correct person to tell this to, please accept my
sincerest apology, and could you be so kind as to point me to the correct
person to help me.

Thanks in advance!

Kind Regards,

Thijs Cramer
----

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2445&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2445: Issue with Maven OSGEO (repo.osgeo.org) - no remote packages available
---------------------------+------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+------------------------

Comment (by jive):

I have not had any reports of trouble from my automated build boxes or
email lists.

Can you confirm that *the suggested url* is:
https://repo.osgeo.org/repository/release/ ?

Doing a geoserver build with an empty local repository is functioning
(making use of the above repository to fetch geotools dependencies).

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2445#comment:1&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2445: Issue with Maven OSGEO (repo.osgeo.org) - no remote packages available
---------------------------+------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+------------------------

Comment (by jive):

It looks like there may be a "maven index" that we should publish once a
day, used by other clients "nexus instances, or m2eclipse"

I am going to schedule a task to produce this once a day and we can ask if
it fixes the problem. This is the first I have heard of this index as it
is not something our previous webdav folder offered.

Reference:

* https://support.sonatype.com/hc/en-us/articles/213465468-What-do-all-of-
the-search-index-related-scheduled-tasks-do-and-when-should-I-schedule-
them-

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2445#comment:2&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2445: Issue with Maven OSGEO (repo.osgeo.org) - no remote packages available
---------------------------+------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+------------------------

Comment (by jive):

I have setup tasks to create an index for the release and snapshot
repositories; please let me know if that resolves the problem.

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2445#comment:3&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2445: Issue with Maven OSGEO (repo.osgeo.org) - no remote packages available
---------------------------+------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+------------------------

Comment (by jive):

Why would maven central know about our repo? we have not requested to be
mirrored yet ...

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2445#comment:4&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2445: Issue with Maven OSGEO (repo.osgeo.org) - no remote packages available
---------------------------+------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+------------------------

Comment (by thijscramer):

I can confirm our configured URL is set to
https://repo.osgeo.org/repository/release/.
Using the "test" function Artifactory gives us a 404. We can ignore the
test result and just add the repository, but it stays empty on the
Artifactory side. It just doesn't see any remote packages.
This is one of many maven(2) repositories we have configured, and we have
no issues with any other repo's (like Maven Central for example). Which
uses the exact same configuration, just another URL.

There's not much we can configure for a remote repo:
https://www.jfrog.com/confluence/display/JFROG/Remote+Repositories

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2445#comment:5&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2445: Issue with Maven OSGEO (repo.osgeo.org) - no remote packages available
---------------------------+------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+------------------------

Comment (by thijscramer):

If we use the url
https://repo.osgeo.org/service/rest/repository/browse/release/ we get a
good status back from Artifactory when testing.
But the remote repo is filled up with only directory's. There are no
artifacts shown.

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2445#comment:6&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2445: Issue with Maven OSGEO (repo.osgeo.org) - no remote packages available
---------------------------+------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+------------------------

Comment (by robe):

When I browse it I do see real files --

https://repo.osgeo.org/service/rest/repository/browse/release/commons-
beanutils/commons-beanutils/1.9.2/

e.g. there is a jar in that folder.

Does not come thru?

jive - did everything replicate over from boundless?

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2445#comment:7&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2445: Issue with Maven OSGEO (repo.osgeo.org) - no remote packages available
---------------------------+------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+------------------------

Comment (by meedel):

It is correct that you can list the artifacts within a browser.
But in our binary resource manager Artifactory I only get the directory
listing and there are no artifacts shown!
I have to use the url
https://repo.osgeo.org/service/rest/repository/browse/release/ in
Artifactory to see the directory listing.
If I use the suggested url from the documentation
https://repo.osgeo.org/service/release/ I get a 404 in the test from
Artifactory and the only directory what is shown is java3d/vecmath/1.5.2/
also without artifacts.

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2445#comment:8&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2445: Issue with Maven OSGEO (repo.osgeo.org) - no remote packages available
---------------------------+------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+------------------------

Comment (by jive):

Only the things we asked for replicated from boundless; they had lots of
their own open source projects (non osgeo) which we did not take.

I am a bit confused about this thread, while I believe that artifactory
has some secret api to communicate maven index - we have setup a task to
refresh and publish this api. But have no way of testing if it is working
or not ...

The browse links, and searching in the user interface, are fine for
checking the contents visually. The actual maven build tool is finding
everything it needs just fine. It is this "repository index" api which a
downstream nexus is trying to make use of ....

meedel do you have any documentation on what needs to be done? I have set
up two tasks as shown in the attachments. They both seem to be running ...

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2445#comment:9&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2445: Issue with Maven OSGEO (repo.osgeo.org) - no remote packages available
---------------------------+------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+------------------------
Changes (by jive):

* Attachment "index-snapshot.png" added.

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2445&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2445: Issue with Maven OSGEO (repo.osgeo.org) - no remote packages available
---------------------------+------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+------------------------
Changes (by jive):

* Attachment "index-release.png" added.

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2445&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2445: Issue with Maven OSGEO (repo.osgeo.org) - no remote packages available
---------------------------+------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+------------------------

Comment (by jive):

Replying to [comment:6 thijscramer]:
> If we use the url
https://repo.osgeo.org/service/rest/repository/browse/release/ we get a
good status back from Artifactory when testing.
> But the remote repo is filled up with only directory's. There are no
artifacts shown.

You are using a URL for browsing visually, what you want is the url we
have documented: https://repo.osgeo.org/repository/release/

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2445#comment:10&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2445: Issue with Maven OSGEO (repo.osgeo.org) - no remote packages available
---------------------------+------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+------------------------

Comment (by jive):

Reading a bit about indexer files here: https://strongbox.github.io
/developer-guide/maven-indexer.html
Apparently this is a packed lucense index, cannot find the api URL to hit
in order to check if this is working.

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2445#comment:11&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2445: Issue with Maven OSGEO (repo.osgeo.org) - no remote packages available
---------------------------+------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+------------------------

Comment (by meedel):

Replying to [comment:11 jive]:
> Reading a bit about indexer files here: https://strongbox.github.io
/developer-guide/maven-indexer.html
> Apparently this is a packed lucense index, cannot find the api URL to
hit in order to check if this is working.

Thanks Jive for your search and support.
I have replaced the url to the documented url. ( stil get a 404 when
testing ) The index files are shown, but no artifacts or directories
I have also made an issue for jfrog
https://www.jfrog.com/jira/browse/RTFACT-21963

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2445#comment:12&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2445: Issue with Maven OSGEO (repo.osgeo.org) - no remote packages available
---------------------------+------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+------------------------

Comment (by jive):

I do not know if indexer files for a group repository are a thing (it
shows it took zero seconds for the last run so I am thinking not).

I have just changed the task to make the indexer files for *all*
repositories, I hope that helps, and running it now.

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2445#comment:13&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2445: Issue with Maven OSGEO (repo.osgeo.org) - no remote packages available
---------------------------+------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+------------------------

Comment (by jive):

If you get a chance to learn of a specific URL that we can use to test if
indexer is working that would be great.

Reading that documentation page they give examples of:

* Hosted repositories: have: Local: strongbox-
vault/storages/${storageId}/${repositoryId}/local/.index
* Proxy repositories have: Remote: strongbox-
vault/storages/${storageId}/${repositoryId}/remote/.index
* Group repositories have: Local: strongbox-
vault/storages/${storageId}/${repositoryId}/local/.index

But that is for a specific product"strongbox", I do not know what the URLs
are for nexus.

Sonyatype has an example program here: https://blog.sonatype.com/2009/06
/nexus-indexer-api-part-2/ which may be useful also.

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2445#comment:14&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2445: Issue with Maven OSGEO (repo.osgeo.org) - no remote packages available
---------------------------+------------------------
Reporter: robe | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+------------------------

Comment (by jive):

Okay the job did something this time, it ran for4m4s!

Can you check now and see if things have improved?

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2445#comment:15&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2445: Issue with Maven OSGEO (repo.osgeo.org) - no remote packages available
---------------------------+------------------------
Reporter: robe | Owner: jive
     Type: task | Status: assigned
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+------------------------
Changes (by jive):

* owner: sac@… => jive
* status: new => assigned

Comment:

I am hoping with the change this is now resolved for you.

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2445#comment:16&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#2445: Issue with Maven OSGEO (repo.osgeo.org) - no remote packages available
---------------------------+------------------------
Reporter: robe | Owner: jive
     Type: task | Status: assigned
Priority: normal | Milestone: Unplanned
Component: Systems Admin | Resolution:
Keywords: |
---------------------------+------------------------

Comment (by jive):

Still no feedback, I am only seeing a few warnings in the logs:

{{{
2020-05-05 18:09:44,875+0000 WARN [qtp623246820-513087] *UNKNOWN
org.sonatype.nexus.repository.httpbridge.internal.ViewServlet - Bad
request. Reason: Repository path must have another '/' after initial '/'
2020-05-05 18:09:49,653+0000 WARN [qtp623246820-513091] *UNKNOWN
org.sonatype.nexus.repository.httpbridge.internal.ViewServlet - Bad
request. Reason: Repository path must have another '/' after initial '/'
}}}

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/2445#comment:17&gt;
OSGeo <https://osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.