I'm seeing build failures again caused by download failures of geowebcache eg. on Travis-CI
[ERROR] Failed to execute goal on project gs-gwc: Could not resolve dependencies for project org.geoserver:gs-gwc:jar:2.19-SNAPSHOT: Failed to collect dependencies at org.geowebcache:gwc-diskquota-jdbc:jar:1.19-SNAPSHOT: Failed to read artifact descriptor for org.geowebcache:gwc-diskquota-jdbc:jar:1.19-SNAPSHOT: Could not find artifact org.geowebcache:gwc-diskquota:pom:1.19-SNAPSHOT in osgeo-snapshots (https://repo.osgeo.org/repository/snapshot/) -> [Help 1]
Not sure how cleanup of old snapshots is done on the osgeo server, but it might be an idea to set up a "Rebuild Maven repository metadata" task to regenerate the maven-metadata.xml files on a regular basis for snapshots (see attached) as there appears to be a discrepancy between the files listed in the maven-metadata.xml and the "browse" GUI of Nexus.
Thanks for letting me know, the “cleanup” jobs run daily and are supposed to keep at least two snapshot jars. I did create the "rebuild maven repository (maven-metadata.xml) task, but currently have it set to run manually as I would like to determine the cause of these problems. I assume this is the task you mean…
Thanks for letting me know, the "cleanup" jobs run daily and are supposed to keep at least two snapshot jars. I did create the "rebuild maven repository (maven-metadata.xml) task, but currently have it set to run manually as I would like to determine the cause of these problems. I assume this is the task you mean...
* When checking maven-metadata.xml indicates "1.19-20200907.154459-6" is the latest
* This is also the latest I see when browsing, which is consistent...
What did you see when you wrote the email?
Checking other folders I think I can see what you mean...
- gwc-diskquota/1.19-SNAPSHOT lists 1.19-20200904.180554-5 but metadata has 1.19-20200907.154259-1
I was under the assumption maven-metadata.xml should list all of the snapshot versions (not just the latest) that are in the repo, but looking at some other repo's I think I'm mistaken.
> 2020-09-07 19:15:49 ERROR MbtilesBlobStore:436 - Error getting metadata from file '/tmp/junit5355982624683894350/metadata.sqlite'.
java.lang.RuntimeException: Error executing query 'SELECT value FROM metadata WHERE layerName = ? AND key = ?;'.
> at org.geowebcache.sqlite.Utils.exception(Utils.java:96)
> ...
> Caused by: org.sqlite.SQLiteException: [SQLITE_ERROR] SQL error or missing database (no such table: metadata)
> at org.sqlite.core.DB.newSQLException(DB.java:1010)
--
Jody Garnett
On Mon, 7 Sep 2020 at 08:46, Mark Prins <mc.prins@anonymised.com <mailto:mc.prins@anonymised.com>> wrote:
I'm seeing build failures again caused by download failures of
geowebcache eg. on Travis-CI
[ERROR] Failed to execute goal on project gs-gwc: Could not resolve
dependencies for project org.geoserver:gs-gwc:jar:2.19-SNAPSHOT: Failed
to collect dependencies at
org.geowebcache:gwc-diskquota-jdbc:jar:1.19-SNAPSHOT: Failed to read
artifact descriptor for
org.geowebcache:gwc-diskquota-jdbc:jar:1.19-SNAPSHOT: Could not find
artifact org.geowebcache:gwc-diskquota:pom:1.19-SNAPSHOT in
osgeo-snapshots (https://repo.osgeo.org/repository/snapshot/) ->
[Help 1]
Not sure how cleanup of old snapshots is done on the osgeo server, but
it might be an idea to set up a "Rebuild Maven repository metadata"
task
to regenerate the maven-metadata.xml files on a regular basis for
snapshots (see attached) as there appears to be a discrepancy between
the files listed in the maven-metadata.xml and the "browse" GUI of
Nexus.
Morning,
any news on that?
I see the same error for the Travis checks on a Pull Request I made.
[ERROR] Failed to execute goal on project geoserver: Could not resolve dependencies for project org.geoserver:geoserver:pom:2.19-SNAPSHOT: The following artifacts could not be resolved: org.geotools:gt-main:jar:25-SNAPSHOT, org.geowebcache:gwc-core:jar:1.19-SNAPSHOT: Could not find artifact org.geotools:gt-main:jar:25-SNAPSHOT in osgeo-snapshots ([https://repo.osgeo.org/repository/snapshot/](https://repo.osgeo.org/repository/snapshot/))
Regards,
Daniele
···
Regards,
Daniele Romagnoli
GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.
Ing. Daniele Romagnoli
Senior Software Engineer
GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia.
This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.
Given the randomness I’m worried about concurrency… are any two builds of the same series allowed
to run at the same time? Like, two geotools 25-SNAPSHOT for example?
Cheers
Andrea
···
Regards, Andrea Aime
== GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.ithttp://twitter.com/geosolutions_it ------------------------------------------------------- Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.
I’m getting build failures caused by geotools download failures.
[ERROR] Failed to execute goal on project geoserver: Could not resolve dependencies for project org.geoserver:geoserver:pom:2.19-SNAPSHOT: Failed to collect dependencies at org.geotools:gt-main:jar:25-SNAPSHOT: Failed to read artifact descriptor for org.geotools:gt-main:jar:25-SNAPSHOT: Could not find artifact org.geotools:library:pom:25-SNAPSHOT in osgeo-snapshots (https://repo.osgeo.org/repository/snapshot/) → [Help 1]
Can it be that the issue underlined in this thread is still around?
Morning,
any news on that?
I see the same error for the Travis checks on a Pull Request I made.
[ERROR] Failed to execute goal on project geoserver: Could not resolve dependencies for project org.geoserver:geoserver:pom:2.19-SNAPSHOT: The following artifacts could not be resolved: org.geotools:gt-main:jar:25-SNAPSHOT, org.geowebcache:gwc-core:jar:1.19-SNAPSHOT: Could not find artifact org.geotools:gt-main:jar:25-SNAPSHOT in osgeo-snapshots ([https://repo.osgeo.org/repository/snapshot/](https://repo.osgeo.org/repository/snapshot/))
Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia.
This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.
== GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.ithttp://twitter.com/geosolutions_it ------------------------------------------------------- Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.
Can we configure Jenkins to run all the existing PR checks? Anyways, I think I’ve seen the download failures
on the Github managed actions too, can anyone confirm?
Cheers
Andrea
···
Regards, Andrea Aime
== GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.ithttp://twitter.com/geosolutions_it ------------------------------------------------------- Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.
On Fri, Sep 11, 2020 at 12:05 AM Jody Garnett <jody.garnett@anonymised.com <mailto:jody.garnett@anonymised.com>> wrote:
In today's OSGeo AGM the deegree project noted that they gave up on
travis and returned to use of jenkins.
Can we configure Jenkins to run all the existing PR checks? Anyways, I think I've seen the download failures
on the Github managed actions too, can anyone confirm?
I haven;t checked jenkins, but have seen them om both "Github Action" builds as wel as Travis-CI builds
Ok, so it’s not specific to Travis. Thanks for confirming.
Cheers
Andrea
···
== GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.ithttp://twitter.com/geosolutions_it ------------------------------------------------------- Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.
Looks like someone rewriting the jar while the other JVM is reading it.
Not completely downloaded… not sure, would the zip libraries be even able to open it?
A case where the file was opened, and then its contents changed, may seem more likely (no certainty here).
Cheers
Andrea
···
== GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.ithttp://twitter.com/geosolutions_it ------------------------------------------------------- Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.
[exec] /var/lib/jenkins/workspace/geoserver-master-live-docs/doc/en/user/source/community/features-templating/index.rst:4: WARNING: Title underline too short.
This looks like something changing mid build? Or a jar not completely download?
Looks like someone rewriting the jar while the other JVM is reading it.
Not completely downloaded… not sure, would the zip libraries be even able to open it?
A case where the file was opened, and then its contents changed, may seem more likely (no certainty here).
Cheers
Andrea
== GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.ithttp://twitter.com/geosolutions_it ------------------------------------------------------- Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.
Changes
[GEOS-9737] Fix wfs-templating documentation error
capitalisation and typo fixes in GeoPackage user doc (#4490)
[GEOS-9677] “Edit layer” screen should show layer source (#4465)
Appears to be failing on LDAP tests:
[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.189 s <<< FAILURE! - in org.geoserver.web.security.ldap.LDAPAuthProviderPanelTest
net.sf.ehcache.CacheException: java.io.FileNotFoundException: /tmp/server-work-myDS/cache/482a8a97-4982-4202-9172-a0ca4e65365b/kdc%0052eplay%0043ache.data (No such file or directory)
are the JDK 11 builds allowed to go in parallel?
Remember that LDAP tests can failed because they ended up conflicting on a port?
The bad news is that even choosing a random port, they also create a directory in a fixed position
in the temp directory… so they also end up conflicting on the file system.
An error like this:
16 Sep 23:35:56 ERROR [schema.SchemaPartition] - ERR_90 Failed to initialize wrapped partition.
org.apache.directory.api.ldap.model.exception.LdapOtherException: ERR_216_ID_FOR_PARENT_NOT_FOUND Id for parent 'cn=krb5kdc,ou=schema' not found!
at org.apache.directory.server.core.api.partition.AbstractPartition.initialize(AbstractPartition.java:94)
at org.apache.directory.server.core.api.schema.SchemaPartition.doInit(SchemaPartition.java:231)
at org.apache.directory.server.core.api.partition.AbstractPartition.initialize(AbstractPartition.java:89)
at org.apache.directory.server.core.DefaultDirectoryService.initialize(DefaultDirectoryService.java:1810)
at org.apache.directory.server.core.DefaultDirectoryService.startup(DefaultDirectoryService.java:1251)
at org.apache.directory.server.core.factory.DefaultDirectoryServiceFactory.build(DefaultDirectoryServiceFactory.java:259)
at org.apache.directory.server.core.factory.DefaultDirectoryServiceFactory.init(DefaultDirectoryServiceFactory.java:125)
at org.apache.directory.server.core.factory.DSAnnotationProcessor.createDS(DSAnnotationProcessor.java:96)
at org.apache.directory.server.core.factory.DSAnnotationProcessor.getDirectoryService(DSAnnotationProcessor.java:328)
at org.apache.directory.server.core.integ.FrameworkRunner.run(FrameworkRunner.java:109)
at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
Caused by: org.apache.directory.api.ldap.model.exception.LdapNoSuchObjectException: ERR_216_ID_FOR_PARENT_NOT_FOUND Id for parent 'cn=krb5kdc,ou=schema' not found!
at org.apache.directory.server.core.partition.impl.btree.AbstractBTreePartition.add(AbstractBTreePartition.java:743)
at org.apache.directory.server.core.partition.ldif.LdifPartition.loadEntries(LdifPartition.java:532)
at org.apache.directory.server.core.partition.ldif.LdifPartition.loadEntries(LdifPartition.java:550)
at org.apache.directory.server.core.partition.ldif.LdifPartition.loadEntries(LdifPartition.java:550)
at org.apache.directory.server.core.partition.ldif.LdifPartition.doInit(LdifPartition.java:165)
at org.apache.directory.server.core.api.partition.AbstractPartition.initialize(AbstractPartition.java:89)
... 17 more
May suggest that the LDAP database kept in those directories has been corrupted by concurrent overwrites of files.
If that’s the case, builds may be fixable by giving each a separate temp directory.
The location cannot be controlled via the annotation used to create the test server
All instances end up working in the “/tmp/server-work-myDS” directory (well on my machine, where “/tmp” is the default temp directory)
We could be setting the “workingDirectory” system variable to whatever random location we want (e.g. the absolute path of “target/ds-storage” for example) to isolate the tests
Cheers
Andrea
···
Regards, Andrea Aime
== GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.ithttp://twitter.com/geosolutions_it ------------------------------------------------------- Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.
Hi Jody,
saw it has been fixed, thankfully. Having the PR checks fails so often due to repo related issues
is making people ignore more and more the results of the checks, I’m afraid.
But at least they are in their face. The build server is something one needs to double check pretty
much manually.
Cheers
Andrea
···
Regards, Andrea Aime
== GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.ithttp://twitter.com/geosolutions_it ------------------------------------------------------- Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.
