[Geoserver-devel] build.geoserver.org setup for un-reliable builds?

GeoServer GeoServer Developer
1

Hi,
while starting to perform the release I looked at build.geoserver.org and found a nightly
build with a suspicious, classpath related failure (something like “org.geoserver.platform
package not found”, which should never happen).

Looking around I see there are no concurrent build group limitations on build.geoserver.org
like it’s done in Ares, meaning that a geotools/geoserver build can be rebuild and replaced
while a nightly, release or other dependent build runs, making it fail like above.

I’m going to use Ares for the build, and in the meantime, I’m asking: was that an oversight?
I don’t think build.geoserver.org can work setup as it is now.

Cheers
Andrea

···

==
GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

2

Hi Andrea,

build.geoserver.org is using a newer version of Jenkins that ares, and as such has some different solutions to some of these issues. In this case, it is using the Locks and Latches plugin to control what can and cannot be executed concurrently. Right now, there are two different locks set up - “GeoServer” and “Docs”.

So, I think it should be working as-is? However, the fact that you are seeing a failure like that is concerning.

Nick - you set up the locks and latches, was there a specific reason why build.geoserver.org is not using the same concurrent execution group setup as ares? Is it just because of the version of Jenkins?

Torben

···

On Mon, Jul 31, 2017 at 1:21 AM, Andrea Aime <andrea.aime@anonymised.com> wrote:

Hi,
while starting to perform the release I looked at build.geoserver.org and found a nightly
build with a suspicious, classpath related failure (something like “org.geoserver.platform
package not found”, which should never happen).

Looking around I see there are no concurrent build group limitations on build.geoserver.org
like it’s done in Ares, meaning that a geotools/geoserver build can be rebuild and replaced
while a nightly, release or other dependent build runs, making it fail like above.

I’m going to use Ares for the build, and in the meantime, I’m asking: was that an oversight?
I don’t think build.geoserver.org can work setup as it is now.

Cheers
Andrea

==
GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

Check out the vibrant tech community on one of the world’s most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot

Geoserver-devel mailing list
Geoserver-devel@anonymised.com.366…sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

3

On Mon, Jul 31, 2017 at 6:26 PM, Torben Barsballe <
tbarsballe@anonymised.com> wrote:

Hi Andrea,

build.geoserver.org is using a newer version of Jenkins that ares, and as
such has some different solutions to some of these issues. In this case, it
is using the Locks and Latches plugin to control what can and cannot be
executed concurrently. Right now, there are two different locks set up -
"GeoServer" and "Docs".

So, I think it should be working as-is? However, the fact that you are
seeing a failure like that is concerning.

Right, it seems that the current concurrent build solution is at least not
fully configured, e.g., a geoserver nightly build should
not be allowed to run while a geoserver one is running (and vice versa).
And same goes for geotools of course, the
group should be one large all encompassing gt/gs/gwc, since upstream
projects might wipe jars off the downstream
builds and make them fail otherwise.

Cheers
Andrea

--

Regards,

Andrea Aime

==
GeoServer Professional Services from the experts! Visit http://goo.gl/it488V
for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
loro utilizzo è consentito esclusivamente al destinatario del messaggio,
per le finalità indicate nel messaggio stesso. Qualora riceviate questo
messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
darcene notizia via e-mail e di procedere alla distruzione del messaggio
stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso,
divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od
utilizzarlo per finalità diverse, costituisce comportamento contrario ai
principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for
the attention and use of the named addressee(s) and may be confidential or
proprietary in nature or covered by the provisions of privacy act
(Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection
Code).Any use not in accord with its purpose, any disclosure, reproduction,
copying, distribution, or either dissemination, either whole or partial, is
strictly forbidden except previous formal approval of the named
addressee(s). If you are not the intended recipient, please contact
immediately the sender by telephone, fax or e-mail and delete the
information in this message that has been received in error. The sender
does not give any warranty or accept liability as the content, accuracy or
completeness of sent messages and accepts no responsibility for changes
made after they were sent or for other risks which arise as a result of
e-mail transmission, viruses, etc.

4

Torben,

Yes, the new version of Jenkins doesn’t have the same settings as the Ares did. The capability of blocking concurrent builds isn’t something native to Jenkins now, it’s managed from the plugin.

Cheers,
Nick

···

On Mon, Jul 31, 2017 at 12:26 PM, Torben Barsballe <tbarsballe@anonymised.com> wrote:

Hi Andrea,

build.geoserver.org is using a newer version of Jenkins that ares, and as such has some different solutions to some of these issues. In this case, it is using the Locks and Latches plugin to control what can and cannot be executed concurrently. Right now, there are two different locks set up - “GeoServer” and “Docs”.

So, I think it should be working as-is? However, the fact that you are seeing a failure like that is concerning.

Nick - you set up the locks and latches, was there a specific reason why build.geoserver.org is not using the same concurrent execution group setup as ares? Is it just because of the version of Jenkins?

Torben

–

On Mon, Jul 31, 2017 at 1:21 AM, Andrea Aime <andrea.aime@anonymised.com> wrote:

Hi,
while starting to perform the release I looked at build.geoserver.org and found a nightly
build with a suspicious, classpath related failure (something like “org.geoserver.platform
package not found”, which should never happen).

Looking around I see there are no concurrent build group limitations on build.geoserver.org
like it’s done in Ares, meaning that a geotools/geoserver build can be rebuild and replaced
while a nightly, release or other dependent build runs, making it fail like above.

I’m going to use Ares for the build, and in the meantime, I’m asking: was that an oversight?
I don’t think build.geoserver.org can work setup as it is now.

Cheers
Andrea

==
GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

Check out the vibrant tech community on one of the world’s most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot

Geoserver-devel mailing list
Geoserver-devel@anonymised.comrge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

Nick Stires

DevOps Engineer | Boundless
nstires@anonymised.com9…
Mobile: +1 561-713-0922