[Geoserver-devel] Build server locked up on "unknown task"?

Hi,
we have 35 builds in queue and the executor is presently working on a “unkonwn task” (even after logging into the server):

image.png

I’m guessing it might be some build that I’m not allowed to see, that maybe got stuck?

Cheers
Andrea

···

== GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.it http://twitter.com/geosolutions_it ------------------------------------------------------- Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.

I ran into a similar issue a couple weeks ago.

After a little research, it appears this sort of thing can occur if Jenkins encounters an unexpected error (e.g. a job or intermediate step failed but wasn’t fully stopped). This example shows the issue with Jenkins 1, but I expect something similar is happening for us.

---------- Forwarded message ---------
From: Torben Barsballe <tbarsballe@anonymised.com>
Date: Tue, Sep 4, 2018 at 3:21 PM
Subject: build.geoserver.org - apollo-slave-01 stuck on “Unknown Task”
To: geoserver-devel <geoserver-devel@lists.sourceforge.net>

Hello,

Today I noticed that the apollo-slave-01 was stuck running an “Unknown Task”, causing a backlogged build queue of 38 items.

After a little research, it appears this sort of thing can occur if Jenkins encounters an unexpected error.

I have restarted the node and everything seems to be working fine now.
I don’t think any action needs to be taken at the moment, but in the future if anyone else runs into a similar failure, or if this sort of thing starts becoming common, we may wish to investigate further.

Torben

On Tue, Sep 18, 2018 at 4:04 AM Andrea Aime <andrea.aime@anonymised.com> wrote:

Hi,
we have 35 builds in queue and the executor is presently working on a “unkonwn task” (even after logging into the server):

image.png

I’m guessing it might be some build that I’m not allowed to see, that maybe got stuck?

Cheers
Andrea

== GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.it http://twitter.com/geosolutions_it ------------------------------------------------------- Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.


Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

Hi Torben,
it’s blocked again, same way… Is there anything I can do to unblock it? Even logged in I cannot see
anything I can act on to unlock the server

Cheers
Andrea

(attachments)

image.png

···

Regards, Andrea Aime == GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.it http://twitter.com/geosolutions_it ------------------------------------------------------- Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.

You can click the name of the node (apollo-slave-01) then click disconnect on the left menu. The node will reset and reconnect after a short time, and be unblocked. (I’ve done so for the current task).

Given that this has come up as an issue again, it seems like we need to look further into it. I get the feeling it might be a specific job causing the issue.

Torben

On Wed, Sep 19, 2018 at 2:09 AM Andrea Aime <andrea.aime@anonymised.com> wrote:

Hi Torben,
it’s blocked again, same way… Is there anything I can do to unblock it? Even logged in I cannot see
anything I can act on to unlock the server

Cheers
Andrea

On Tue, Sep 18, 2018 at 6:19 PM Torben Barsballe <tbarsballe@anonymised.com> wrote:

I ran into a similar issue a couple weeks ago.

After a little research, it appears this sort of thing can occur if Jenkins encounters an unexpected error (e.g. a job or intermediate step failed but wasn’t fully stopped). This example shows the issue with Jenkins 1, but I expect something similar is happening for us.

---------- Forwarded message ---------
From: Torben Barsballe <tbarsballe@anonymised.com>
Date: Tue, Sep 4, 2018 at 3:21 PM
Subject: build.geoserver.org - apollo-slave-01 stuck on “Unknown Task”
To: geoserver-devel <geoserver-devel@lists.sourceforge.net>

Hello,

Today I noticed that the apollo-slave-01 was stuck running an “Unknown Task”, causing a backlogged build queue of 38 items.

After a little research, it appears this sort of thing can occur if Jenkins encounters an unexpected error.

I have restarted the node and everything seems to be working fine now.
I don’t think any action needs to be taken at the moment, but in the future if anyone else runs into a similar failure, or if this sort of thing starts becoming common, we may wish to investigate further.

Torben

On Tue, Sep 18, 2018 at 4:04 AM Andrea Aime <andrea.aime@anonymised.com.> wrote:

Hi,
we have 35 builds in queue and the executor is presently working on a “unkonwn task” (even after logging into the server):

image.png

I’m guessing it might be some build that I’m not allowed to see, that maybe got stuck?

Cheers
Andrea

== GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.it http://twitter.com/geosolutions_it ------------------------------------------------------- Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.


Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

Regards, Andrea Aime == GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.it http://twitter.com/geosolutions_it ------------------------------------------------------- Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.