Hi,
on behalf of Alessio I would like to propose a new community module that allows
GeoServer WPS to discover, run and monitor processes running on one or more remote machines.
This setup is popular in scenarios where one has long lived and resource hungry processes that
require a dedicated machine to run (e.g., some large satellite imagery processes,
simulation or weather models, that can take hours and chew a lot of of memory per run),
as well as the “dockerization” trend in which algorithm providers are simply shipping a
docker container fully setup with the executable to be run and its specific environment
(in scientific apps that can be very specific), which regardless of the physical setup, effectively
makes it run on a separate node.
The module is easier to explain with a picture:
Basically on the GeoServer side we have a custom process factory that discovers and exposes
processes, on the other end we have some support to describe and execute the processes, and
in the middle we have a XMPP server acting as the network protocol, plus eventual file system sharing
for large inputs/outputs.
XMPP was chosen as a suitable cross language communication mechanism, indeed, while the
GeoServer module is pure java (pull request in preparation here: https://github.com/geosolutions-it/geoserver/tree/wps-remote),
while the reference implementation of the other end is python based instead:
https://github.com/geosolutions-it/wps-remote-backend-XMPP
We’d like to contribute the GeoServer module, along with docs, as a community one, and if possible
add the reference python implementation as a new repository in the https://github.com/geoserver/ organization,
to stress its open status and encourage more people to take part.
As this is a community module there is no feature freeze rush, but I guess it would be nice to
have it in anyways in order to add it to the beta announcement
Feedback welcomed
Cheers
Andrea
···
==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.
Ing. Andrea Aime
@geowolf
Technical Lead
GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549
http://www.geo-solutions.it
http://twitter.com/geosolutions_it
AVVERTENZE AI SENSI DEL D.Lgs. 196/2003
Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.
The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.
