Hi,
Does anyone have experience with GeoServer installed on Google Cloud Platform (GCP) and then accessing raster files on Google Cloud Storage (GCS) to use with Openlayers for web mapping?
Thanks,
···
Sincerely yours,
Arun
Hi Arun,
you might not get a positive answer here. GeoServer has some community modules that support S3 for
tile storage and for geotiff access, and new, better performing replacements for geotiff are landing on the
development branch during these days, that can use pure HTTP connections too (not limited to S3)
Support for GCP may require some extra effort. Code contributions are welcomed, in alternative,
if you’re in a position to fund these developments, there are companies that could do the development for you:
http://geoserver.org/support/
Cheers
Andrea
···
Regards, Andrea Aime
== GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.it http://twitter.com/geosolutions_it ------------------------------------------------------- Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.
Hi Arun,
I have had positive experiences using GCS fuse to mount a GCS bucket on Linux. From there you can treat the raster as a local file in GeoServer. An example of mounting GCS under Linux can be found in one of my Github repos: https://github.com/boonen/postgresql-client-gcsfuse
Kind regards,
Jan
···
System Architect and Lead Developer
Geodan b.v.
Buitenhaven 27-A
5211 TP 's-Hertogenbosch (NL)
T +31 (0)73 - 692 5151
M +31 (0)6 - 2395 1191
E jan.boonen@anonymised.com
www.geodan.nl | disclaimer
Hi Jan,
Thanks for the reply.
Can you please tell me how exactly you deployed it?
I have GeoServer installed on a VPS server (vpsserver.com, Ubuntu 19.04, 3CPU, 4GB RAM, 100GB) for serving files, and cloud optimized GeoTIFFs in several GCS buckets. So do I install FUSE on our VPS server and connect to the GCS buckets? And I simply point the GCS bucket enabled through FUSE as the GeoServer data directory to process and publish services? So in this case will the data (COGs) transfer and download from the GCS bucket to GeoServer data directory on the VPS server (outside of GCP)?
Or am I better off to spinning up a Ubuntu VM on GCP and install GeoServer and FUSE to it and then connect to the GCS buckets so that data stays within GCP?
Another person said that “FUSE is pretty fast, but the off the shelf FUSE that google provides is hampered by the “read ahead” system environment variable. You can re-write the kernel for google cloud images, but it doesn’t work well with Kubernetes, because I don’t believe you can use custom kernels with kubernetes in GCP.” Have you encountered any such limitations?
Please let me know, thanks!
Arun
Hi Arun,
I have no experience using GCS and fuse outside a GCP zone, but I can imagine that a connection between a VPS on vpsserver.com and GCS gives a worse response than hosting GeoServer on GCP in the same zone as where your GCS bucket is located.
The use case I have tested was a database restore (PostGIS) on Kubernetes. That worked very well, but hosting COGs over fuse might give a disappointing performance. However, it’s easy to set up so I’d suggest giving it a try.
Cheers,
Jan
···
System Architect and Lead Developer
Geodan b.v.
Buitenhaven 27-A
5211 TP 's-Hertogenbosch (NL)
T +31 (0)73 - 692 5151
M +31 (0)6 - 2395 1191
E jan.boonen@anonymised.com
www.geodan.nl | disclaimer
In the meantime initial support for COGs over S3 and generic HTTP has
landed on master, if you or anyone else want to try it out it needs a nightly build of
the development series:
https://build.geoserver.org/geoserver/master/
and the “COG” community module:
https://build.geoserver.org/geoserver/master/community-latest/geoserver-2.19-SNAPSHOT-cog-plugin.zip
Docs here:
https://docs.geoserver.org/latest/en/user/community/cog/index.html
If your TIFF files are exposed as public files, or can be accessed via HTTP Basic authentication,
the generic HTTP support might just work fine (if you try it out, let us know how it goes).
Cheers
Andrea
···
Regards, Andrea Aime
== GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.it http://twitter.com/geosolutions_it ------------------------------------------------------- Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.