[Geoserver-devel] New community module: cog (Cloud Optimized GeoTIFF)

GeoServer GeoServer Developer
1

Dear all,
I’m proposing the addition of a new cog community module on GeoServer.
Where cog-> COG means Cloud Optimized GeoTIFF, a regular GeoTIFF file, aimed at being hosted on a file server, whose internal organization is friendly for consumption by clients issuing GET Byte range requests.

The module will be mainly based on new imageio-ext readers/streams supporting these Byte Range requests.

It will contain new UI sections extending the GeoTIFF format panel to configure a (COG)eoTiff Dataset, as well as additional instructions and configuration parameters to setup an ImageMosaic on top of an index referring to COG granules.

Finally it will add all the additional dependencies needed to support those new capabilities, not being part of the standard GeoServer war.

The related GeoServer JIRA.
https://osgeo-org.atlassian.net/browse/GEOS-9767

Related GeoTools JIRA and PRs (still in draft state)

GeoTIFF:
https://osgeo-org.atlassian.net/browse/GEOT-6715

https://github.com/geotools/geotools/pull/3169

ImageMosaic:

https://osgeo-org.atlassian.net/browse/GEOT-6716
https://github.com/geotools/geotools/pull/3173

···

Regards,
Daniele Romagnoli

GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia.

This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.

2

As a follow up,

a Draft PR of the cog GeoServer community module.
https://github.com/geoserver/geoserver/pull/4531

It’s still a draft since I need some additional tuning on building the zip with all the needed dependencies, and it still depends on a snapshot version of imageio-ext.
I made a few changes and bug fixes on the work done so far by Josh Fix on ImageIO-Ext. He was the main contributor of the new imageio-ext cog readers and streams, thanks for that.
I will release a new imageio-ext version when done and update the GT/GS poms to depend on the released version when finalizing the Pull Request.

Regards,
Daniele

···

Regards,
Daniele Romagnoli

GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia.

This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.

3

+1

Was going to ask what the module would be called, and checked the draft … cog :slight_smile:
Should we follow the existing naming convention with s3-geotiff, and end up with something like cog-geotiff ?

Or is it a case that when these community modules are approved they will be added to the existing geotiff support.

···

–
Jody Garnett

4

Aka CloudOptimizedGeotiff-Geotiff?

CheeersCheers
Andrea

Il dom 11 ott 2020, 20:11 Jody Garnett <jody.garnett@anonymised.com> ha scritto:

+1

Was going to ask what the module would be called, and checked the draft … cog :slight_smile:
Should we follow the existing naming convention with s3-geotiff, and end up with something like cog-geotiff ?

Or is it a case that when these community modules are approved they will be added to the existing geotiff support.

–
Jody Garnett

On Fri, 9 Oct 2020 at 03:59, Daniele Romagnoli <daniele.romagnoli@anonymised.com> wrote:

Dear all,
I’m proposing the addition of a new cog community module on GeoServer.
Where cog-> COG means Cloud Optimized GeoTIFF, a regular GeoTIFF file, aimed at being hosted on a file server, whose internal organization is friendly for consumption by clients issuing GET Byte range requests.

The module will be mainly based on new imageio-ext readers/streams supporting these Byte Range requests.

It will contain new UI sections extending the GeoTIFF format panel to configure a (COG)eoTiff Dataset, as well as additional instructions and configuration parameters to setup an ImageMosaic on top of an index referring to COG granules.

Finally it will add all the additional dependencies needed to support those new capabilities, not being part of the standard GeoServer war.

The related GeoServer JIRA.
https://osgeo-org.atlassian.net/browse/GEOS-9767

Related GeoTools JIRA and PRs (still in draft state)

GeoTIFF:
https://osgeo-org.atlassian.net/browse/GEOT-6715

https://github.com/geotools/geotools/pull/3169

ImageMosaic:

https://osgeo-org.atlassian.net/browse/GEOT-6716
https://github.com/geotools/geotools/pull/3173

–

Regards,
Daniele Romagnoli

GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia.

This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.

Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

5

+1

Was going to ask what the module would be called, and checked the draft … cog :slight_smile:
Should we follow the existing naming convention with s3-geotiff, and end up with something like cog-geotiff ?

I agree with Andrea’s joke :slight_smile: The G in coG already means GeoTIFF so it will be redundant.
Regards,
Daniele

···

Regards,
Daniele Romagnoli

GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia.

This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.

6

Fair enough, you already have my +1, looking forward to the result :slight_smile:

···

–
Jody Garnett