[Geoserver-users] GeoServer Web Coverage Service Issue

Hi,

There is nothing strange with that. Your original image is compressed with “deflate” and if you expand it into uncompressed format with gdal_translate (gdal_translate 1201.tif expand.tif) the file size seems to grow into 324626939 bytes. WCS by default sends coverages as uncompressed.

Read about WCS 2.0 GeoTIFF extension https://portal.opengeospatial.org/files/?artifact_id=54813 and ask Geoserver to send you a compressed image by adding the required parameter &compression=Deflate. Using also &predictor=Horizontal probably yields even smaller output.

BTW. according to the standard the parameters should be &geotiff:compression=Deflate&geotiff:predictor=Horizontal but older Geoserver versions do not handle the “geotiff:” part. Geoserver 2.13 and 2.14 support both variants but users should learn to use the correct geotiff: prefixed syntax as soon as possible because that is the correct format and required by other WCS servers.

-Jukka Rahkonen-

image001.png

image003.jpg

image004.png

···

Lähettäjä: Mustafa ÖZÇETiN via Geoserver-users [mailto:geoserver-users@lists.sourceforge.net]
Lähetetty: 4. huhtikuuta 2018 11:12
Vastaanottaja: geoserver-users@lists.sourceforge.net
Aihe: [Geoserver-users] GeoServer Web Coverage Service Issue

Hi,

I have a strange behaviour with GeoServer WCS. I am using a GeoTIFF image with WCS. The image contains terrain type data like land/sea etc. The original size of the image is just 939 KB but when I download this image from WCS it becomes 309 MB! How can a GeoTIFF file expands its size to 300+ times after downloaded from WCS?

System info:

JRE 8

GeoServer 2.9.2

WCS 2.0.1

You can download and inspect the image with the following link:

Temp

Tekstiruutu:

Lähettäjä poisti kuvan.

Temp

Shared with Dropbox

Thanks.

Hi Jukka,

Thanks for the response. Adding the “&compression=LZW” parameter to the end of the WCS GetCoverage request sends a compressed GeoTIFF that I expect.

Some observations:

  1. When I use the “Deflate” value as the compression parameter, GeoServer returns a service exception saying “Provided compression does not seem supported”.

  2. When I try the “&geotiff:compression=LZW” parameter, GeoServer does not return any exceptions but sends an uncompressed GeoTIFF (with GeoServer 2.9.2).

On Wednesday, April 4, 2018, 5:10:03 PM GMT+3, Rahkonen Jukka (MML) jukka.rahkonen@anonymised.com wrote:

Hi,

There is nothing strange with that. Your original image is compressed with “deflate” and if you expand it into uncompressed format with gdal_translate (gdal_translate 1201.tif expand.tif) the file size seems to grow into 324626939 bytes. WCS by default sends coverages as uncompressed.

Read about WCS 2.0 GeoTIFF extension https://portal.opengeospatial.org/files/?artifact_id=54813 and ask Geoserver to send you a compressed image by adding the required parameter &compression=Deflate. Using also &predictor=Horizontal probably yields even smaller output.

BTW. according to the standard the parameters should be &geotiff:compression=Deflate&geotiff:predictor=Horizontal but older Geoserver versions do not handle the “geotiff:” part. Geoserver 2.13 and 2.14 support both variants but users should learn to use the correct geotiff: prefixed syntax as soon as possible because that is the correct format and required by other WCS servers.

-Jukka Rahkonen-

Lähettäjä: Mustafa ÖZÇETiN via Geoserver-users [mailto:geoserver-users@anonymised.comceforge.net]
Lähetetty: 4. huhtikuuta 2018 11:12
Vastaanottaja: geoserver-users@lists.sourceforge.net
Aihe: [Geoserver-users] GeoServer Web Coverage Service Issue

Hi,

I have a strange behaviour with GeoServer WCS. I am using a GeoTIFF image with WCS. The image contains terrain type data like land/sea etc. The original size of the image is just 939 KB but when I download this image from WCS it becomes 309 MB! How can a GeoTIFF file expands its size to 300+ times after downloaded from WCS?

System info:

JRE 8

GeoServer 2.9.2

WCS 2.0.1

You can download and inspect the image with the following link:

Temp

Tekstiruutu:

Lähettäjä poisti kuvan.

Temp

Shared with Dropbox

Thanks.

Hi Mustafa,

image003.jpg

image004.png

image001.png

···

On Wed, Apr 4, 2018 at 5:48 PM, Mustafa ÖZÇETiN via Geoserver-users <geoserver-users@anonymised.comforge.net> wrote:

Hi Jukka,

Thanks for the response. Adding the “&compression=LZW” parameter to the end of the WCS GetCoverage request sends a compressed GeoTIFF that I expect.

Some observations:

  1. When I use the “Deflate” value as the compression parameter, GeoServer returns a service exception saying “Provided compression does not seem supported”.

Looking from the code, you may want to try with “DEFLATE”, all upper-case.
I will open a JIRA to make sure the value defined in the specification [1] is supported too.

  1. When I try the “&geotiff:compression=LZW” parameter, GeoServer does not return any exceptions but sends an uncompressed GeoTIFF (with GeoServer 2.9.2).

I think that the “geotiff:” prefixes have been added from 2.11 as part of this JIRA, so 2.9.2 is not supporting them yet:
https://osgeo-org.atlassian.net/browse/GEOS-8555

[1]: https://portal.opengeospatial.org/files/?artifact_id=54813 [Page 16, Table 2]

Hope this helps.
Regards,
Daniele

On Wednesday, April 4, 2018, 5:10:03 PM GMT+3, Rahkonen Jukka (MML) <jukka.rahkonen@maanmittauslaitos.fi> wrote:

Hi,

There is nothing strange with that. Your original image is compressed with “deflate” and if you expand it into uncompressed format with gdal_translate (gdal_translate 1201.tif expand.tif) the file size seems to grow into 324626939 bytes. WCS by default sends coverages as uncompressed.

Read about WCS 2.0 GeoTIFF extension https://portal.opengeospatial.org/files/?artifact_id=54813 and ask Geoserver to send you a compressed image by adding the required parameter &compression=Deflate. Using also &predictor=Horizontal probably yields even smaller output.

BTW. according to the standard the parameters should be &geotiff:compression=Deflate&geotiff:predictor=Horizontal but older Geoserver versions do not handle the “geotiff:” part. Geoserver 2.13 and 2.14 support both variants but users should learn to use the correct geotiff: prefixed syntax as soon as possible because that is the correct format and required by other WCS servers.

-Jukka Rahkonen-

Lähettäjä: Mustafa ÖZÇETiN via Geoserver-users [mailto:geoserver-users@anonymised.comsourceforge.net]
Lähetetty: 4. huhtikuuta 2018 11:12
Vastaanottaja: geoserver-users@anonymised.comsourceforge.net
Aihe: [Geoserver-users] GeoServer Web Coverage Service Issue

Hi,

I have a strange behaviour with GeoServer WCS. I am using a GeoTIFF image with WCS. The image contains terrain type data like land/sea etc. The original size of the image is just 939 KB but when I download this image from WCS it becomes 309 MB! How can a GeoTIFF file expands its size to 300+ times after downloaded from WCS?

System info:

JRE 8

GeoServer 2.9.2

WCS 2.0.1

You can download and inspect the image with the following link:

Temp

Tekstiruutu:

Lähettäjä poisti kuvan.

Temp

Shared with Dropbox

Thanks.


Check out the vibrant tech community on one of the world’s most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot


Geoserver-users mailing list

Please make sure you read the following two resources before posting to this list:

If you want to request a feature or an improvement, also see this: https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer

Geoserver-users@anonymised.com.382…sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Regards,
Daniele Romagnoli

GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


AVVERTENZE AI SENSI DEL D.Lgs. 196/2003
Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

Hi Daniele,

Using the all-upper case DEFLATE value worked as you specify. Thanks a lot.

On Thursday, April 5, 2018, 10:52:48 AM GMT+3, Daniele Romagnoli daniele.romagnoli@anonymised.com wrote:

Hi Mustafa,

On Wed, Apr 4, 2018 at 5:48 PM, Mustafa ÖZÇETiN via Geoserver-users <geoserver-users@lists.sourceforge.net> wrote:

Hi Jukka,

Thanks for the response. Adding the “&compression=LZW” parameter to the end of the WCS GetCoverage request sends a compressed GeoTIFF that I expect.

Some observations:

  1. When I use the “Deflate” value as the compression parameter, GeoServer returns a service exception saying “Provided compression does not seem supported”.

Looking from the code, you may want to try with “DEFLATE”, all upper-case.
I will open a JIRA to make sure the value defined in the specification [1] is supported too.

  1. When I try the “&geotiff:compression=LZW” parameter, GeoServer does not return any exceptions but sends an uncompressed GeoTIFF (with GeoServer 2.9.2).

I think that the “geotiff:” prefixes have been added from 2.11 as part of this JIRA, so 2.9.2 is not supporting them yet:
https://osgeo-org.atlassian.net/browse/GEOS-8555

[1]: https://portal.opengeospatial.org/files/?artifact_id=54813 [Page 16, Table 2]

Hope this helps.
Regards,
Daniele

On Wednesday, April 4, 2018, 5:10:03 PM GMT+3, Rahkonen Jukka (MML) <jukka.rahkonen@ maanmittauslaitos.fi> wrote:

Hi,

There is nothing strange with that. Your original image is compressed with “deflate” and if you expand it into uncompressed format with gdal_translate (gdal_translate 1201.tif expand.tif) the file size seems to grow into 324626939 bytes. WCS by default sends coverages as uncompressed.

Read about WCS 2.0 GeoTIFF extension https://portal.opengeospatial. org/files/?artifact_id=54813 and ask Geoserver to send you a compressed image by adding the required parameter &compression=Deflate. Using also &predictor=Horizontal probably yields even smaller output.

BTW. according to the standard the parameters should be &geotiff:compression=Deflate& geotiff:predictor=Horizontal but older Geoserver versions do not handle the “geotiff:” part. Geoserver 2.13 and 2.14 support both variants but users should learn to use the correct geotiff: prefixed syntax as soon as possible because that is the correct format and required by other WCS servers.

-Jukka Rahkonen-

Lähettäjä: Mustafa ÖZÇETiN via Geoserver-users [mailto:geoserver-users@anonymised.com sourceforge.net]
Lähetetty: 4. huhtikuuta 2018 11:12
Vastaanottaja: geoserver-users@anonymised.com sourceforge.net
Aihe: [Geoserver-users] GeoServer Web Coverage Service Issue

Hi,

I have a strange behaviour with GeoServer WCS. I am using a GeoTIFF image with WCS. The image contains terrain type data like land/sea etc. The original size of the image is just 939 KB but when I download this image from WCS it becomes 309 MB! How can a GeoTIFF file expands its size to 300+ times after downloaded from WCS?

System info:

JRE 8

GeoServer 2.9.2

WCS 2.0.1

You can download and inspect the image with the following link:

Temp

Tekstiruutu:

Lähettäjä poisti kuvan.

Temp

Shared with Dropbox

Thanks.


Check out the vibrant tech community on one of the world’s most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot


Geoserver-users mailing list

Please make sure you read the following two resources before posting to this list:

If you want to request a feature or an improvement, also see this: https://github.com/geoserver/ geoserver/wiki/Successfully- requesting-and-integrating- new-features-and-improvements- in-GeoServer

Geoserver-users@anonymised.com sourceforge.net
https://lists.sourceforge.net/ lists/listinfo/geoserver-users

Regards,
Daniele Romagnoli

GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


AVVERTENZE AI SENSI DEL D.Lgs. 196/2003
Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

Hi Mustafa

image003.jpg

image004.png

image001.png

···

On Fri, Apr 6, 2018 at 9:43 AM, Mustafa ÖZÇETiN <mustafaozcetin76@anonymised.com> wrote:

Hi Daniele,

Using the all-upper case DEFLATE value worked as you specify. Thanks a lot.

Good. thanks for having reported that.
I have also opened a ticket for that (https://osgeo-org.atlassian.net/browse/GEOS-8674) and prepared fixes for GS 2.14.x and 2.13.x so latest releases will also support Deflate as per specification.

Cheers,
Daniele

On Thursday, April 5, 2018, 10:52:48 AM GMT+3, Daniele Romagnoli <daniele.romagnoli@anonymised.comsolutions.it> wrote:

Hi Mustafa,

On Wed, Apr 4, 2018 at 5:48 PM, Mustafa ÖZÇETiN via Geoserver-users <geoserver-users@anonymised.comsourceforge.net> wrote:

Hi Jukka,

Thanks for the response. Adding the “&compression=LZW” parameter to the end of the WCS GetCoverage request sends a compressed GeoTIFF that I expect.

Some observations:

  1. When I use the “Deflate” value as the compression parameter, GeoServer returns a service exception saying “Provided compression does not seem supported”.

Looking from the code, you may want to try with “DEFLATE”, all upper-case.
I will open a JIRA to make sure the value defined in the specification [1] is supported too.

  1. When I try the “&geotiff:compression=LZW” parameter, GeoServer does not return any exceptions but sends an uncompressed GeoTIFF (with GeoServer 2.9.2).

I think that the “geotiff:” prefixes have been added from 2.11 as part of this JIRA, so 2.9.2 is not supporting them yet:
https://osgeo-org.atlassian.net/browse/GEOS-8555

[1]: https://portal.opengeospatial.org/files/?artifact_id=54813 [Page 16, Table 2]

Hope this helps.
Regards,
Daniele

On Wednesday, April 4, 2018, 5:10:03 PM GMT+3, Rahkonen Jukka (MML) <jukka.rahkonen@ maanmittauslaitos.fi> wrote:

Hi,

There is nothing strange with that. Your original image is compressed with “deflate” and if you expand it into uncompressed format with gdal_translate (gdal_translate 1201.tif expand.tif) the file size seems to grow into 324626939 bytes. WCS by default sends coverages as uncompressed.

Read about WCS 2.0 GeoTIFF extension https://portal.opengeospatial. org/files/?artifact_id=54813 and ask Geoserver to send you a compressed image by adding the required parameter &compression=Deflate. Using also &predictor=Horizontal probably yields even smaller output.

BTW. according to the standard the parameters should be &geotiff:compression=Deflate& geotiff:predictor=Horizontal but older Geoserver versions do not handle the “geotiff:” part. Geoserver 2.13 and 2.14 support both variants but users should learn to use the correct geotiff: prefixed syntax as soon as possible because that is the correct format and required by other WCS servers.

-Jukka Rahkonen-

Lähettäjä: Mustafa ÖZÇETiN via Geoserver-users [mailto:geoserver-users@anonymised.com sourceforge.net]
Lähetetty: 4. huhtikuuta 2018 11:12
Vastaanottaja: geoserver-users@anonymised.com2… sourceforge.net
Aihe: [Geoserver-users] GeoServer Web Coverage Service Issue

Hi,

I have a strange behaviour with GeoServer WCS. I am using a GeoTIFF image with WCS. The image contains terrain type data like land/sea etc. The original size of the image is just 939 KB but when I download this image from WCS it becomes 309 MB! How can a GeoTIFF file expands its size to 300+ times after downloaded from WCS?

System info:

JRE 8

GeoServer 2.9.2

WCS 2.0.1

You can download and inspect the image with the following link:

Temp

Tekstiruutu:

Lähettäjä poisti kuvan.

Temp

Shared with Dropbox

Thanks.


Check out the vibrant tech community on one of the world’s most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot


Geoserver-users mailing list

Please make sure you read the following two resources before posting to this list:

If you want to request a feature or an improvement, also see this: https://github.com/geoserver/ geoserver/wiki/Successfully- requesting-and-integrating- new-features-and-improvements- in-GeoServer

Geoserver-users@anonymised.com sourceforge.net
https://lists.sourceforge.net/ lists/listinfo/geoserver-users

Regards,
Daniele Romagnoli

GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


AVVERTENZE AI SENSI DEL D.Lgs. 196/2003
Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

Regards,
Daniele Romagnoli

GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


AVVERTENZE AI SENSI DEL D.Lgs. 196/2003
Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.