Image Mosaic granules pointing to Google Storage private bucket problem

GeoServer GeoServer User
1

Hi.
I have some COG images stored in a private bucket. When I create a mosaic with an index file (SHAPEFILE) pointing to these images, no images are displayed. I can create the ImageMosaic store without errors (there are no errors in the LOG file), but the result is that nothing is displayed and no error message appears.

I have previously created the GOOGLE_APPLICATION_CREDENTIALS environment variable pointing to my service account file.

The following works for me: If I create a GeoTIFF store and in the connection parameters I put the image URL (cog://https://…/Alerta_30TUN_2021_cog.tif), GeoServer displays it correctly, so it is reading the service account file correctly.

Could someone tell me how to make my mosaic able to read the Google credentials (service account file) and display the images as GeoTIFF store does?

Regards

2

Hi,
the image mosaic is using exactly the same underlying COG libraries as the GeoTIFF store.
Thinking out loud… did you tell the mosaic that it’s dealing with COGs, by adding the following in the
indexer.properties, before creation, or updating it afterwards in the mosaic property file?

Cog=true
SuggestedSPI=it.geosolutions.imageioimpl.plugins.cog.CogImageReaderSpi

See also: https://docs.geoserver.org/main/en/user/community/cog/update.html#imagemosaic-configuration-update

3

Hi, Andrea.

Yes, that information is added in both indexer.properties and .properties files.

The mosaic uses a mix of both public and private bucket images, but the only ones that are not visible are the ones from the private bucket. I think that if this were the problem, no images would be visible, neither public nor private.

On the other hand, as I mentioned in the initial message, the strange thing is that if I create a layer with a single image that uses a GeoTIFF type store, GeoServer displays it correctly. In this case, there is a checkbox to check if the image is a COG, and once checked, I choose the GS option in the Range Reader settings dropdown, but these options are not available when creating the mosaic store.

Thanks a lot.

4

Hi,

the TIFF reader knows it might be COG, but the image mosaic can delegate to
a mix of different image

types in the same mosaic, so it can’t offer that option at the GUI level.

Maybe try adding the following in the indexer and mosaic property file:

CogRangeReader=it.geosolutions.imageioimpl.plugins.cog.GSRangeReader

Regards,

Andrea Aime

==

GeoServer Professional Services from the experts!

Visit GeoSolutions Enterprise Support Services for more information.

==

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions Group
phone: +39 0584 962313

fax: +39 0584 1660272

mob: +39 339 8844549

http://twitter.com/geosolutions_it

Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE
2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si
precisa che ogni circostanza inerente alla presente email (il suo
contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è
riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il
messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra
operazione è illecita. Le sarei comunque grato se potesse darmene notizia.

This email is intended only for the person or entity to which it is
addressed and may contain information that is privileged, confidential or
otherwise protected from disclosure. We remind that - as provided by
European Regulation 2016/679 “GDPR” - copying, dissemination or use of this
e-mail or the information herein by anyone other than the intended
recipient is prohibited. If you have received this email by mistake, please
notify us immediately by telephone or e-mail

On Wed, Oct 2, 2024 at 10:20 AM Andrea Aime <
andrea.aime@geosolutionsgroup.com> wrote:

Hi,
the image mosaic is using exactly the same underlying COG libraries as the
GeoTIFF store.
Thinking out loud… did you tell the mosaic that it’s dealing with COGs,
by adding the following in the
indexer.properties, before creation, or updating it afterwards in the
mosaic property file?

Cog=true
SuggestedSPI=it.geosolutions.imageioimpl.plugins.cog.CogImageReaderSpi

See also:
COG ImageMosaic from local storage to S3 — GeoServer 2.27.x User Manual

Regards,

Andrea Aime

==

GeoServer Professional Services from the experts!

Visit GeoSolutions Enterprise Support Services for more information.

==

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions Group
phone: +39 0584 962313

fax: +39 0584 1660272

mob: +39 339 8844549

https://www.geosolutionsgroup.com/

x.com

Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE
2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si
precisa che ogni circostanza inerente alla presente email (il suo
contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è
riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il
messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra
operazione è illecita. Le sarei comunque grato se potesse darmene notizia.

This email is intended only for the person or entity to which it is
addressed and may contain information that is privileged, confidential or
otherwise protected from disclosure. We remind that - as provided by
European Regulation 2016/679 “GDPR” - copying, dissemination or use of this
e-mail or the information herein by anyone other than the intended
recipient is prohibited. If you have received this email by mistake, please
notify us immediately by telephone or e-mail

On Tue, Oct 1, 2024 at 1:00 PM Pedro Briones via OSGeo Discourse <
noreply@discourse.osgeo.org> wrote:

pbg https://discourse.osgeo.org/u/pbg
October 1

Hi.
I have some COG images stored in a private bucket. When I create a mosaic
with an index file (SHAPEFILE) pointing to these images, no images are
displayed. I can create the ImageMosaic store without errors (there are no
errors in the LOG file), but the result is that nothing is displayed and no
error message appears.

I have previously created the GOOGLE_APPLICATION_CREDENTIALS environment
variable pointing to my service account file.

The following works for me: If I create a GeoTIFF store and in the
connection parameters I put the image URL (cog://https://…/Alerta_30TUN_2021_cog.tif),
GeoServer displays it correctly, so it is reading the service account file
correctly.

Could someone tell me how to make my mosaic able to read the Google
credentials (service account file) and display the images as GeoTIFF store
does?

Regards

Visit Topic
https://discourse.osgeo.org/t/image-mosaic-granules-pointing-to-google-storage-private-bucket-problem/85584/1
or reply to this email to respond.

To unsubscribe from these emails, click here
https://discourse.osgeo.org/email/unsubscribe/df849586d41deae84b39adef3c1c339e94476dd98602977ba6a1d17e2af692cf
.

5

It works!!! :grinning:

You have solved a problem that I have been trying to fix for a long time!!!

Thanks a lot, Andrea.

Regards