Ing. Daniele Romagnoli
Senior Software Engineer
GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
AVVERTENZE AI SENSI DEL D.Lgs. 196/2003
Hi Daniele,
thank you for your all your efforts concerning this issue. I attached two
hours of data and the configuration files for the image mosaic plugin to
this mail. The OpenLayers client i use, always sends requests with a from/to
Time-interval to quey the data. As i mentioned the first file matching the
interval is always delivered. Maybe it is because the mosaic plugin merges
the first file at last and in FLAT mode it overwrites the other pictures?
When i use STACK mode the delivered file is still way too small to contain
all the different bands. As soon as i have a little bit more time i'll try
to look at the ImageMosaic code again to figure out what i am doing wrong.
Cheers,
Marc
________________________________
From: daniele.romagnoli@anonymised.com
Date: Mon, 9 Mar 2015 17:09:53 +0100
Subject: Re: [Geoserver-users] Image Mosaic Plugin composing behaviour
To: mschenke@anonymised.com
CC: geoserver-users@lists.sourceforge.net
Hi Marc,
do you have any chance to share a subset of your dataset? If you have a
couple of granules ad different times (such as T0, T0+7minutes,
T0+14minutes) to replicate the issue, I would like to take a look at the
STACKING mergeBehaviour with your sample case.
Please, let us know.
Cheers,
Daniele
==
GeoServer Professional Services from the experts! Visit
http://goo.gl/NWWaa2 for more information.
Ing. Daniele Romagnoli
Senior Software Engineer
GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
http://www.geo-solutions.it
http://twitter.com/geosolutions_it
-------------------------------------------------------
AVVERTENZE AI SENSI DEL D.Lgs. 196/2003
Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro
utilizzo è consentito esclusivamente al destinatario del messaggio, per le
finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio
senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia
via e-mail e di procedere alla distruzione del messaggio stesso,
cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo
anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per
finalità diverse, costituisce comportamento contrario ai principi dettati
dal D.Lgs. 196/2003.
The information in this message and/or attachments, is intended solely for
the attention and use of the named addressee(s) and may be confidential or
proprietary in nature or covered by the provisions of privacy act
(Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection
Code).Any use not in accord with its purpose, any disclosure, reproduction,
copying, distribution, or either dissemination, either whole or partial, is
strictly forbidden except previous formal approval of the named
addressee(s). If you are not the intended recipient, please contact
immediately the sender by telephone, fax or e-mail and delete the
information in this message that has been received in error. The sender does
not give any warranty or accept liability as the content, accuracy or
completeness of sent messages and accepts no responsibility for changes
made after they were sent or for other risks which arise as a result of
e-mail transmission, viruses, etc.
On Tue, Mar 3, 2015 at 5:32 PM, Marc Schenke <mschenke@anonymised.com> wrote:
Hi Daniele,
currently it looks like the plugin is not merging several images at all.
When i query rain data within range of a day i just receive the first
geotiff image. I would have expected to see at least the several different
rain locations of a day within my bounding box in one picture, while
overlaying rain locations are not summarized.
Using the STACK mode resulted again in a single image with a single band.
As long as i cannot fix this issue, i cannot test the
renderingTransformation methods suggested by you.
I attached a piece of the geoserver.log that shows how all relevant files
are selected, but somewhere on the way they are lost.
Then i had closer look to the image merging code and found out that the
actual pixel value calculation is handled by JAI as described in the
MosaicDescriptor Class ->
http://docs.oracle.com/cd/E17802_01/products/products/java-media/jai/forDevelopers/jai-apidocs/javax/media/jai/operator/MosaicDescriptor.html
There are two modes, BLEND and OVERLAY. Blend does look a bit like it
could be useful for me. In the geotools plugin this mode seems to be
controlled by a blend parameter (RasterLayerRequest.java, member: blend).
However i was not able to figure out where this parameter is initially set
to a value or how i can change this parameter in geoserver. I tried to add
it to the layers xml configuration but that did not change the current
behaviour.
I am not sure if this discussion belongs to geoserver or geotools mailing
lists.
Cheers,
Marc
________________________________
From: daniele.romagnoli@anonymised.com
Date: Mon, 2 Mar 2015 13:07:40 +0100
Subject: Re: [Geoserver-users] Image Mosaic Plugin composing behaviour
To: mschenke@anonymised.com
CC: geoserver-users@lists.sourceforge.net
Hi Marc,
nope... The ImageMosaic is "simply" an image collector which returns back
a mosaic of data from a set of available rasters. You can perform filtering
on some area/dimensions/attributes; you can flat all the pieces of the
mosaic to a single image or stack them into different bands but you can't
get math computations results (as sum, average, std_dev) from them.
A thing which may work is playing with renderingTransformations (which are
operations performed on the fly on the data, configured through a style
applied to the layer) to do what you need.
I'm wondering if using a STACK mergeBehaviour (which stacks different
pieces of the mosaic to different bands) and applying a
renderingTransformation doing sum of the bands will do the trick. I'm also
wondering if we need to know in advance the number of output bands in order
to setup the required computation.
More info or samples on renderingTransformation are here:
http://docs.geoserver.org/stable/en/user/styling/sld-extensions/rendering-transform.html
http://geoserver.geo-solutions.it/edu/en/wps/rendering_tx.html#point-extraction
The latest one also contains a "wind arrows" paragraph where it uses a
style containing ogc:Add operation which could be used to compose additions
of bands.
Hopefully, other developers may also add their feedbacks on the topic.
Cheers,
Daniele
==
GeoServer Professional Services from the experts! Visit
http://goo.gl/NWWaa2 for more information.
Ing. Daniele Romagnoli
Senior Software Engineer
GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
http://www.geo-solutions.it
http://twitter.com/geosolutions_it
-------------------------------------------------------
AVVERTENZE AI SENSI DEL D.Lgs. 196/2003
Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro
utilizzo è consentito esclusivamente al destinatario del messaggio, per le
finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio
senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia
via e-mail e di procedere alla distruzione del messaggio stesso,
cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo
anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per
finalità diverse, costituisce comportamento contrario ai principi dettati
dal D.Lgs. 196/2003.
The information in this message and/or attachments, is intended solely for
the attention and use of the named addressee(s) and may be confidential or
proprietary in nature or covered by the provisions of privacy act
(Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection
Code).Any use not in accord with its purpose, any disclosure, reproduction,
copying, distribution, or either dissemination, either whole or partial, is
strictly forbidden except previous formal approval of the named
addressee(s). If you are not the intended recipient, please contact
immediately the sender by telephone, fax or e-mail and delete the
information in this message that has been received in error. The sender does
not give any warranty or accept liability as the content, accuracy or
completeness of sent messages and accepts no responsibility for changes
made after they were sent or for other risks which arise as a result of
e-mail transmission, viruses, etc.
On Mon, Mar 2, 2015 at 11:49 AM, Marc Schenke <mschenke@anonymised.com>
wrote:
Hello Daniele,
the GeoTiffs contain real measurement of rain in milimeters per m² per
hour. Basically every cell in the raster contains floating point numbers. I
have hoped to receive an accumulated raster as response, when querying with
a time interval. The task is to display the amount of rain for a user
defined time interval. For example if the interval encloses ten files, the
result should contain the accumulated rain amount for every cell from the
matching files.
The client is a web interface based on Open Layers 2.
Flattening in the sense that all files are combined into a single
image/band is what i am looking for. How are cell values ( colors or
measurements ) computed when two images overlap each other?
Cheers,
Marc
________________________________
From: daniele.romagnoli@anonymised.com
Date: Mon, 2 Mar 2015 11:06:19 +0100
Subject: Re: [Geoserver-users] Image Mosaic Plugin composing behaviour
To: mschenke@anonymised.com
CC: geoserver-users@lists.sourceforge.net
Hi Marc,
In that case, the "FLAT" merge behaviour does what its name suggests:
It takes all the matching inputs and FLAT them all together to a single
image.
Next questions then:
- Which datatypes of images are you merging? (Byte RGB/Byte Gray/Real
measurements (temperature/humidity/...)/...?)
- Since all the input images cover the same area, what kind of visual
output are you expecting from a set of them?
I mean... if you are mosaicking images covering different locations, you
may want to get back a single image made of all those scattered pieces. In
this case, you will populate instead the same geographic area with data
coming from different times. Are you looking for a multibands image where
each band is made of data coming from a different time of the same region?
Or are you looking instead for a 3D output (lat/lon+time) to be used into
another client? (I'm thinking about setting a NetCDF output with a time
dimension to be view in Panoply, ToolsUI, ...).
Please, let us know what is your intended usage.
Cheers,
Daniele
==
GeoServer Professional Services from the experts! Visit
http://goo.gl/NWWaa2 for more information.
Ing. Daniele Romagnoli
Senior Software Engineer
GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
http://www.geo-solutions.it
http://twitter.com/geosolutions_it
-------------------------------------------------------
AVVERTENZE AI SENSI DEL D.Lgs. 196/2003
Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro
utilizzo è consentito esclusivamente al destinatario del messaggio, per le
finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio
senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia
via e-mail e di procedere alla distruzione del messaggio stesso,
cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo
anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per
finalità diverse, costituisce comportamento contrario ai principi dettati
dal D.Lgs. 196/2003.
The information in this message and/or attachments, is intended solely for
the attention and use of the named addressee(s) and may be confidential or
proprietary in nature or covered by the provisions of privacy act
(Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection
Code).Any use not in accord with its purpose, any disclosure, reproduction,
copying, distribution, or either dissemination, either whole or partial, is
strictly forbidden except previous formal approval of the named
addressee(s). If you are not the intended recipient, please contact
immediately the sender by telephone, fax or e-mail and delete the
information in this message that has been received in error. The sender does
not give any warranty or accept liability as the content, accuracy or
completeness of sent messages and accepts no responsibility for changes
made after they were sent or for other risks which arise as a result of
e-mail transmission, viruses, etc.
On Mon, Mar 2, 2015 at 10:37 AM, Marc Schenke <mschenke@anonymised.com>
wrote:
Hi Daniele,
the only difference is the validity time, all raster files cover the exact
same area. However after checking the corresponding geometry column i
noticed that sometimes the bounding box declaration varies. It is always in
the same geographic location (when i look at them on the map) but the order
of points within the polygon differs. I am not sure if this is an issue,
since it is always the same set of coordinates.
Cheers,
Marc
________________________________
From: daniele.romagnoli@anonymised.com
Date: Mon, 2 Mar 2015 10:17:04 +0100
Subject: Re: [Geoserver-users] Image Mosaic Plugin composing behaviour
To: mschenke@anonymised.com
CC: geoserver-users@lists.sourceforge.net
Hi Marc,
quick question:
are these GeoTiffs scattered "around the world" or are all of them
covering the same exact Bounding Box instead, where the only difference is
the 7 minutes validity time?
Cheers,
Daniele
==
GeoServer Professional Services from the experts! Visit
http://goo.gl/NWWaa2 for more information.
Ing. Daniele Romagnoli
Senior Software Engineer
GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
http://www.geo-solutions.it
http://twitter.com/geosolutions_it
-------------------------------------------------------
AVVERTENZE AI SENSI DEL D.Lgs. 196/2003
Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro
utilizzo è consentito esclusivamente al destinatario del messaggio, per le
finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio
senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia
via e-mail e di procedere alla distruzione del messaggio stesso,
cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo
anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per
finalità diverse, costituisce comportamento contrario ai principi dettati
dal D.Lgs. 196/2003.
The information in this message and/or attachments, is intended solely for
the attention and use of the named addressee(s) and may be confidential or
proprietary in nature or covered by the provisions of privacy act
(Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection
Code).Any use not in accord with its purpose, any disclosure, reproduction,
copying, distribution, or either dissemination, either whole or partial, is
strictly forbidden except previous formal approval of the named
addressee(s). If you are not the intended recipient, please contact
immediately the sender by telephone, fax or e-mail and delete the
information in this message that has been received in error. The sender does
not give any warranty or accept liability as the content, accuracy or
completeness of sent messages and accepts no responsibility for changes
made after they were sent or for other risks which arise as a result of
e-mail transmission, viruses, etc.
On Mon, Mar 2, 2015 at 9:13 AM, Marc Schenke <mschenke@anonymised.com> wrote:
Hello,
i have a question concerning the raster data merge behaviour of the image
mosaic plugin in combination with temporal wms requests. Here's my setup:
Geoserver 2.6.2 running in a Tomcat 7 container on ubuntu 12 server
configured image mosaic plugin with geotiff's and postgis, as suggested in
the tutorial
geotiffs are added every 7 minutes and are valid within this interval (i
have a datefrom and dateto timestamp in the database)
Layer is configured to use time dimension with presentation set to
"continuous interval" and default value "Use the biggest domain value"
Merge behaviour is set to "FLAT"
The time support docs say that i can plot several measurements (in this
case a raster of rain amounts) over a certain time window: "you might have a
single dataset with weather observations collected over time and choose to
plot a single day’s worth of observations."
http://docs.geoserver.org/latest/en/user/services/wms/time.html
So i expected geoserver to somehow compose a picture of several raster
files when i query the wms for an one hour interval. Instead geoserver
returns the first geotiff that meets the lower end time of my requested
interval.
Is it possible to configure the geoserver in a way, that it will
accumulate all raster data for the requested interval within a single layer,
or did i missunderstand the capabilities of time support and the image
mosaic plugin? And are there other Merge behaviours than FLAT?
Thanks in advance,
Marc Schenke
------------------------------------------------------------------------------
Dive into the World of Parallel Programming The Go Parallel Website,
sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for
all
things parallel software development, from weekly thought leadership blogs
to
news, videos, case studies, tutorials and more. Take a look and join the
conversation now. http://goparallel.sourceforge.net/
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users