···
On Thu, Feb 11, 2016 at 5:55 PM, César Martínez Izquierdo <cesar.izq@anonymised.com> wrote:
Dear Simone, I agree on creating a proposal to mature the exact scope and the best way to implement it on Geoserver.
Some first ideas:
- Read raster statistics (max & mean) if available on the raster data source
- Compute min and max and store it on the CoverageDimension range (it is already stored but never calculated AFAIK. It can be currently introduced by hand on the web interface)
- As an WPS process
The capability to compute stats on a raster is already available as a WPS.
We might want to improve the process by adding a configurable subsampling step to reduce the load.
- As an optional parameter to REST operations on coverages (POST or GET)
As Andrea indicated, it would be great to have this as an asynch task.
It might be worth exploring the idea of putting the importer in the mix and handling this as an asynch import.
We can continue elaborating on the wiki.
Cool, share the page when you have it.
César
Simone Giannecchini
GeoServer Professional Services from the experts!
Visit http://goo.gl/it488V for more information.
Ing. Simone Giannecchini
@simogeo
Founder/Director
GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928
http://www.geo-solutions.it
http://twitter.com/geosolutions_it
AVVERTENZE AI SENSI DEL D.Lgs. 196/2003
Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.
The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.
On 10 February 2016 at 18:40, Simone Giannecchini <simone.giannecchini@anonymised.com> wrote:
Dear Cesar,
adding to Andrea’s, your proposal is certainly interesting and we would be glad to devote some our time helping out with this.
I would suggest to start with putting together a proposal that we can start discussing on.
–
César Martínez Izquierdo
GIS developer
SCOLAB: http://www.scolab.es
Regards,
Simone Giannecchini
GeoServer Professional Services from the experts!
Visit http://goo.gl/it488V for more information.
Ing. Simone Giannecchini
@simogeo
Founder/Director
GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928
http://www.geo-solutions.it
http://twitter.com/geosolutions_it
AVVERTENZE AI SENSI DEL D.Lgs. 196/2003
Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.
The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.
On Wed, Feb 10, 2016 at 6:22 PM, Andrea Aime <andrea.aime@anonymised.com> wrote:
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140
Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel
On Tue, Feb 9, 2016 at 6:21 PM, César Martínez Izquierdo <cesar.izq@anonymised.com> wrote:
We are interested on improving the behaviour of Geoserver regarding the management of raster statistics, which currently seems to be broken in several senses:
a) It is not possible to update raster statistics using REST API (see message [1] on mailing list)
This one is easily fixed, given enough time to work it.
b) Geoserver apparently fails to (or doesn’t make any effort to) read raster statistics even if they are present of the raster data source (at least for GeoTiff)
Does GeoTiff have statistics built in? First time I hear about it?
Or are you talking about the GDAL statistics file (a xml file normally), which is not part of any standard?
Indeed the code is not making any effort to read it.
When you talk about statistics do you mean just min and max, or an histogram?
And where would you expect to see the results of this calculation? Right now I believe they are showing up only in WCS outputs as far as I know
(and assuming you’re not talking about a histogram, which won’t show up anywhere).
c) Geoserver apparently is not able to compute raster statistics from the data source
It is not indeed, but it has the machinery necessary to do it. What is worrysome about it is that some data
sources are several terabytes of data (or more), calculating full statistics on them might require hours or days.
Seems like a job for a WPS process, that can be called asynchronously, at least for large datasets.
We intend to correct a) in the sort term (meaning: now), but we might also be interested on b) and c) on the long term depending on the required effort.
For c), I envisage a parameter on REST requests for coverages which forces the (re)calculation of statistics. For instance:
POST /workspaces//coveragestores//coverages[.]?stats=yes (when uploading the coverage)
GET /workspaces//coveragestores//coverages/[.]?stats=yes (for an already published coverage)
Do you think it could be a good approach?
For small datasets yes, for larger ones a synchronous request might take too much time
Cheers
Andrea
–
==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.
Ing. Andrea Aime
@geowolf
Technical Lead
GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549
http://www.geo-solutions.it
http://twitter.com/geosolutions_it
AVVERTENZE AI SENSI DEL D.Lgs. 196/2003
Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.
The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.