I want to add an extra note. I noticed that if I don't use integration with GeoServer WMS and directly use GWC WMS (/geoserver/gwc/service/wms), the performance is significantly better. Most of my request response times are < 1s, whereas before using the integrated mode, I was getting some 10s+ response times along with some < 1s response times.
Is there a known performance difference between integrated WMS mode versus GWC WMS?
Thanks,
Danny
-----Original Message-----
From: Danny Cheng
Sent: Friday, November 28, 2014 1:02 PM
To: 'Simone Giannecchini'
Cc: geoserver-users@lists.sourceforge.net
Subject: RE: [Geoserver-users] 2.6.1 JPEG2000 Performance
Hi Simone,
I have an image mosaic layer that serves up a global basemap in JPEG2000 format. I am accessing via OWS service with the following sample request,
http://localhost:8686/geoserver/myworkspace/ows?LAYERS=myworkspace%3AJPEG2000_Test&FORMAT=image%2Fpng&MINRESOLUTION=auto&MAXRESOLUTION=auto&TRANSPARENT=TRUE&TILED=true&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&SRS=EPSG%3A4326&BBOX=120.76171875,24.43359375,120.9375,24.609375&WIDTH=256&HEIGHT=256
I am also trying to cache the basemap to speed up future requests via GWC. See attached for the image mosaic configuration. I did confirm that ECW is being used. Looking through the log, I found something interesting.
28 Nov 10:29:38 WARN [layer.MetaTile] - ********* Native JAI is not installed, meta tile cropping may be slow ********
Doesn't JAI come with GeoServer?
Thanks,
Danny
-----Original Message-----
From: simboss1@...84... [mailto:simboss1@…84…] On Behalf Of Simone Giannecchini
Sent: Friday, November 28, 2014 10:09 AM
To: Danny Cheng
Cc: Simone Giannecchini; geoserver-users@lists.sourceforge.net
Subject: Re: [Geoserver-users] 2.6.1 JPEG2000 Performance
Dear Danny,
please find my answers inline below....
Regards,
Simone Giannecchini
GeoServer Professional Services from the experts! Visit
http://goo.gl/NWWaa2 for more information.
Ing. Simone Giannecchini
@simogeo
Founder/Director
GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928
http://www.geo-solutions.it
http://twitter.com/geosolutions_it
-------------------------------------------------------
AVVERTENZE AI SENSI DEL D.Lgs. 196/2003
Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate.
Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema.
Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.
The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.
On Fri, Nov 28, 2014 at 6:18 PM, Danny Cheng <dcheng@...3836...> wrote:
Hi Simone,
I played around with the configuration further and I found that the cause of the poor performance is actually due to caching with GWC. I was running GWC with direct integration with GeoServer WMS. When I turned off caching the performance was much better at roughly 10s response time. Is this expected with direct integration with GeoServer WMS? I haven't tried GWC WMS yet.
Generally speaking GWC does metatiling when it creates a tile hence your requests requests a lager area underneath and you also need to take into account the time to write the tiles to the disk. Then requests are accelerated on successive access.
You would need to be more specific about what you are doing and how you are accessing the WMS service in order for me to be helpful.
For information purposes here is the gdalinfo of my input file.
Driver: JP2ECW/ERDAS JPEG2000 (SDK 5.0)
Files: N55-W012.jp2
Size is 21621, 36021
Coordinate System is:
GEOGCS["WGS 84",
DATUM["WGS_1984",
SPHEROID["WGS 84",6378137,298.257223563,
AUTHORITY["EPSG","7030"]],
AUTHORITY["EPSG","6326"]],
PRIMEM["Greenwich",0],
UNIT["degree",0.0174532925199433],
AUTHORITY["EPSG","4326"]]
Origin = (-9.001458333333334,60.001458333333332)
Pixel Size = (0.000138888888889,-0.000138888888889)
Metadata:
AREA_OR_POINT=Point
COLORSPACE=RGB
COMPRESSION_RATE_TARGET=23
VERSION=1
Corner Coordinates:
Upper Left ( -9.0014583, 60.0014583) ( 9d 0' 5.25"W, 60d 0'
5.25"N) Lower Left ( -9.0014583, 54.9985417) ( 9d 0' 5.25"W,
54d59'54.75"N) Upper Right ( -5.9985417, 60.0014583) ( 5d59'54.75"W,
60d 0' 5.25"N) Lower Right ( -5.9985417, 54.9985417) ( 5d59'54.75"W, 54d59'54.75"N)
Center ( -7.5000000, 57.5000000) ( 7d30' 0.00"W, 57d30' 0.00"N)
Band 1 Block=256x256 Type=Byte, ColorInterp=Red
Description = Red
Overviews: 10810x18010, 5405x9005, 2702x4502, 1351x2251, 675x1125,
337x562, 168x281 Band 2 Block=256x256 Type=Byte, ColorInterp=Green
Description = Green
Overviews: 10810x18010, 5405x9005, 2702x4502, 1351x2251, 675x1125,
337x562, 168x281 Band 3 Block=256x256 Type=Byte, ColorInterp=Blue
Description = Blue
Overviews: 10810x18010, 5405x9005, 2702x4502, 1351x2251, 675x1125,
337x562, 168x281
I am using the GDAL plug-in and image mosaic plug-in to serve this layer. See the attachment for layer configuration. Can you elaborate on what keywords I'm looking for in the verbose log? It's quite extensive.
Well, I kind of assume you are using the ECW plugin hence there is no need to check the logs. Just to be on the safe side in my log I see something like this at the beginning:
2014-11-28 19:02:30,899 DEBUG [org.geotools.coverageio.gdal.dted] - DTEDFormatFactory is availaible.
2014-11-28 19:02:30,900 DEBUG [org.geotools.coverageio.gdal.jp2k] - JP2KFormatFactory is not availaible.
2014-11-28 19:02:30,900 DEBUG [org.geotools.coverageio.gdal.erdasimg]
- ErdasImgFormatFactory is availaible.
2014-11-28 19:02:30,900 DEBUG [org.geotools.coverageio.gdal.ehdr] - EsriHdrFormatFactory is availaible.
2014-11-28 19:02:30,901 DEBUG [org.geotools.coverageio.gdal.nitf] - NITFFormatFactory is availaible.
2014-11-28 19:02:30,901 DEBUG [org.geotools.coverageio.gdal.ecw] - ECWFormatFactory is availaible.
2014-11-28 19:02:30,902 DEBUG [org.geotools.coverageio.jp2k] - JP2KFormatFactory is availaible.
2014-11-28 19:02:30,902 DEBUG [org.geotools.coverageio.gdal.mrsid] - MrSIDFormatFactory is availaible.
2014-11-28 19:02:30,904 DEBUG [org.geotools.gce.arcgrid] - ArcGridFormatFactory is availaible.
2014-11-28 19:02:30,905 DEBUG [org.geotools.coverageio.gdal.envihdr] - EnviHdrFormatFactory is availaible.
2014-11-28 19:02:30,915 DEBUG [org.geotools.coverageio.gdal.rpftoc] - RPFTOCFormatFactory is availaible.
2014-11-28 19:02:30,916 DEBUG [org.geotools.coverageio.gdal.jp2mrisd]
- JP2MrSIDFormatFactory is not availaible. <<----
2014-11-28 19:02:30,916 DEBUG [org.geotools.coverageio.gdal.jp2ecw] -
JP2ECWFormatFactory is availaible. <<----
2014-11-28 19:02:30,926 DEBUG [org.geotools.coverageio.gdal.dted] - Creating a new DTEDFormat.
2014-11-28 19:02:30,927 DEBUG [org.geotools.coverageio.gdal.erdasimg]
- Creating a new ErdasImgFormat.
2014-11-28 19:02:30,929 DEBUG [org.geotools.coverageio.gdal.ehdr] - Creating a new EsriHdrFormat.
2014-11-28 19:02:30,930 DEBUG [org.geotools.coverageio.gdal.nitf] - Creating a new NITFFormat.
2014-11-28 19:02:30,931 DEBUG [org.geotools.coverageio.gdal.ecw] - Creating a new ECWFormat.
2014-11-28 19:02:30,943 DEBUG [org.geotools.coverageio.jp2k] - Creating a new JP2KFormat.
2014-11-28 19:02:30,944 DEBUG [org.geotools.coverageio.gdal.mrsid] - Creating a new MrSIDFormat.
2014-11-28 19:02:30,948 DEBUG [org.geotools.gce.arcgrid] - Creating a new ArcGriFormat.
2014-11-28 19:02:30,950 DEBUG [org.geotools.coverageio.gdal.envihdr] - Creating a new EnviHdrFormat.
2014-11-28 19:02:30,962 DEBUG [org.geotools.coverageio.gdal.rfptoc] - Creating a new RPFTOCFormat.
2014-11-28 19:02:30,965 DEBUG [org.geotools.coverageio.gdal.jp2ecw] - Creating a new JP2KFormat.
An easier way is to check the GUI of GeoServer. When you try to create a store you need to make sure the right plugin is activated and available as per the image attached.
One last thing, send over the properties file for the ImageMosaic I want to see which SPI is suggested (this speed things up as avoids lookups).
Thanks,
Danny
-----Original Message-----
From: simboss1@...84... [mailto:simboss1@…84…] On Behalf Of
Simone Giannecchini
Sent: Friday, November 28, 2014 8:11 AM
To: Danny Cheng
Cc: geoserver-users@lists.sourceforge.net
Subject: Re: [Geoserver-users] 2.6.1 JPEG2000 Performance
Dear Danny,
can you give us a bit more info as per the following questions?
- provide us a gdalinfo of the input file
- which plugin are you using for serving this file?
- provide us with the config in geoserver for this layer
- which plugin where you using to serve this layer
It looks to me the siutation where GeoServer is not loading a specific
JP2 plugin (ECW or Kakadu) and is actually using the internal JJ2000 one which is _extremely_ slow.
To spot such a problem you need to restart the geoserver with the log
to verbose and look at the plugin that have been disabled. This might
be next step once we get some basic information
Regards,
Simone Giannecchini
GeoServer Professional Services from the experts! Visit
http://goo.gl/NWWaa2 for more information.
Ing. Simone Giannecchini
@simogeo
Founder/Director
GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928
http://www.geo-solutions.it
http://twitter.com/geosolutions_it
-------------------------------------------------------
AVVERTENZE AI SENSI DEL D.Lgs. 196/2003 Le informazioni contenute in
questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate.
Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema.
Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.
The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.
On Thu, Nov 27, 2014 at 9:45 PM, Danny Cheng <dcheng@...3836...> wrote:
Hi,
Did anyone notice a significant drop in JPEG2000 performance when
making WMS GetMap request? My request format is PNG and tile size is
256x256. I find that it is taking very long to encode to PNG and it
took about 4 minutes to get back my image. I didn’t have this problem with 2.5.2.
Thanks,
Danny
---------------------------------------------------------------------
-
-------- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT
Server from Actuate! Instantly Supercharge Your Business Reports and
Dashboards with Interactivity, Sharing, Native Excel Exports, App
Integration & more Get technology previously reserved for
billion-dollar corporations, FREE
http://pubads.g.doubleclick.net/gampad/clk?id=157005751&iu=/4140/ostg.
clktrk _______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users