[Geoserver-users] Geoserver 2.5 - poor performance mosaics

GeoServer GeoServer User
1

Hi,

we are working on a project which involves providing a service with full
national coverage using Aerial Photography. We created a mosaic using
Geoserver 2.4.4 from multiple GeoTiff images with no performance issues but
when we tried to migrate to a new environment and tried to use geoserver 2.5
we found that the performance was very poor (in some cases it took hours to
show the mosaic). We have seen that there have been changes in the image
codecs, but we don't know if this is a known bug of there is something that
we should change in our configuration. We moved back to Geoserver 2.4.4 and
everything worked fine again. Has anyone had a similar issue?

Any help would be highly appreciated.

Thanks in advance,
Jose

--
View this message in context: http://osgeo-org.1560.x6.nabble.com/Geoserver-2-5-poor-performance-mosaics-tp5150254.html
Sent from the GeoServer - User mailing list archive at Nabble.com.

2

Hi Jose,
I had a few issues with the 2.5.x series (one sounds very similar to yours), however a couple of them have been fixed in the new 2.5.x snapshots so you may wish to test those to see if the issue is still evident.

If it keeps occuring, can you provide more details to the list (geotiff properties, form of mosaic etc).

Cheers,
Jonathan

This transmission is intended for the named addressee(s) only and may contain confidential, sensitive or personal information and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.

···

On 9 July 2014 10:43, joseluisgraa <joseluisgraa@anonymised.com> wrote:

Hi,

we are working on a project which involves providing a service with full
national coverage using Aerial Photography. We created a mosaic using
Geoserver 2.4.4 from multiple GeoTiff images with no performance issues but
when we tried to migrate to a new environment and tried to use geoserver 2.5
we found that the performance was very poor (in some cases it took hours to
show the mosaic). We have seen that there have been changes in the image
codecs, but we don’t know if this is a known bug of there is something that
we should change in our configuration. We moved back to Geoserver 2.4.4 and
everything worked fine again. Has anyone had a similar issue?

Any help would be highly appreciated.

Thanks in advance,
Jose

–
View this message in context: http://osgeo-org.1560.x6.nabble.com/Geoserver-2-5-poor-performance-mosaics-tp5150254.html
Sent from the GeoServer - User mailing list archive at Nabble.com.

Open source business process management suite built on Java and Eclipse
Turn processes into business applications with Bonita BPM Community Edition
Quickly connect people, data, and systems into organized workflows
Winner of BOSSIE, CODIE, OW2 and Gartner awards
http://p.sf.net/sfu/Bonitasoft

Geoserver-users mailing list
Geoserver-users@anonymised.comsts.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

3

On Wed, Jul 9, 2014 at 11:43 AM, joseluisgraa <joseluisgraa@anonymised.com>
wrote:

Hi,

we are working on a project which involves providing a service with full
national coverage using Aerial Photography. We created a mosaic using
Geoserver 2.4.4 from multiple GeoTiff images with no performance issues but
when we tried to migrate to a new environment and tried to use geoserver
2.5
we found that the performance was very poor (in some cases it took hours to
show the mosaic). We have seen that there have been changes in the image
codecs, but we don't know if this is a known bug of there is something that
we should change in our configuration. We moved back to Geoserver 2.4.4 and
everything worked fine again. Has anyone had a similar issue?

Yes, just recently, with a mosaic made of tiles with heterogeneous
resolutions,
while reprojecting.

Check the mailing list archives (there are links to them in geoserver.org,
community section)

Cheers
Andrea

--

GeoServer Professional Services from the experts! Visit
http://goo.gl/NWWaa2 for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

4

Thanks Jonathan, do you mean using the nightly version of 2.5.1? Now we are
in a rush and we probably won't have too much time to test, so maybe it's
not a good idea to test beta versions...

I just wanted to check if somebody have had some problems with mosaics in
this version.

What details of the geotiff files would you find interesting in this case?

Jose

--
View this message in context: http://osgeo-org.1560.x6.nabble.com/Geoserver-2-5-poor-performance-mosaics-tp5150254p5150275.html
Sent from the GeoServer - User mailing list archive at Nabble.com.

5

Hi Andrea,

thanks for your response. The thing is that these files doesn't have
heterogeneous resolutions and we have tried with and without reprojecting,
with the same result.

I have tried to search in the mailing list but I haven't found anything
related directly to this issue.

Jose

--
View this message in context: http://osgeo-org.1560.x6.nabble.com/Geoserver-2-5-poor-performance-mosaics-tp5150254p5150277.html
Sent from the GeoServer - User mailing list archive at Nabble.com.

6

This transmission is intended for the named addressee(s) only and may contain confidential, sensitive or personal information and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.

···

Hi Jose,
I believe 2.5.2 is out in a week or so. That should have the fixes in that resolved my issues, I’d suggest trying that if you’re time constrained and don’t wish to test a beta.

Useful information:

  • GdalInfo for one of the GeoTiffs
  • Projection you’re serving in.

Cheers,
Jonathan

On 9 July 2014 12:45, joseluisgraa <joseluisgraa@anonymised.com> wrote:

Thanks Jonathan, do you mean using the nightly version of 2.5.1? Now we are
in a rush and we probably won’t have too much time to test, so maybe it’s
not a good idea to test beta versions…

I just wanted to check if somebody have had some problems with mosaics in
this version.

What details of the geotiff files would you find interesting in this case?

Jose

–
View this message in context: http://osgeo-org.1560.x6.nabble.com/Geoserver-2-5-poor-performance-mosaics-tp5150254p5150275.html

Sent from the GeoServer - User mailing list archive at Nabble.com.

Open source business process management suite built on Java and Eclipse
Turn processes into business applications with Bonita BPM Community Edition
Quickly connect people, data, and systems into organized workflows
Winner of BOSSIE, CODIE, OW2 and Gartner awards
http://p.sf.net/sfu/Bonitasoft

Geoserver-users mailing list
Geoserver-users@anonymised.comsts.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

7

On 9 July 2014 13:00, Jonathan Moules <jonathanmoules@anonymised.com>
wrote:

Hi Jose,
I believe 2.5.2 is out in a week or so. That should have the fixes in that
resolved my issues, I'd suggest trying that if you're time constrained and
don't wish to test a beta.

Really it's better to test the beta and get fixes in before the release. Or
you can wait 2 months for the next one to come along.

Ian

8

That’s a good point Ian, I’ll try to get time to test this version…

By the way, this is the output of the gdalinfo against one of the tiles that compound the mosaic:

Driver: GTiff/GeoTIFF
Files: SZ07.tif
Size is 20000, 16000
Coordinate System is:
LOCAL_CS[“OSGB 1936 / British National Grid”,
GEOGCS[“OSGB 1936”,
DATUM[“unknown”,
SPHEROID[“unretrievable - using WGS84”,6378137,298.257223563],
TOWGS84[446.448,-125.157,542.06,0.15,0.247,0.842,-20.489]],
PRIMEM[“Greenwich”,0],
UNIT[“degree”,0.0174532925199433]],
AUTHORITY[“EPSG”,“27700”],
UNIT[“metre”,1]]
Origin = (400000.000000000000000,80000.000000000000000)
Pixel Size = (0.250000000000000,-0.250000000000000)
Metadata:
AREA_OR_POINT=Area
Image Structure Metadata:
COMPRESSION=JPEG
INTERLEAVE=PIXEL
Corner Coordinates:
Upper Left ( 400000.000, 80000.000)
Lower Left ( 400000.000, 76000.000)
Upper Right ( 405000.000, 80000.000)
Lower Right ( 405000.000, 76000.000)
Center ( 402500.000, 78000.000)
Band 1 Block=20000x16 Type=Byte, ColorInterp=Red
Overviews: 10000x8000, 5000x4000, 2500x2000, 1250x1000, 625x500, 313x250, 157x125
Band 2 Block=20000x16 Type=Byte, ColorInterp=Green
Overviews: 10000x8000, 5000x4000, 2500x2000, 1250x1000, 625x500, 313x250, 157x125
Band 3 Block=20000x16 Type=Byte, ColorInterp=Blue
Overviews: 10000x8000, 5000x4000, 2500x2000, 1250x1000, 625x500, 313x250, 157x125

···

2014-07-09 13:19 GMT+01:00 Ian Turton <ijturton@anonymised.com>:

On 9 July 2014 13:00, Jonathan Moules <jonathanmoules@anonymised.com> wrote:

Really it’s better to test the beta and get fixes in before the release. Or you can wait 2 months for the next one to come along.

Ian

Hi Jose,
I believe 2.5.2 is out in a week or so. That should have the fixes in that resolved my issues, I’d suggest trying that if you’re time constrained and don’t wish to test a beta.

9

Dear Jose,
a few observations:

-1- a nightly from the 2.5.x branch is not a beta, it is actually the
soon to be 2.5.2. Hence I would use it with no fear
-2- you say the granules are not heterogenous but I am assuming this
does not come from the fact that you opened the _mosaic_.properties
file that GeoServer creates for the mosaic and inspected the
corresponding property. In any case can you share that file?

In the end, best thing would be to isolate a couple of files and a
request to replicate the issue and send them over (even privately) for
a quick check, but first, give a spin to a 2.5.x nightly.

Regards,
Simone Giannecchini

GeoServer Professional Services from the experts! Visit
http://goo.gl/NWWaa2 for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

On Wed, Jul 9, 2014 at 5:32 PM, Jose Luis Garcia Ramos
<joseluisgraa@anonymised.com> wrote:

That's a good point Ian, I'll try to get time to test this version...

By the way, this is the output of the gdalinfo against one of the tiles that
compound the mosaic:

Driver: GTiff/GeoTIFF
Files: SZ07.tif
Size is 20000, 16000
Coordinate System is:
LOCAL_CS["OSGB 1936 / British National Grid",
    GEOGCS["OSGB 1936",
        DATUM["unknown",
            SPHEROID["unretrievable - using WGS84",6378137,298.257223563],
            TOWGS84[446.448,-125.157,542.06,0.15,0.247,0.842,-20.489]],
        PRIMEM["Greenwich",0],
        UNIT["degree",0.0174532925199433]],
    AUTHORITY["EPSG","27700"],
    UNIT["metre",1]]
Origin = (400000.000000000000000,80000.000000000000000)
Pixel Size = (0.250000000000000,-0.250000000000000)
Metadata:
  AREA_OR_POINT=Area
Image Structure Metadata:
  COMPRESSION=JPEG
  INTERLEAVE=PIXEL
Corner Coordinates:
Upper Left ( 400000.000, 80000.000)
Lower Left ( 400000.000, 76000.000)
Upper Right ( 405000.000, 80000.000)
Lower Right ( 405000.000, 76000.000)
Center ( 402500.000, 78000.000)
Band 1 Block=20000x16 Type=Byte, ColorInterp=Red
  Overviews: 10000x8000, 5000x4000, 2500x2000, 1250x1000, 625x500, 313x250,
157x125
Band 2 Block=20000x16 Type=Byte, ColorInterp=Green
  Overviews: 10000x8000, 5000x4000, 2500x2000, 1250x1000, 625x500, 313x250,
157x125
Band 3 Block=20000x16 Type=Byte, ColorInterp=Blue
  Overviews: 10000x8000, 5000x4000, 2500x2000, 1250x1000, 625x500, 313x250,
157x125

2014-07-09 13:19 GMT+01:00 Ian Turton <ijturton@anonymised.com>:

On 9 July 2014 13:00, Jonathan Moules <jonathanmoules@anonymised.com>
wrote:

Hi Jose,
I believe 2.5.2 is out in a week or so. That should have the fixes in
that resolved my issues, I'd suggest trying that if you're time constrained
and don't wish to test a beta.

Really it's better to test the beta and get fixes in before the release.
Or you can wait 2 months for the next one to come along.

Ian

------------------------------------------------------------------------------
Open source business process management suite built on Java and Eclipse
Turn processes into business applications with Bonita BPM Community Edition
Quickly connect people, data, and systems into organized workflows
Winner of BOSSIE, CODIE, OW2 and Gartner awards
http://p.sf.net/sfu/Bonitasoft
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

10

Hi again,

I have tried with the nightly version and I still face the same problem,
rendering the image mosaic takes much longer than using version 2.4.4

I have checked this properties file and it says heterogeneous=false

Please let me know if you need more details.

Thanks,
Jose

--
View this message in context: http://osgeo-org.1560.x6.nabble.com/Geoserver-2-5-poor-performance-mosaics-tp5150254p5151457.html
Sent from the GeoServer - User mailing list archive at Nabble.com.

11

Ciao Jose,
if you can isolate 2 to 3 samples that higlight the problem and share
them with us (even privately) that would help us replicate and fix the
problem.

In any case, you can set the log to verbose send a request, get the
log and share with us.

Regards,
Simone Giannecchini

GeoServer Professional Services from the experts! Visit
http://goo.gl/NWWaa2 for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

On Thu, Jul 17, 2014 at 12:01 PM, joseluisgraa <joseluisgraa@anonymised.com> wrote:

Hi again,

I have tried with the nightly version and I still face the same problem,
rendering the image mosaic takes much longer than using version 2.4.4

I have checked this properties file and it says heterogeneous=false

Please let me know if you need more details.

Thanks,
Jose

--
View this message in context: http://osgeo-org.1560.x6.nabble.com/Geoserver-2-5-poor-performance-mosaics-tp5150254p5151457.html
Sent from the GeoServer - User mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users