[Geoserver-users] Coverage (Mosaic-Pyramid)

GeoServer GeoServer User
1

Hi,

I get large image of 4Gb from ENVI (with 3 bands informations), exported as
one .tiff and one .tfw

1. I create a coverage Store as "referenced image with spatial file", style
"RASTER" and i get a WMS but it display it as black image. However, whene i
click on the black image, the WFS module give me the value of the three RGV
component... so why it doesn't display the image ?
i'll try rgb2pct maybe ?

2. Anyway, the image is to fat and it's too slow..
So i would like to pyramid or mosaic it.
I installed "image pyramid" plugin but i don't know how to build an image
pyramid from my tiff.. i tried to install geotools to use pyramidbuilder
class but i d'ont find this class in the sources.
So i try to use Gdal or something but i'm a bit lost..

so do you have a solution to pyramid and mosaic a fat image (with gdal for
example) and put it in geoserver to get a WMS quite fast..
i would need the steps i have to do (gdalindex, gdaltranslate ? i don't
know)

thks

Flo
--
View this message in context: http://www.nabble.com/Coverage-(Mosaic-Pyramid)-tp19403106p19403106.html
Sent from the GeoServer - User mailing list archive at Nabble.com.

2

Hi Flo,

Yeah you definitely want to convert to geotiff with gdal and build overviews and tiles. Here are some docs that should give you the necessary info:

http://geoserver.org/display/GEOSDOC/Creating+a+coverage+from+a+TIFF+with+world+file+(tfw)
http://geoserver.org/display/GEOSDOC/High+performance+coverage+serving

-Justin

floflo wrote:

Hi,

I get large image of 4Gb from ENVI (with 3 bands informations), exported as
one .tiff and one .tfw

1. I create a coverage Store as "referenced image with spatial file", style
"RASTER" and i get a WMS but it display it as black image. However, whene i
click on the black image, the WFS module give me the value of the three RGV
component... so why it doesn't display the image ?
i'll try rgb2pct maybe ?

2. Anyway, the image is to fat and it's too slow..
So i would like to pyramid or mosaic it.
I installed "image pyramid" plugin but i don't know how to build an image
pyramid from my tiff.. i tried to install geotools to use pyramidbuilder
class but i d'ont find this class in the sources.
So i try to use Gdal or something but i'm a bit lost..

so do you have a solution to pyramid and mosaic a fat image (with gdal for
example) and put it in geoserver to get a WMS quite fast.. i would need the steps i have to do (gdalindex, gdaltranslate ? i don't
know)

thks

Flo

--
Justin Deoliveira
Software Engineer, OpenGeo
http://opengeo.org

3

Ciao Flo,
please read below…

On Wed, Sep 10, 2008 at 1:05 AM, floflo <florent.gravin@anonymised.com> wrote:

Hi,

I get large image of 4Gb from ENVI (with 3 bands informations), exported as
one .tiff and one .tfw

What about projection information? The (in)famous prj file ?

  1. I create a coverage Store as “referenced image with spatial file”, style
    “RASTER” and i get a WMS but it display it as black image. However, whene i
    click on the black image, the WFS module give me the value of the three RGV
    component… so why it doesn’t display the image ?
    i’ll try rgb2pct maybe ?

I would need some more info in order to help you out. Can you run a gdalinfo on the specific geotiff file?

  1. Anyway, the image is to fat and it’s too slow…
    So i would like to pyramid or mosaic it.
    I installed “image pyramid” plugin but i don’t know how to build an image
    pyramid from my tiff… i tried to install geotools to use pyramidbuilder
    class but i d’ont find this class in the sources.
    So i try to use Gdal or something but i’m a bit lost…

The shortest path would be using the OverviewEmbedder from the coveragetools, but even with gdaladdo things should be easy.
I would recommend you to install fwtools so that yo have all the nice gdal utilities available. I can then tell you how to prepare your raster data.

so do you have a solution to pyramid and mosaic a fat image (with gdal for
example) and put it in geoserver to get a WMS quite fast…
i would need the steps i have to do (gdalindex, gdaltranslate ? i don’t
know)

As I said above, first of all install fwtools for your platform and copy and paste a simple gdalinfo on your geotiff then I’ll guide you through preprocessing your geotiff.

Ciao,
Simone.

thks

Flo

View this message in context: http://www.nabble.com/Coverage-%28Mosaic-Pyramid%29-tp19403106p19403106.html
Sent from the GeoServer - User mailing list archive at Nabble.com.

This SF.Net email is sponsored by the Moblin Your Move Developer’s challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/

Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

–

Eng. Simone Giannecchini
GeoSolutions S.A.S.
Owner - Software Engineer
Via Carignoni 51
55041 Camaiore (LU)
Italy

phone: +39 0584983027
fax: +39 0584983027
mob: +39 333 8128928

http://www.geo-solutions.it
http://www.geo-solutions.it/simone.giannecchini

4

Hi,

Just a short note: because this tiff file is already 4 GB in size and thus close to the maximum, then gdaladdo must be run with -ro option so that an external overview image is created. But are external overviews supported by Geoserver?

-Jukka Rahkonen-

-----Alkuperäinen viesti-----
Lähettäjä: geoserver-users-bounces@lists.sourceforge.net puolesta: Simone Giannecchini
Lähetetty: pe 12.9.2008 21:12
Vastaanottaja: floflo
Kopio: geoserver-users@lists.sourceforge.net
Aihe: Re: [Geoserver-users] Coverage (Mosaic-Pyramid)

Ciao Flo,
please read below...

On Wed, Sep 10, 2008 at 1:05 AM, floflo <florent.gravin@anonymised.com> wrote:

Hi,

I get large image of 4Gb from ENVI (with 3 bands informations), exported as
one .tiff and one .tfw

What about projection information? The (in)famous prj file ?

1. I create a coverage Store as "referenced image with spatial file", style
"RASTER" and i get a WMS but it display it as black image. However, whene i
click on the black image, the WFS module give me the value of the three RGV
component... so why it doesn't display the image ?
i'll try rgb2pct maybe ?

I would need some more info in order to help you out. Can you run a gdalinfo
on the specific geotiff file?

2. Anyway, the image is to fat and it's too slow..
So i would like to pyramid or mosaic it.
I installed "image pyramid" plugin but i don't know how to build an image
pyramid from my tiff.. i tried to install geotools to use pyramidbuilder
class but i d'ont find this class in the sources.
So i try to use Gdal or something but i'm a bit lost..

The shortest path would be using the OverviewEmbedder from the
coveragetools, but even with gdaladdo things should be easy.
I would recommend you to install fwtools so that yo have all the nice gdal
utilities available. I can then tell you how to prepare your raster data.

so do you have a solution to pyramid and mosaic a fat image (with gdal for
example) and put it in geoserver to get a WMS quite fast..
i would need the steps i have to do (gdalindex, gdaltranslate ? i don't
know)

As I said above, first of all install fwtools for your platform and copy and
paste a simple gdalinfo on your geotiff then I'll guide you through
preprocessing your geotiff.

Ciao,
Simone.

thks

Flo
--
View this message in context:
http://www.nabble.com/Coverage-(Mosaic-Pyramid)-tp19403106p19403106.html
Sent from the GeoServer - User mailing list archive at Nabble.com.

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's
challenge
Build the coolest Linux based applications with Moblin SDK & win great
prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

--
-------------------------------------------------------
Eng. Simone Giannecchini
GeoSolutions S.A.S.
Owner - Software Engineer
Via Carignoni 51
55041 Camaiore (LU)
Italy

phone: +39 0584983027
fax: +39 0584983027
mob: +39 333 8128928

http://www.geo-solutions.it
http://www.geo-solutions.it/simone.giannecchini

-------------------------------------------------------

5

Rahkonen Jukka ha scritto:

Hi,

Just a short note: because this tiff file is already 4 GB in size and
thus close to the maximum, then gdaladdo must be run with -ro option
so that an external overview image is created. But are external
overviews supported by Geoserver?

Nope, they are not. Is the format of these external overviews
documented anywhere?
When data reaches that size you can also split it into tiles,
build overviews in each tile, and make up a mosaic of them.

Cheers
Andrea

6

Rahkonen Jukka ha scritto:

Hi,

Just a short note: because this tiff file is already 4 GB in size and
thus close to the maximum, then gdaladdo must be run with -ro option
so that an external overview image is created. But are external
overviews supported by Geoserver?

Nope, they are not. Is the format of these external overviews
documented anywhere?
When data reaches that size you can also split it into tiles,
build overviews in each tile, and make up a mosaic of them.

In gdal they are geotiffs by dafault, named as original_file.ovr, or of ERDAS Imagine aux format. See http://gdal.org/gdaladdo.html
WMS almost supports external overviews by itself. You get the desired result by ordering the original image and overview image under same GROUP and playing with min/max scales. But WMS is advertising both GROUP and individual layers and user can select them as well. Sometimes it might be useful if Geoserver could be tweaked to hide group members and list only groups for users. Or is it possible somehow already?

-Jukka-

7

Rahkonen Jukka ha scritto:

Rahkonen Jukka ha scritto:

Hi,

Just a short note: because this tiff file is already 4 GB in size and
thus close to the maximum, then gdaladdo must be run with -ro option
so that an external overview image is created. But are external
overviews supported by Geoserver?

Nope, they are not. Is the format of these external overviews
documented anywhere?
When data reaches that size you can also split it into tiles,
build overviews in each tile, and make up a mosaic of them.

In gdal they are geotiffs by dafault, named as original_file.ovr, or of ERDAS Imagine aux format. See http://gdal.org/gdaladdo.html
WMS almost supports external overviews by itself. You get the desired result by ordering the original image and overview image under same GROUP and playing with min/max scales. But WMS is advertising both GROUP and individual layers and user can select them as well. Sometimes it might be useful if Geoserver could be tweaked to hide group members and list only groups for users. Or is it possible somehow already?

Nope, it's not. In the future we are working on having the idea of
separating configuration and publishing, publishing would be managed
as a set of "maps", that is, named virtual ogc servers, in which
you decide what to publish and how. The current easy way to just
configure and go will be retained by having a "default" map that
grabs automatically every configured layer, but you'll be able to
hide it (either by using the security subsystem, or by using some
UI config).

Cheers
Andrea

8

Ops,
You are right Jukka, I did not think about the 4 gb limitation (probably because I am trying to bend iamgeio to support bigtff :slight_smile: ).

When the 4gb boundary is crossed, the best thing to do is to split the raster in a few big tiles (like 4) and add overviews to them separatly then mosaic together again. It is quite straightforward.

As of the external overviews (at least the geotiff ones), I have never thought about supporting that, it would not be too difficult, I might give that a try these days.

Ciao,
Simone.

On Fri, Sep 12, 2008 at 8:50 PM, Rahkonen Jukka <Jukka.Rahkonen@anonymised.com> wrote:

Hi,

Just a short note: because this tiff file is already 4 GB in size and thus close to the maximum, then gdaladdo must be run with -ro option so that an external overview image is created. But are external overviews supported by Geoserver?

-Jukka Rahkonen-

-----Alkuperäinen viesti-----
Lähettäjä: geoserver-users-bounces@lists.sourceforge.net puolesta: Simone Giannecchini
Lähetetty: pe 12.9.2008 21:12
Vastaanottaja: floflo
Kopio: geoserver-users@lists.sourceforge.net
Aihe: Re: [Geoserver-users] Coverage (Mosaic-Pyramid)

Ciao Flo,
please read below…

On Wed, Sep 10, 2008 at 1:05 AM, floflo <florent.gravin@anonymised.com> wrote:

Hi,

I get large image of 4Gb from ENVI (with 3 bands informations), exported as
one .tiff and one .tfw

What about projection information? The (in)famous prj file ?

  1. I create a coverage Store as “referenced image with spatial file”, style
    “RASTER” and i get a WMS but it display it as black image. However, whene i
    click on the black image, the WFS module give me the value of the three RGV
    component… so why it doesn’t display the image ?
    i’ll try rgb2pct maybe ?

I would need some more info in order to help you out. Can you run a gdalinfo
on the specific geotiff file?

  1. Anyway, the image is to fat and it’s too slow…
    So i would like to pyramid or mosaic it.
    I installed “image pyramid” plugin but i don’t know how to build an image
    pyramid from my tiff… i tried to install geotools to use pyramidbuilder
    class but i d’ont find this class in the sources.
    So i try to use Gdal or something but i’m a bit lost…

The shortest path would be using the OverviewEmbedder from the
coveragetools, but even with gdaladdo things should be easy.
I would recommend you to install fwtools so that yo have all the nice gdal
utilities available. I can then tell you how to prepare your raster data.

so do you have a solution to pyramid and mosaic a fat image (with gdal for
example) and put it in geoserver to get a WMS quite fast…
i would need the steps i have to do (gdalindex, gdaltranslate ? i don’t
know)

As I said above, first of all install fwtools for your platform and copy and
paste a simple gdalinfo on your geotiff then I’ll guide you through
preprocessing your geotiff.

Ciao,
Simone.

thks

Flo

View this message in context:
http://www.nabble.com/Coverage-%28Mosaic-Pyramid%29-tp19403106p19403106.html
Sent from the GeoServer - User mailing list archive at Nabble.com.

This SF.Net email is sponsored by the Moblin Your Move Developer’s
challenge
Build the coolest Linux based applications with Moblin SDK & win great
prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/

Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

–

Eng. Simone Giannecchini
GeoSolutions S.A.S.
Owner - Software Engineer
Via Carignoni 51
55041 Camaiore (LU)
Italy

phone: +39 0584983027
fax: +39 0584983027
mob: +39 333 8128928

http://www.geo-solutions.it
http://www.geo-solutions.it/simone.giannecchini

This SF.Net email is sponsored by the Moblin Your Move Developer’s challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/

Geoserver-users mailing list
Geoserver-users@anonymised.comsts.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

–

Eng. Simone Giannecchini
GeoSolutions S.A.S.
Owner - Software Engineer
Via Carignoni 51
55041 Camaiore (LU)
Italy

phone: +39 0584983027
fax: +39 0584983027
mob: +39 333 8128928

http://www.geo-solutions.it
http://www.geo-solutions.it/simone.giannecchini

9

Hi,

my image from ENVI had a bad format, if we export it as TIFF 24 bits it
works.
These are the informations about my image :

Driver: GTiff/GeoTIFF
Files: CN_sharpen_par1_con_24bit.tif
Size is 12009, 12009
Coordinate System is:
GEOGCS["WGS 84",
    DATUM["WGS_1984",
        SPHEROID["WGS 84",6378137,298.2572235630016,
            AUTHORITY["EPSG","7030"]],
        AUTHORITY["EPSG","6326"]],
    PRIMEM["Greenwich",0],
    UNIT["degree",0.0174532925199433],
    AUTHORITY["EPSG","4326"]]
Origin = (165.861807440000010,-21.411136070000001)
Pixel Size = (0.000005995638191,-0.000005609602378)
Metadata:
  AREA_OR_POINT=Area
  TIFFTAG_XRESOLUTION=1
  TIFFTAG_YRESOLUTION=1
Image Structure Metadata:
  INTERLEAVE=BAND
Corner Coordinates:
Upper Left ( 165.8618074, -21.4111361) (165d51'42.51"E, 21d24'40.09"S)
Lower Left ( 165.8618074, -21.4785018) (165d51'42.51"E, 21d28'42.61"S)
Upper Right ( 165.9338091, -21.4111361) (165d56'1.71"E, 21d24'40.09"S)
Lower Right ( 165.9338091, -21.4785018) (165d56'1.71"E, 21d28'42.61"S)
Center ( 165.8978082, -21.4448189) (165d53'52.11"E, 21d26'41.35"S)
Band 1 Block=12009x1 Type=Byte, ColorInterp=Red
Band 2 Block=12009x1 Type=Byte, ColorInterp=Green
Band 3 Block=12009x1 Type=Byte, ColorInterp=Blue

my image is now only 400 Mo, still in .tif and .twf (no .prj)
this image is displayed as WMS in geoserver

but it's still to slow..

we tryed to use gdal2tiles (pyramid & tiles), result looks correct, very
fast with the sample generated for googlemap library, but it doesn't work
with the sample generated (by gdal) for openlayers, which is the library i
need !

also, how can we put the result of gdal2tiles into geoserver as WMS ?

then we tried also gdal_retile, looks also fin but we cannot import it as
MosaciPlugin into geoserver...
we tried gdaladdo and gdal_translate to get a .tiff..

so actually we haven't any result to display this image in Openlayers via
geoserver with acceptable performances...

thks if you could help to how prepare the image properly with gdal

Florent

--
View this message in context: http://www.nabble.com/Coverage-(Mosaic-Pyramid)-tp19403106p19506324.html
Sent from the GeoServer - User mailing list archive at Nabble.com.