[Geoserver-users] Huge database -> long startup time

GeoServer GeoServer User
1

Hi all,
I'm managing a huge database of georeferenced rasters, and everytime I
startup my GeoServer I must wait for all these layers to be loaded.
Is there a way to avoid this?

Thank you for reading.
Cheers,
Piero
--
View this message in context: http://old.nabble.com/Huge-database-->-long-startup-time-tp30143606p30143606.html
Sent from the GeoServer - User mailing list archive at Nabble.com.

2

On Fri, Nov 5, 2010 at 6:54 PM, Piero Campa <piero.campa@anonymised.com> wrote:

Hi all,
I'm managing a huge database of georeferenced rasters, and everytime I
startup my GeoServer I must wait for all these layers to be loaded.
Is there a way to avoid this?

To clarify, how many layers are you publishing with geoserver?
(mind, I said layers, not records in a table, not tiles in a mosaic)

Cheers
Andrea

-----------------------------------------------------
Ing. Andrea Aime
Senior Software Engineer

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy

phone: +39 0584962313
fax: +39 0584962313

http://www.geo-solutions.it
http://geo-solutions.blogspot.com/
http://www.linkedin.com/in/andreaaime
http://twitter.com/geowolf

-----------------------------------------------------

3

They’re about 20’000 GeoTiffs: I take several minutes to startup.

On 5 November 2010 22:48, Andrea Aime <andrea.aime@anonymised.com> wrote:

On Fri, Nov 5, 2010 at 6:54 PM, Piero Campa <piero.campa@anonymised.com> wrote:

Hi all,
I’m managing a huge database of georeferenced rasters, and everytime I
startup my GeoServer I must wait for all these layers to be loaded.
Is there a way to avoid this?

To clarify, how many layers are you publishing with geoserver?
(mind, I said layers, not records in a table, not tiles in a mosaic)

Cheers
Andrea

Ing. Andrea Aime
Senior Software Engineer

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy

phone: +39 0584962313
fax: +39 0584962313

http://www.geo-solutions.it
http://geo-solutions.blogspot.com/
http://www.linkedin.com/in/andreaaime
http://twitter.com/geowolf

4

On Sat, Nov 6, 2010 at 3:27 PM, Piero Campalani <piero.campa@anonymised.com> wrote:

They're about 20'000 GeoTiffs: I take several minutes to startup.

Yeah, there is not much to do about it at the moment, we have an improvement
request in jira (that I cannot find right now) about this but not a patch.

Wondering about the 20000 tiffs.... are they completely unrelated to each other?
Or are the part of the same large image? Wondering if the mosaic
module could be used to reduce the number of layers

Cheers
Andrea

-----------------------------------------------------
Ing. Andrea Aime
Senior Software Engineer

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy

phone: +39 0584962313
fax: +39 0584962313

http://www.geo-solutions.it
http://geo-solutions.blogspot.com/
http://www.linkedin.com/in/andreaaime
http://twitter.com/geowolf

-----------------------------------------------------

5

Well yes, they could be grouped into Layer Groups of 5 layers: each one describing a different feature over the same geographic area.

Are you meaning to create Layer Groups or Mosaics?
I’d want to be able to see the layers separately.

Cheers,
Piero

On 6 November 2010 18:22, Andrea Aime <andrea.aime@anonymised.com> wrote:

On Sat, Nov 6, 2010 at 3:27 PM, Piero Campalani <piero.campa@anonymised.com> wrote:

They’re about 20’000 GeoTiffs: I take several minutes to startup.

Yeah, there is not much to do about it at the moment, we have an improvement
request in jira (that I cannot find right now) about this but not a patch.

Wondering about the 20000 tiffs… are they completely unrelated to each other?
Or are the part of the same large image? Wondering if the mosaic
module could be used to reduce the number of layers

Cheers
Andrea

Ing. Andrea Aime
Senior Software Engineer

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy

phone: +39 0584962313
fax: +39 0584962313

http://www.geo-solutions.it
http://geo-solutions.blogspot.com/
http://www.linkedin.com/in/andreaaime
http://twitter.com/geowolf

6

I think andrea is talking about mosaics.
You can reduce the number of layers by mosaicking individual raster
that are compatible:

- same number of bands and data type
- same crs
- compatible list of resolutions for overviews

Simone.
-------------------------------------------------------

Notice that our office phone number has recently changed!
Please, update your records!

Ing. Simone Giannecchini
GeoSolutions S.A.S.
Founder
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy

phone: +39 0584962313
fax: +39 0584962313
mob: +39 333 8128928

http://www.geo-solutions.it
http://geo-solutions.blogspot.com/
http://www.linkedin.com/in/simonegiannecchini
http://twitter.com/simogeo

-------------------------------------------------------

On Mon, Nov 8, 2010 at 2:51 PM, Piero Campalani <piero.campa@anonymised.com> wrote:

Well yes, they could be grouped into Layer Groups of 5 layers: each one
describing a different feature over the same geographic area.

Are you meaning to create Layer Groups or Mosaics?
I'd want to be able to see the layers separately.

Cheers,
Piero

On 6 November 2010 18:22, Andrea Aime <andrea.aime@anonymised.com> wrote:

On Sat, Nov 6, 2010 at 3:27 PM, Piero Campalani <piero.campa@anonymised.com>
wrote:
> They're about 20'000 GeoTiffs: I take several minutes to startup.

Yeah, there is not much to do about it at the moment, we have an
improvement
request in jira (that I cannot find right now) about this but not a patch.

Wondering about the 20000 tiffs.... are they completely unrelated to each
other?
Or are the part of the same large image? Wondering if the mosaic
module could be used to reduce the number of layers

Cheers
Andrea

-----------------------------------------------------
Ing. Andrea Aime
Senior Software Engineer

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy

phone: +39 0584962313
fax: +39 0584962313

http://www.geo-solutions.it
http://geo-solutions.blogspot.com/
http://www.linkedin.com/in/andreaaime
http://twitter.com/geowolf

-----------------------------------------------------

------------------------------------------------------------------------------
The Next 800 Companies to Lead America's Growth: New Video Whitepaper
David G. Thomson, author of the best-selling book "Blueprint to a
Billion" shares his insights and actions to help propel your
business during the next growth cycle. Listen Now!
http://p.sf.net/sfu/SAP-dev2dev
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

7

Thank you very much, I will create mosaic 'granules' hence.

Would you mind suggesting me which is the correct procedure to manage
mosaics via REST?
I'm making some test but without success.

Cheers,
Piero

Simone Giannecchini wrote:

I think andrea is talking about mosaics.
You can reduce the number of layers by mosaicking individual raster
that are compatible:

- same number of bands and data type
- same crs
- compatible list of resolutions for overviews

Simone.
-------------------------------------------------------

Notice that our office phone number has recently changed!
Please, update your records!

Ing. Simone Giannecchini
GeoSolutions S.A.S.
Founder
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy

phone: +39 0584962313
fax: +39 0584962313
mob: +39 333 8128928

http://www.geo-solutions.it
http://geo-solutions.blogspot.com/
http://www.linkedin.com/in/simonegiannecchini
http://twitter.com/simogeo

-------------------------------------------------------

On Mon, Nov 8, 2010 at 2:51 PM, Piero Campalani <piero.campa@anonymised.com>
wrote:

Well yes, they could be grouped into Layer Groups of 5 layers: each one
describing a different feature over the same geographic area.

Are you meaning to create Layer Groups or Mosaics?
I'd want to be able to see the layers separately.

Cheers,
Piero

On 6 November 2010 18:22, Andrea Aime <andrea.aime@anonymised.com>
wrote:

On Sat, Nov 6, 2010 at 3:27 PM, Piero Campalani <piero.campa@anonymised.com>
wrote:
> They're about 20'000 GeoTiffs: I take several minutes to startup.

Yeah, there is not much to do about it at the moment, we have an
improvement
request in jira (that I cannot find right now) about this but not a
patch.

Wondering about the 20000 tiffs.... are they completely unrelated to
each
other?
Or are the part of the same large image? Wondering if the mosaic
module could be used to reduce the number of layers

Cheers
Andrea

-----------------------------------------------------
Ing. Andrea Aime
Senior Software Engineer

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy

phone: +39 0584962313
fax: +39 0584962313

http://www.geo-solutions.it
http://geo-solutions.blogspot.com/
http://www.linkedin.com/in/andreaaime
http://twitter.com/geowolf

-----------------------------------------------------

------------------------------------------------------------------------------
The Next 800 Companies to Lead America's Growth: New Video Whitepaper
David G. Thomson, author of the best-selling book "Blueprint to a
Billion" shares his insights and actions to help propel your
business during the next growth cycle. Listen Now!
http://p.sf.net/sfu/SAP-dev2dev
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

------------------------------------------------------------------------------
The Next 800 Companies to Lead America's Growth: New Video Whitepaper
David G. Thomson, author of the best-selling book "Blueprint to a
Billion" shares his insights and actions to help propel your
business during the next growth cycle. Listen Now!
http://p.sf.net/sfu/SAP-dev2dev
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

--
View this message in context: http://old.nabble.com/Huge-database-->-long-startup-time-tp30143606p30182210.html
Sent from the GeoServer - User mailing list archive at Nabble.com.