[Geoserver-users] Performance and feasibility using geoserver if map publishing is.s. done using shapefile or oracle spatial database

Hi,

I have a huge amount of Vector data that I would like to serve via
geoserver, data size would be around 300 GB covering an area of 1/5th of the
U.S.
There are around 60-70 odd layers and all this data, I would like to serve
via WMS and there are SLDs to be applied to the layers for roads,point
symbology using SVGs.

Question:
1. I can create shape files(.shp) for this data or put it into oracle
spatial , which one would give better performance if we publish via Oracle
Spatial datastore or publish via Shapefile datastore for all these vector
layer. I understand that shape file has a limitation of 2GB,I will somehow
manage to restrict the size to 2GB or increase the layers.

2. We have around 25-30 concurrent users as well on this and would increase
in future, what would be better(shp or oracle)

3. Do we really need tile caching for these vector layers or we can bypass
it and serve directly from geoserver at all the time if we use shape file?

4. Are there any Oracle connecting/buffering tweaks on Geoserver recomended
for these kind of large datasets.

Kindly suggest.

best Regards
dk

--
View this message in context: http://osgeo-org.1560.n6.nabble.com/Performance-and-feasibility-using-geoserver-if-map-publishing-is-s-done-using-shapefile-or-oracle-spe-tp5035558.html
Sent from the GeoServer - User mailing list archive at Nabble.com.

Hi,

find my 2 cents inline, while waiting for suggestions from more expert guys

and of course look at

http://www.slideshare.net/geosolutions/geoserver-on-steroids

by Andrea Aime and Simone Giannecchini

2013/2/20 dkotian95 <dkotian95@anonymised.com>:

Hi,

I have a huge amount of Vector data that I would like to serve via
geoserver, data size would be around 300 GB covering an area of 1/5th of the
U.S.
There are around 60-70 odd layers and all this data, I would like to serve
via WMS and there are SLDs to be applied to the layers for roads,point
symbology using SVGs.

Question:
1. I can create shape files(.shp) for this data or put it into oracle
spatial , which one would give better performance if we publish via Oracle
Spatial datastore or publish via Shapefile datastore for all these vector
layer. I understand that shape file has a limitation of 2GB,I will somehow
manage to restrict the size to 2GB or increase the layers.

shapefile is usually faster, but if you have to split layers probably
Oracle or PostGIS is a better choice.
By the way spatial option requires Oracle Enterprise edition , that is
big bucks to put on the project budget. Consider using Locator, you
don't need spatial for storing data in SDO_GEOMETRY, or better have a
look at PostGIS.

2. We have around 25-30 concurrent users as well on this and would increase
in future, what would be better(shp or oracle)

3. Do we really need tile caching for these vector layers or we can bypass
it and serve directly from geoserver at all the time if we use shape file?

Using shapefile or Oracle I would use GeoWebCache anyway. The only
reason against caching your data is if they are updated very
frequently.

4. Are there any Oracle connecting/buffering tweaks on Geoserver recomended
for these kind of large datasets.

Kindly suggest.

best Regards
dk

Kind Regards,

Stefano

---------------------------------------------------
41.95581N 12.52854E

http://www.linkedin.com/in/stefanoiacovella

http://twitter.com/#!/Iacovellas

On Wed, Feb 20, 2013 at 5:08 PM, dkotian95 <dkotian95@anonymised.com> wrote:

Hi,

I have a huge amount of Vector data that I would like to serve via
geoserver, data size would be around 300 GB covering an area of 1/5th of the
U.S.
There are around 60-70 odd layers and all this data, I would like to serve
via WMS and there are SLDs to be applied to the layers for roads,point
symbology using SVGs.

Short addendum to what Stefano already said.

Generally speaking, shapefile performance is very good in GeoServer, they are
far superior to spatial databases when you are trying to display all of the data
in a single small map, however they fall short if you ever need a non spatial
index to speed up searches on non spatial attributes, and not an option if
you are trying to do WFS-T editing.

The indexing thing might become important if you do CQL filters to display only
a portion of the data, or if you have styles that display only a subset of the data
based on some logic (e.g., displaying only highways in a road map, when zoomed
out).

Cheers
Andrea

==
Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


Thanks Andrea/Stefano.
Is there any performance benchmark between shape and oracle with geoserver. Can I use geoserver directly with shapefile for data of this size without webcache with around 25-30 concurrent users.

Thanks and Regards
Deepak

On Thu, Feb 21, 2013 at 2:48 PM, Andrea Aime <andrea.aime@anonymised.com> wrote:

On Wed, Feb 20, 2013 at 5:08 PM, dkotian95 <dkotian95@anonymised.com> wrote:

Hi,

I have a huge amount of Vector data that I would like to serve via
geoserver, data size would be around 300 GB covering an area of 1/5th of the
U.S.
There are around 60-70 odd layers and all this data, I would like to serve
via WMS and there are SLDs to be applied to the layers for roads,point
symbology using SVGs.

Short addendum to what Stefano already said.

Generally speaking, shapefile performance is very good in GeoServer, they are
far superior to spatial databases when you are trying to display all of the data
in a single small map, however they fall short if you ever need a non spatial
index to speed up searches on non spatial attributes, and not an option if
you are trying to do WFS-T editing.

The indexing thing might become important if you do CQL filters to display only
a portion of the data, or if you have styles that display only a subset of the data
based on some logic (e.g., displaying only highways in a road map, when zoomed
out).

Cheers
Andrea

==
Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it