[Geoserver-users] Geoserver Production Environment specs

Hi,

What would typically be virtual server specs in terms of RAM and processor speed you would recommend for production environment to serve several applications?

of Layers served totally from this server ~200 - 250

of Layers simultaneously accessed in an application ~10

Data format(vectors only): PostGIS Layers and few shapefiles(max size of each 60MB).

of simultaneous users : Max 5-10.

Also, does one typically serve all the layers from the a BIG server instance or multiple small server instances with small configuration?

I know that this is a very open ended question. Any rough estimate is appreciated.

Thanks,
Ravi.

--static--bg_xmas_mini_1.gif

Hi Ravi,

It really depends on what you expect the load to be on the server. For instance if you only expect the server to be accessed by a handful of users then some pretty modest requirements will probably work. For smaller installations that don’t typically handle much load we typically use a vm with 1-2 G of RAM giving about half of it to geoserver. For larger setups obviously the requirement goes up.

It also matters what type of traffic you will be doing. For instance if you are strictly doing WMS then the more memory the better since for rendering the WMS has to continually allocate large chunks of memory for images. Whereas WFS operates in a strictly streaming fashion.

There is currently an issue as well in that if you have that many layers/feature types you will want to change the “feature type cache settings” (global settings page) to be larger than the number of layers/feature types.

Also it is important to properly configure the server in terms of limits. You should find this article interesting:

http://opengeo.org/publications/geoserver-production/

Hope that helps.

-Justin

On Wed, Jan 5, 2011 at 11:02 AM, Ravi Pavuluri <ravitheja@anonymised.com> wrote:

Hi,

What would typically be virtual server specs in terms of RAM and processor speed you would recommend for production environment to serve several applications?

of Layers served totally from this server ~200 - 250

of Layers simultaneously accessed in an application ~10

Data format(vectors only): PostGIS Layers and few shapefiles(max size of each 60MB).

of simultaneous users : Max 5-10.

Also, does one typically serve all the layers from the a BIG server instance or multiple small server instances with small configuration?

I know that this is a very open ended question. Any rough estimate is appreciated.

Thanks,
Ravi.


Learn how Oracle Real Application Clusters (RAC) One Node allows customers
to consolidate database storage, standardize their database environment, and,
should the need arise, upgrade to a full multi-node Oracle RAC database
without downtime or disruption
http://p.sf.net/sfu/oracle-sfdevnl


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users


Justin Deoliveira
OpenGeo - http://opengeo.org
Enterprise support for open source geospatial.

Hi Justin,

Thank you for the information. I read the link you sent and it was a very good one.

I am looking at both WMS(50%) and WFS(50%) in each application in a tomcat environment with maximum simultaneous users about 5-10.“For smaller installations that don’t typically handle much load we typically use a vm with 1-2 G of RAM giving about half of it to geoserver.” Is this the case you are referring when you have geoserver as a webapp in Tomcat? Tomcat and Geoserver both being java based, consume more RAM and you would still suggest 2GB of RAM with server optimizations? With the above configurations, is 5-6GB RAM with decent processor considered a safe estimate or an overestimate?

Thanks,
Ravi,


From: Justin Deoliveira jdeolive@anonymised.com
To: Ravi Pavuluri ravitheja@anonymised.com
Cc: geoserver-users@lists.sourceforge.net
Sent: Thu, January 6, 2011 11:07:49 AM
Subject: Re: [Geoserver-users] Geoserver Production Environment specs

Hi Ravi,

It really depends on what you expect the load to be on the server. For instance if you only expect the server to be accessed by a handful of users then some pretty modest requirements will probably work. For smaller installations that don’t typically handle much load we typically use a vm with 1-2 G of RAM giving about half of it to geoserver. For larger setups obviously the requirement goes up.

It also matters what type of traffic you will be doing. For instance if you are strictly doing WMS then the more memory the better since for rendering the WMS has to continually allocate large chunks of memory for images. Whereas WFS operates in a strictly streaming fashion.

There is currently an issue as well in that if you have that many layers/feature types you will want to change the “feature type cache settings” (global settings page) to be larger than the number of layers/feature types.

Also it is important to properly configure the server in terms of limits. You should find this article interesting:

http://opengeo.org/publications/geoserver-production/

Hope that helps.

-Justin

On Wed, Jan 5, 2011 at 11:02 AM, Ravi Pavuluri <ravitheja@anonymised.com> wrote:

Hi,

What would typically be virtual server specs in terms of RAM and processor speed you would recommend for production environment to serve several applications?

of Layers served totally from this server ~200 - 250

of Layers simultaneously accessed in an application ~10

Data format(vectors only): PostGIS Layers and few shapefiles(max size of each 60MB).

of simultaneous users : Max 5-10.

Also, does one typically serve all the layers from the a BIG server instance or multiple small server instances with small configuration?

I know that this is a very open ended question. Any rough estimate is appreciated.

Thanks,
Ravi.


Learn how Oracle Real Application Clusters (RAC) One Node allows customers
to consolidate database storage, standardize their database environment, and,
should the need arise, upgrade to a full multi-node Oracle RAC database
without downtime or disruption
http://p.sf.net/sfu/oracle-sfdevnl


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users


Justin Deoliveira
OpenGeo - http://opengeo.org
Enterprise support for open source geospatial.

Hi Ravi,

On Thu, Jan 6, 2011 at 5:52 PM, Ravi Pavuluri <ravitheja@anonymised.com142…> wrote:

Hi Justin,

Thank you for the information. I read the link you sent and it was a very good one.

I am looking at both WMS(50%) and WFS(50%) in each application in a tomcat environment with maximum simultaneous users about 5-10.“For smaller installations that don’t typically handle much load we typically use a vm with 1-2 G of RAM giving about half of it to geoserver.” Is this the case you are referring when you have geoserver as a webapp in Tomcat? Tomcat and

Yes, i am referring to geoserver running in tomcat or some other servlet container. Memory is allocated to the servlet container.

Geoserver both being java based, consume more RAM and you would still suggest 2GB of RAM with server optimizations?

Yes, but again it depends. The more memory you allocate the more requests you can handle which improves overall availability of your app. So in the end its a trade off and you have to find the balance.

With the above configurations, is 5-6GB RAM with decent processor considered a safe estimate or an overestimate?

In most production systems I see that do a lot of traffic I usually don’t see more than 4G allocated to java/tomcat/geoserver. And even that is a bit excessive. With heap sizes that large you start to pay a big price for garbage collection.

I would say with your requirements allocating 2G of ram to java should be more than enough if the server is “properly configured”. By properly configured I mean both the services (using control flow, wms limits, etc…) and the data (spatial indexes, attribute indexes based on your SLD styles, etc…)

Thanks,
Ravi,


From: Justin Deoliveira <jdeolive@anonymised.com671…>
To: Ravi Pavuluri <ravitheja@anonymised.com>
Cc: geoserver-users@anonymised.comurceforge.net
Sent: Thu, January 6, 2011 11:07:49 AM
Subject: Re: [Geoserver-users] Geoserver Production Environment specs

Hi Ravi,

It really depends on what you expect the load to be on the server. For instance if you only expect the server to be accessed by a handful of users then some pretty modest requirements will probably work. For smaller installations that don’t typically handle much load we typically use a vm with 1-2 G of RAM giving about half of it to geoserver. For larger setups obviously the requirement goes up.

It also matters what type of traffic you will be doing. For instance if you are strictly doing WMS then the more memory the better since for rendering the WMS has to continually allocate large chunks of memory for images. Whereas WFS operates in a strictly streaming fashion.

There is currently an issue as well in that if you have that many layers/feature types you will want to change the “feature type cache settings” (global settings page) to be larger than the number of layers/feature types.

Also it is important to properly configure the server in terms of limits. You should find this article interesting:

http://opengeo.org/publications/geoserver-production/

Hope that helps.

-Justin

On Wed, Jan 5, 2011 at 11:02 AM, Ravi Pavuluri <ravitheja@anonymised.com> wrote:

Hi,

What would typically be virtual server specs in terms of RAM and processor speed you would recommend for production environment to serve several applications?

of Layers served totally from this server ~200 - 250

of Layers simultaneously accessed in an application ~10

Data format(vectors only): PostGIS Layers and few shapefiles(max size of each 60MB).

of simultaneous users : Max 5-10.

Also, does one typically serve all the layers from the a BIG server instance or multiple small server instances with small configuration?

I know that this is a very open ended question. Any rough estimate is appreciated.

Thanks,
Ravi.


Learn how Oracle Real Application Clusters (RAC) One Node allows customers
to consolidate database storage, standardize their database environment, and,
should the need arise, upgrade to a full multi-node Oracle RAC database
without downtime or disruption
http://p.sf.net/sfu/oracle-sfdevnl


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users


Justin Deoliveira
OpenGeo - http://opengeo.org
Enterprise support for open source geospatial.


Justin Deoliveira
OpenGeo - http://opengeo.org
Enterprise support for open source geospatial.

On Fri, Jan 7, 2011 at 1:52 AM, Ravi Pavuluri <ravitheja@anonymised.com…3142…> wrote:

Hi Justin,

Thank you for the information. I read the link you sent and it was a very good one.

I am looking at both WMS(50%) and WFS(50%) in each application in a tomcat environment with maximum simultaneous users about 5-10.“For smaller installations that don’t typically handle much load we typically use a vm with 1-2 G of RAM giving about half of it to geoserver.” Is this the case you are referring when you have geoserver as a webapp in Tomcat? Tomcat and Geoserver both being java based, consume more RAM and you would still suggest 2GB of RAM with server optimizations? With the above configurations, is 5-6GB RAM with decent processor considered a safe estimate or an overestimate?

During FOSS4G 2010 WMS shootout, with a single server having 8GB of memory, GeoServer was allocated 2GB of memory with tops 64 concurrent users.
Giving it less or more resulted in measurable slowdowns (this includes both GeoServer and Tomcat, as they are running inside the same JVM).

Cheers
Andrea


Ing. Andrea Aime
Senior Software Engineer

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy

phone: +39 0584962313
fax: +39 0584962313

http://www.geo-solutions.it
http://geo-solutions.blogspot.com/
http://www.linkedin.com/in/andreaaime
http://twitter.com/geowolf


Andrea and Justin,

Thank you for sharing your experiences on production environment. I think Andrea’s information would provide an high upper limit for my case and Justin’s information would be a good estimate to start with.

Thanks again,
Ravi.


From: Andrea Aime andrea.aime@anonymised.com
To: Ravi Pavuluri ravitheja@anonymised.com
Cc: Justin Deoliveira jdeolive@anonymised.com; geoserver-users@lists.sourceforge.net
Sent: Fri, January 7, 2011 2:40:52 AM
Subject: Re: [Geoserver-users] Geoserver Production Environment specs

On Fri, Jan 7, 2011 at 1:52 AM, Ravi Pavuluri <ravitheja@anonymised.com> wrote:

Hi Justin,

Thank you for the information. I read the link you sent and it was a very good one.

I am looking at both WMS(50%) and WFS(50%) in each application in a tomcat environment with maximum simultaneous users about 5-10.“For smaller installations that don’t typically handle much load we typically use a vm with 1-2 G of RAM giving about half of it to geoserver.” Is this the case you are referring when you have geoserver as a webapp in Tomcat? Tomcat and Geoserver both being java based, consume more RAM and you would still suggest 2GB of RAM with server optimizations? With the above configurations, is 5-6GB RAM with decent processor considered a safe estimate or an overestimate?

During FOSS4G 2010 WMS shootout, with a single server having 8GB of memory, GeoServer was allocated 2GB of memory with tops 64 concurrent users.
Giving it less or more resulted in measurable slowdowns (this includes both GeoServer and Tomcat, as they are running inside the same JVM).

Cheers
Andrea


Ing. Andrea Aime
Senior Software Engineer

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy

phone: +39 0584962313
fax: +39 0584962313

http://www.geo-solutions.it
http://geo-solutions.blogspot.com/
http://www.linkedin.com/in/andreaaime
http://twitter.com/geowolf