[Geoserver-users] OS Mastermap in Production 1000's of users

GeoServer GeoServer User
1

Hi All,

We are developing a map application which is aiming to serve 1000's of users
Ordnance Survey Master Map data at various scales.
We have scaled our geoserver solution to provide the following:

24 instances of geoserver running 4 instances on 6 VMs
8x 2.7 CPUs
64GB RAM each

2 instances of Geowebcache - 128GB RAM available on each
GWC serves pre-built cache at levels 0-10 (1:2m - 1:3100) on British
national Grid.
(Level 10 consists of approx 8 million tiles)
Any further levels are cached dynamically
As it is OS Mastermap we are required to update our data every 6 weeks hence
a full recache at that time.

We have an Oracle Node with 12 cores serving our GeoServers as well as a
number of other applications. Nonetheless OSMM requests are responsible for
the majority of CPU usage.

We are using spatial partitions, up to date statistics as well as
appropriate columns indexing for the WMS queries to take place.

We request tiles on 256x256 pixels - it has been suggested by our DBAs to
increase this request size - does anybody agree/disagree with this? I would
just expect this increases the size of the request and increase rendering
time. OSMM is quite a complex SLD though is still rather performant.

Has anybody had experience with full national coverage of OSMM on Oracle?
Did you encounter performance issues at high user load? Did you do anything
to rectify the solution or was it a matter of hardware required to deal with
the demand?

Any insights appreciated, happy to answer any further questions.

Regards

--
View this message in context: http://osgeo-org.1560.x6.nabble.com/OS-Mastermap-in-Production-1000-s-of-users-tp5213560.html
Sent from the GeoServer - User mailing list archive at Nabble.com.

2

Hi Gavin

Only comment I can add is regarding the use of oracle to store your spatial data.

I serve up mastermap data for the Merseyside area . I had a lot of complaints from my users about the speed of the maps loading

I had all the mastermap data in an oracle 11 database. I switched to Postgis and the map tile loading time decreased significantly

Feedback from my users was that the maps loaded "instantly" after the change.

Mark Ismail

-----Original Message-----
From: gavin.montgomery [mailto:gavin.montgomery@anonymised.com]
Sent: 30 June 2015 11:53
To: geoserver-users@lists.sourceforge.net
Subject: [Geoserver-users] OS Mastermap in Production 1000's of users

Hi All,

We are developing a map application which is aiming to serve 1000's of users Ordnance Survey Master Map data at various scales.
We have scaled our geoserver solution to provide the following:

24 instances of geoserver running 4 instances on 6 VMs 8x 2.7 CPUs 64GB RAM each

2 instances of Geowebcache - 128GB RAM available on each GWC serves pre-built cache at levels 0-10 (1:2m - 1:3100) on British national Grid.
(Level 10 consists of approx 8 million tiles) Any further levels are cached dynamically As it is OS Mastermap we are required to update our data every 6 weeks hence a full recache at that time.

We have an Oracle Node with 12 cores serving our GeoServers as well as a number of other applications. Nonetheless OSMM requests are responsible for the majority of CPU usage.

We are using spatial partitions, up to date statistics as well as appropriate columns indexing for the WMS queries to take place.

We request tiles on 256x256 pixels - it has been suggested by our DBAs to increase this request size - does anybody agree/disagree with this? I would just expect this increases the size of the request and increase rendering time. OSMM is quite a complex SLD though is still rather performant.

Has anybody had experience with full national coverage of OSMM on Oracle?
Did you encounter performance issues at high user load? Did you do anything to rectify the solution or was it a matter of hardware required to deal with the demand?

Any insights appreciated, happy to answer any further questions.

Regards

--
View this message in context: http://osgeo-org.1560.x6.nabble.com/OS-Mastermap-in-Production-1000-s-of-users-tp5213560.html
Sent from the GeoServer - User mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Don't Limit Your Business. Reach for the Cloud.
GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business.
Configured For All Businesses. Start Your Cloud Today.
https://www.gigenetcloud.com/
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users
This e-mail and any attachments are confidential. It may contain privileged information and is intended for the named recipient(s) only. It must not be distributed without consent. If you are not one of the intended recipients, please notify the sender immediately and do not disclose, distribute, or retain this email or any part of it and do not take any action based on it.

Unless expressly stated, opinions in this email are those of the individual sender, and not of Knowsley MBC. Legally binding obligations can only be created for, or be entered into on behalf of, Knowsley MBC by duly authorised officers or representatives.

Knowsley MBC excludes any liability whatsoever for any offence caused, any direct or consequential loss arising from the use, or reliance on, this e-mail or its contents. We believe but do not warrant that this e-mail and any attachments are virus free. You must therefore take full responsibility for virus checking and no responsibility is accepted for loss or damage arising from viruses or changes made to this message after it was sent. Knowsley MBC reserves the right to monitor and/or record all e-mail communications through its network in accordance with relevant legislation.

3

You might also want to only rebuild the tiles where there is an actual change - I assume you are using the change only updates?
The math to decide which tiles to invalidate is quite easy - I used to have a script but the client kept them internal so I can’t share I’m afraid.

And I second Mark’s comment - dump oracle for PostGIS as soon as you can.

Ian

On Tue, Jun 30, 2015 at 12:08 PM Ismail, Mark <mark.ismail@anonymised.com> wrote:

Hi Gavin

Only comment I can add is regarding the use of oracle to store your spatial data.

I serve up mastermap data for the Merseyside area . I had a lot of complaints from my users about the speed of the maps loading

I had all the mastermap data in an oracle 11 database. I switched to Postgis and the map tile loading time decreased significantly

Feedback from my users was that the maps loaded “instantly” after the change.

Mark Ismail

-----Original Message-----
From: gavin.montgomery [mailto:gavin.montgomery@anonymised.com]
Sent: 30 June 2015 11:53
To: geoserver-users@lists.sourceforge.net
Subject: [Geoserver-users] OS Mastermap in Production 1000’s of users

Hi All,

We are developing a map application which is aiming to serve 1000’s of users Ordnance Survey Master Map data at various scales.
We have scaled our geoserver solution to provide the following:

24 instances of geoserver running 4 instances on 6 VMs 8x 2.7 CPUs 64GB RAM each

2 instances of Geowebcache - 128GB RAM available on each GWC serves pre-built cache at levels 0-10 (1:2m - 1:3100) on British national Grid.
(Level 10 consists of approx 8 million tiles) Any further levels are cached dynamically As it is OS Mastermap we are required to update our data every 6 weeks hence a full recache at that time.

We have an Oracle Node with 12 cores serving our GeoServers as well as a number of other applications. Nonetheless OSMM requests are responsible for the majority of CPU usage.

We are using spatial partitions, up to date statistics as well as appropriate columns indexing for the WMS queries to take place.

We request tiles on 256x256 pixels - it has been suggested by our DBAs to increase this request size - does anybody agree/disagree with this? I would just expect this increases the size of the request and increase rendering time. OSMM is quite a complex SLD though is still rather performant.

Has anybody had experience with full national coverage of OSMM on Oracle?
Did you encounter performance issues at high user load? Did you do anything to rectify the solution or was it a matter of hardware required to deal with the demand?

Any insights appreciated, happy to answer any further questions.

Regards

–
View this message in context: http://osgeo-org.1560.x6.nabble.com/OS-Mastermap-in-Production-1000-s-of-users-tp5213560.html
Sent from the GeoServer - User mailing list archive at Nabble.com.

Don’t Limit Your Business. Reach for the Cloud.
GigeNET’s Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business.
Configured For All Businesses. Start Your Cloud Today.
https://www.gigenetcloud.com/

Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users
This e-mail and any attachments are confidential. It may contain privileged information and is intended for the named recipient(s) only. It must not be distributed without consent. If you are not one of the intended recipients, please notify the sender immediately and do not disclose, distribute, or retain this email or any part of it and do not take any action based on it.

Unless expressly stated, opinions in this email are those of the individual sender, and not of Knowsley MBC. Legally binding obligations can only be created for, or be entered into on behalf of, Knowsley MBC by duly authorised officers or representatives.

Knowsley MBC excludes any liability whatsoever for any offence caused, any direct or consequential loss arising from the use, or reliance on, this e-mail or its contents. We believe but do not warrant that this e-mail and any attachments are virus free. You must therefore take full responsibility for virus checking and no responsibility is accepted for loss or damage arising from viruses or changes made to this message after it was sent. Knowsley MBC reserves the right to monitor and/or record all e-mail communications through its network in accordance with relevant legislation.

Don’t Limit Your Business. Reach for the Cloud.
GigeNET’s Cloud Solutions provide you with the tools and support that
you need to offload your IT needs and focus on growing your business.
Configured For All Businesses. Start Your Cloud Today.
https://www.gigenetcloud.com/

Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

4

Thank you both, yes ultimately we would like to move to postGIS too, however
slightly constrained by client requirements.

We have been advised to increase the tile size of the requests to improve DB
query performance. I am happy to implement this change but do not believe it
is going to have a substantial impact on the performance when we scale up
the numbers - maybe allow for another 100 users or so...

FYI we currently have approx 50-60 users concurrent, this will be going up
significantly in coming weeks and we know the oracle DB will start to run
hot with that many requests.

Gavin

--
View this message in context: http://osgeo-org.1560.x6.nabble.com/OS-Mastermap-in-Production-1000-s-of-users-tp5213560p5213619.html
Sent from the GeoServer - User mailing list archive at Nabble.com.

5

Do you have meta tiling turned on? I can’t see that the DB access is the bottle neck (though with Oracle anything is possible) - I would have the lower levels cache on request so that at least popular areas become faster - unless you are very short fo disk space

Ian

On Tue, Jun 30, 2015 at 3:33 PM gavin.montgomery <gavin.montgomery@anonymised.com> wrote:

Thank you both, yes ultimately we would like to move to postGIS too, however
slightly constrained by client requirements.

We have been advised to increase the tile size of the requests to improve DB
query performance. I am happy to implement this change but do not believe it
is going to have a substantial impact on the performance when we scale up
the numbers - maybe allow for another 100 users or so…

FYI we currently have approx 50-60 users concurrent, this will be going up
significantly in coming weeks and we know the oracle DB will start to run
hot with that many requests.

Gavin

–
View this message in context: http://osgeo-org.1560.x6.nabble.com/OS-Mastermap-in-Production-1000-s-of-users-tp5213560p5213619.html
Sent from the GeoServer - User mailing list archive at Nabble.com.

Don’t Limit Your Business. Reach for the Cloud.
GigeNET’s Cloud Solutions provide you with the tools and support that
you need to offload your IT needs and focus on growing your business.
Configured For All Businesses. Start Your Cloud Today.
https://www.gigenetcloud.com/

Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

6

Hi Ian,

Thanks again, yes we are using 4x4 meta tiling.

It isn't specifically access to the DB that is the bottle neck, as we use
tiled requests it sends an inordinate amount of requests to the DB server.
The turn-around for a single request is not too bad at all (3-4ms) and our
DBA assures us that the query plan is as good as it can be. It is more a
matter of when we increase the number of requests on the DB it just
generates a mass backlog of queries to process. Something that is only going
to get worse as we ramp up. Instead we have the option of using single tile
(full screen) map requests which will reduce the traffic to the DB but will
inherently hit performance on the front end and GeoServers by increasing
rendering time.

I do have GWC configured to cache on request too, hopefully that will reduce
some of the load.

regards

--
View this message in context: http://osgeo-org.1560.x6.nabble.com/OS-Mastermap-in-Production-1000-s-of-users-tp5213560p5213748.html
Sent from the GeoServer - User mailing list archive at Nabble.com.