[Geoserver-users] Advice on speeding up map generation

Hey there,

I’m looking for some advice about how to speed up responses to WMS requests for a map I’m generating. The map consists of 800k points, stored in Postgres (with a spatial index and clustered), and at this point I’m displaying it with the default point SLD. It can take as long as 45 seconds to render. I’ve played with the various renderer configurations … but I’m not sure how to profile or improve the performance at this stage. Any advice? Any additional information I can provide?

Thanks so much, --j

Probably the easiest (and most effective) way to improve WMS performance is to set up a tile cache for your WMS. GeoWebCache and TileCache are two fairly easy options. GeoWebCache even has a plugin available for GeoServer.

http://geowebcache.org/
http://tilecache.org/

Hope this helps,
-David Winslow

Josh Marcus wrote:

Hey there,

I'm looking for some advice about how to speed up responses to WMS requests for a map I'm generating. The map consists of 800k points, stored in Postgres (with a spatial index and clustered), and at this point I'm displaying it with the default point SLD. It can take as long as 45 seconds to render. I've played with the various renderer configurations ... but I'm not sure how to profile or improve the performance at this stage. Any advice? Any additional information I can provide?

Thanks so much, --j
!DSPAM:4040,4880f67155391637810514!
------------------------------------------------------------------------

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/

!DSPAM:4040,4880f67155391637810514!
  ------------------------------------------------------------------------

_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

!DSPAM:4040,4880f67155391637810514!
  

David,

Thanks for the advice! However, I need to apply dynamic SLDs – so I will need to actually optimize the speed of the map generation. Mapserver can generate the same maps almost an order of magnitude faster.

–j

On Fri, Jul 18, 2008 at 4:05 PM, David Winslow <dwinslow@anonymised.com> wrote:

Probably the easiest (and most effective) way to improve WMS performance is to set up a tile cache for your WMS. GeoWebCache and TileCache are two fairly easy options. GeoWebCache even has a plugin available for GeoServer.

http://geowebcache.org/
http://tilecache.org/

Hope this helps,
-David Winslow

Josh Marcus wrote:

Hey there,

I’m looking for some advice about how to speed up responses to WMS requests for a map I’m generating. The map consists of 800k points, stored in Postgres (with a spatial index and clustered), and at this point I’m displaying it with the default point SLD. It can take as long as 45 seconds to render. I’ve played with the various renderer configurations … but I’m not sure how to profile or improve the performance at this stage. Any advice? Any additional information I can provide?

Thanks so much, --j

!DSPAM:4040,4880f67155391637810514!


This SF.Net email is sponsored by the Moblin Your Move Developer’s challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/

!DSPAM:4040,4880f67155391637810514!


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

!DSPAM:4040,4880f67155391637810514!

What version of GeoServer are you using? It should be just as fast as MapServer for most all renderings with 1.6.x. One thing may be to install java advanced imaging, though I think we don't depend on that for speed as much as we used to. And be sure that your jdk is 1.6, 1.4 is half as slow. http://geoserver.org/display/GEOSDOC/2.6+GeoServer+in+Production+Environment has more hints on running in a production environment, and may have some more tips.

Chris

Josh Marcus wrote:

David,

Thanks for the advice! However, I need to apply dynamic SLDs -- so I will need to actually optimize the speed of the map generation. Mapserver can generate the same maps almost an order of magnitude faster.

--j

On Fri, Jul 18, 2008 at 4:05 PM, David Winslow <dwinslow@anonymised.com <mailto:dwinslow@anonymised.com>> wrote:

    Probably the easiest (and most effective) way to improve WMS
    performance is to set up a tile cache for your WMS. GeoWebCache and
    TileCache are two fairly easy options. GeoWebCache even has a
    plugin available for GeoServer.

    http://geowebcache.org/
    http://tilecache.org/

    Hope this helps,
    -David Winslow

    Josh Marcus wrote:

        Hey there,

        I'm looking for some advice about how to speed up responses to
        WMS requests for a map I'm generating. The map consists of 800k
        points, stored in Postgres (with a spatial index and clustered),
        and at this point I'm displaying it with the default point SLD.
         It can take as long as 45 seconds to render. I've played with
        the various renderer configurations ... but I'm not sure how to
        profile or improve the performance at this stage. Any advice?
         Any additional information I can provide?

        Thanks so much, --j

        ------------------------------------------------------------------------

        -------------------------------------------------------------------------
        This SF.Net email is sponsored by the Moblin Your Move
        Developer's challenge
        Build the coolest Linux based applications with Moblin SDK & win
        great prizes
        Grand prize is a trip for two to an Open Source event anywhere
        in the world
        http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;

        !DSPAM:4040,4880f67155391637810514!
         ------------------------------------------------------------------------

        _______________________________________________
        Geoserver-users mailing list
        Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>
        https://lists.sourceforge.net/lists/listinfo/geoserver-users

        !DSPAM:4040,4880f67155391637810514!
         
!DSPAM:4005,488101b977873327367457!

------------------------------------------------------------------------

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/

!DSPAM:4005,488101b977873327367457!

------------------------------------------------------------------------

_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

!DSPAM:4005,488101b977873327367457!

Hey there,

I’m using 1.7.x and my jdk is 1.6, and I’ve isolated that my issue is postgis related, as I dumped my postgis data into a shapefile – and that renders quite quickly.

–j

On Fri, Jul 18, 2008 at 5:31 PM, Chris Holmes <cholmes@anonymised.com> wrote:

What version of GeoServer are you using? It should be just as fast as MapServer for most all renderings with 1.6.x. One thing may be to install java advanced imaging, though I think we don’t depend on that for speed as much as we used to. And be sure that your jdk is 1.6, 1.4 is half as slow. http://geoserver.org/display/GEOSDOC/2.6+GeoServer+in+Production+Environment has more hints on running in a production environment, and may have some more tips.

Chris

Josh Marcus wrote:

David,

Thanks for the advice! However, I need to apply dynamic SLDs – so I will need to actually optimize the speed of the map generation. Mapserver can generate the same maps almost an order of magnitude faster.

–j

On Fri, Jul 18, 2008 at 4:05 PM, David Winslow <dwinslow@anonymised.com mailto:[dwinslow@anonymised.com](mailto:dwinslow@anonymised.com)> wrote:

Probably the easiest (and most effective) way to improve WMS
performance is to set up a tile cache for your WMS. GeoWebCache and
TileCache are two fairly easy options. GeoWebCache even has a
plugin available for GeoServer.

http://geowebcache.org/
http://tilecache.org/

Hope this helps,
-David Winslow

Josh Marcus wrote:

Hey there,

I’m looking for some advice about how to speed up responses to
WMS requests for a map I’m generating. The map consists of 800k
points, stored in Postgres (with a spatial index and clustered),
and at this point I’m displaying it with the default point SLD.
It can take as long as 45 seconds to render. I’ve played with
the various renderer configurations … but I’m not sure how to
profile or improve the performance at this stage. Any advice?
Any additional information I can provide?

Thanks so much, --j



This SF.Net email is sponsored by the Moblin Your Move
Developer’s challenge
Build the coolest Linux based applications with Moblin SDK & win
great prizes
Grand prize is a trip for two to an Open Source event anywhere
in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
<http://moblin-contest.org/redirect.php?banner_id=100&url=/>

!DSPAM:4040,4880f67155391637810514!


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net

mailto:[Geoserver-users@lists.sourceforge.net](mailto:Geoserver-users@lists.sourceforge.net)

https://lists.sourceforge.net/lists/listinfo/geoserver-users

!DSPAM:4040,4880f67155391637810514!

!DSPAM:4005,488101b977873327367457!



This SF.Net email is sponsored by the Moblin Your Move Developer’s challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/

!DSPAM:4005,488101b977873327367457!



Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

!DSPAM:4005,488101b977873327367457!

Are you using nightlies? Or beta-1? We know that performance dropped for 1.7.x, and made recent efforts to fix it. Though maybe only shapefile got better.

Could you try it with 1.6.x and see if that's fast? And then if you are on the latest nightlies it sounds like we should get our profiler out and see if we have the same issues with postgis. A lot changed with 1.7.x, so it's quite possible it's slower. Thanks a ton for bringing up the issue.

best regards,

Chris

Josh Marcus wrote:

Hey there,

I'm using 1.7.x and my jdk is 1.6, and I've isolated that my issue is postgis related, as I dumped my postgis data into a shapefile -- and that renders quite quickly.

--j

On Fri, Jul 18, 2008 at 5:31 PM, Chris Holmes <cholmes@anonymised.com <mailto:cholmes@anonymised.com>> wrote:

    What version of GeoServer are you using? It should be just as fast
    as MapServer for most all renderings with 1.6.x. One thing may be
    to install java advanced imaging, though I think we don't depend on
    that for speed as much as we used to. And be sure that your jdk is
    1.6, 1.4 is half as slow.
    http://geoserver.org/display/GEOSDOC/2.6+GeoServer+in+Production+Environment
    has more hints on running in a production environment, and may have
    some more tips.

    Chris

    Josh Marcus wrote:

        David,

        Thanks for the advice! However, I need to apply dynamic SLDs
        -- so I will need to actually optimize the speed of the map
        generation. Mapserver can generate the same maps almost an
        order of magnitude faster.

        --j

        On Fri, Jul 18, 2008 at 4:05 PM, David Winslow
        <dwinslow@anonymised.com <mailto:dwinslow@anonymised.com>
        <mailto:dwinslow@anonymised.com>> wrote:

           Probably the easiest (and most effective) way to improve WMS
           performance is to set up a tile cache for your WMS.
         GeoWebCache and
           TileCache are two fairly easy options. GeoWebCache even has a
           plugin available for GeoServer.

           http://geowebcache.org/
           http://tilecache.org/

           Hope this helps,
           -David Winslow

           Josh Marcus wrote:

               Hey there,

               I'm looking for some advice about how to speed up
        responses to
               WMS requests for a map I'm generating. The map consists
        of 800k
               points, stored in Postgres (with a spatial index and
        clustered),
               and at this point I'm displaying it with the default
        point SLD.
                It can take as long as 45 seconds to render. I've
        played with
               the various renderer configurations ... but I'm not sure
        how to
               profile or improve the performance at this stage. Any
        advice?
                Any additional information I can provide?

               Thanks so much, --j

                      ------------------------------------------------------------------------

                      -------------------------------------------------------------------------
               This SF.Net email is sponsored by the Moblin Your Move
               Developer's challenge
               Build the coolest Linux based applications with Moblin
        SDK & win
               great prizes
               Grand prize is a trip for two to an Open Source event
        anywhere
               in the world
                      http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;
                      <http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;&gt;

               _______________________________________________
               Geoserver-users mailing list
               Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>
               <mailto:Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>>

               https://lists.sourceforge.net/lists/listinfo/geoserver-users

               !DSPAM:4040,4880f67155391637810514!
               
        !DSPAM:4005,488101b977873327367457!

        ------------------------------------------------------------------------

        -------------------------------------------------------------------------
        This SF.Net email is sponsored by the Moblin Your Move
        Developer's challenge
        Build the coolest Linux based applications with Moblin SDK & win
        great prizes
        Grand prize is a trip for two to an Open Source event anywhere
        in the world
        http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;

        !DSPAM:4005,488101b977873327367457!

        ------------------------------------------------------------------------

        _______________________________________________
        Geoserver-users mailing list
        Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>
        https://lists.sourceforge.net/lists/listinfo/geoserver-users

        !DSPAM:4005,488101b977873327367457!

!DSPAM:4005,48810dce98281012714783!

Chris,

Thanks for the help!

I’ve tried it with 1.6.x and the performance seems pretty similar.

I exported my postgis data into a shapefile, and the performance with the shapefile is quite good (I haven’t tried filtering yet). So it seems like an issue with Postgis or Postgis/Geoserver interaction. If I put a filter on the points that reduces the number of points to under 50k, the performance is much better.

Maybe it’s an issue with the way I set up my postgis table? I added a spatial index and clustered based on the spatial index…

Any additional advice would be greatly appreciated. Again, let me know if there is information I can share that would be helpful for diagnosis.

–j

On Fri, Jul 18, 2008 at 6:10 PM, Chris Holmes <cholmes@anonymised.com> wrote:

Are you using nightlies? Or beta-1? We know that performance dropped for 1.7.x, and made recent efforts to fix it. Though maybe only shapefile got better.

Could you try it with 1.6.x and see if that’s fast? And then if you are on the latest nightlies it sounds like we should get our profiler out and see if we have the same issues with postgis. A lot changed with 1.7.x, so it’s quite possible it’s slower. Thanks a ton for bringing up the issue.

best regards,

Chris

Josh Marcus wrote:

Hey there,

I’m using 1.7.x and my jdk is 1.6, and I’ve isolated that my issue is postgis related, as I dumped my postgis data into a shapefile – and that renders quite quickly.
–j

On Fri, Jul 18, 2008 at 5:31 PM, Chris Holmes <cholmes@anonymised.com mailto:[cholmes@anonymised.com](mailto:cholmes@anonymised.com)> wrote:

What version of GeoServer are you using? It should be just as fast
as MapServer for most all renderings with 1.6.x. One thing may be
to install java advanced imaging, though I think we don’t depend on
that for speed as much as we used to. And be sure that your jdk is
1.6, 1.4 is half as slow.
http://geoserver.org/display/GEOSDOC/2.6+GeoServer+in+Production+Environment
has more hints on running in a production environment, and may have
some more tips.

Chris

Josh Marcus wrote:

David,

Thanks for the advice! However, I need to apply dynamic SLDs
– so I will need to actually optimize the speed of the map
generation. Mapserver can generate the same maps almost an
order of magnitude faster.

–j

On Fri, Jul 18, 2008 at 4:05 PM, David Winslow
<dwinslow@anonymised.com mailto:[dwinslow@anonymised.com](mailto:dwinslow@anonymised.com)

<mailto:dwinslow@anonymised.com mailto:[dwinslow@anonymised.com](mailto:dwinslow@anonymised.com)>> wrote:

Probably the easiest (and most effective) way to improve WMS
performance is to set up a tile cache for your WMS.
GeoWebCache and
TileCache are two fairly easy options. GeoWebCache even has a
plugin available for GeoServer.

http://geowebcache.org/
http://tilecache.org/

Hope this helps,
-David Winslow

Josh Marcus wrote:

Hey there,

I’m looking for some advice about how to speed up
responses to
WMS requests for a map I’m generating. The map consists
of 800k
points, stored in Postgres (with a spatial index and
clustered),
and at this point I’m displaying it with the default
point SLD.
It can take as long as 45 seconds to render. I’ve
played with
the various renderer configurations … but I’m not sure
how to
profile or improve the performance at this stage. Any
advice?
Any additional information I can provide?

Thanks so much, --j



This SF.Net email is sponsored by the Moblin Your Move
Developer’s challenge
Build the coolest Linux based applications with Moblin
SDK & win
great prizes
Grand prize is a trip for two to an Open Source event
anywhere
in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
<http://moblin-contest.org/redirect.php?banner_id=100&url=/>
<http://moblin-contest.org/redirect.php?banner_id=100&url=/
<http://moblin-contest.org/redirect.php?banner_id=100&url=/>>



Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
mailto:[Geoserver-users@lists.sourceforge.net](mailto:Geoserver-users@lists.sourceforge.net)
<mailto:Geoserver-users@lists.sourceforge.net
mailto:[Geoserver-users@lists.sourceforge.net](mailto:Geoserver-users@lists.sourceforge.net)>

https://lists.sourceforge.net/lists/listinfo/geoserver-users

!DSPAM:4040,4880f67155391637810514!

!DSPAM:4005,488101b977873327367457!



This SF.Net email is sponsored by the Moblin Your Move
Developer’s challenge
Build the coolest Linux based applications with Moblin SDK & win
great prizes
Grand prize is a trip for two to an Open Source event anywhere
in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
<http://moblin-contest.org/redirect.php?banner_id=100&url=/>

!DSPAM:4005,488101b977873327367457!



Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
mailto:[Geoserver-users@lists.sourceforge.net](mailto:Geoserver-users@lists.sourceforge.net)
https://lists.sourceforge.net/lists/listinfo/geoserver-users

!DSPAM:4005,488101b977873327367457!

!DSPAM:4005,48810dce98281012714783!

With MapServer you're connecting to the exact same postgis database? And it's an order of magnitude faster?

Shapefiles should be a bit faster than PostGIS, but not that much. And the differences should be about the same between GeoServer and MapServer, see http://www.foss4g2007.org/presentations/view.php?abstract_id=120

Chris

Josh Marcus wrote:

Chris,

Thanks for the help!

I've tried it with 1.6.x and the performance seems pretty similar.

I exported my postgis data into a shapefile, and the performance with the shapefile is quite good (I haven't tried filtering yet). So it seems like an issue with Postgis or Postgis/Geoserver interaction. If I put a filter on the points that reduces the number of points to under 50k, the performance is much better.

Maybe it's an issue with the way I set up my postgis table? I added a spatial index and clustered based on the spatial index...

Any additional advice would be greatly appreciated. Again, let me know if there is information I can share that would be helpful for diagnosis.

--j

On Fri, Jul 18, 2008 at 6:10 PM, Chris Holmes <cholmes@anonymised.com <mailto:cholmes@anonymised.com>> wrote:

    Are you using nightlies? Or beta-1? We know that performance
    dropped for 1.7.x, and made recent efforts to fix it. Though maybe
    only shapefile got better.

    Could you try it with 1.6.x and see if that's fast? And then if you
    are on the latest nightlies it sounds like we should get our
    profiler out and see if we have the same issues with postgis. A lot
    changed with 1.7.x, so it's quite possible it's slower. Thanks a
    ton for bringing up the issue.

    best regards,

    Chris

    Josh Marcus wrote:

        Hey there,

        I'm using 1.7.x and my jdk is 1.6, and I've isolated that my
        issue is postgis related, as I dumped my postgis data into a
        shapefile -- and that renders quite quickly.
        --j

        On Fri, Jul 18, 2008 at 5:31 PM, Chris Holmes
        <cholmes@anonymised.com <mailto:cholmes@anonymised.com>
        <mailto:cholmes@anonymised.com>> wrote:

           What version of GeoServer are you using? It should be just
        as fast
           as MapServer for most all renderings with 1.6.x. One thing
        may be
           to install java advanced imaging, though I think we don't
        depend on
           that for speed as much as we used to. And be sure that your
        jdk is
           1.6, 1.4 is half as slow.
                  http://geoserver.org/display/GEOSDOC/2.6+GeoServer+in+Production+Environment
           has more hints on running in a production environment, and
        may have
           some more tips.

           Chris

           Josh Marcus wrote:

               David,

               Thanks for the advice! However, I need to apply dynamic
        SLDs
               -- so I will need to actually optimize the speed of the map
               generation. Mapserver can generate the same maps almost an
               order of magnitude faster.

               --j

               On Fri, Jul 18, 2008 at 4:05 PM, David Winslow
               <dwinslow@anonymised.com <mailto:dwinslow@anonymised.com>
        <mailto:dwinslow@anonymised.com>
               <mailto:dwinslow@anonymised.com
        <mailto:dwinslow@anonymised.com> <mailto:dwinslow@anonymised.com
        <mailto:dwinslow@anonymised.com>>>> wrote:

                  Probably the easiest (and most effective) way to
        improve WMS
                  performance is to set up a tile cache for your WMS.
                GeoWebCache and
                  TileCache are two fairly easy options. GeoWebCache
        even has a
                  plugin available for GeoServer.

                  http://geowebcache.org/
                  http://tilecache.org/

                  Hope this helps,
                  -David Winslow

                  Josh Marcus wrote:

                      Hey there,

                      I'm looking for some advice about how to speed up
               responses to
                      WMS requests for a map I'm generating. The map
        consists
               of 800k
                      points, stored in Postgres (with a spatial index and
               clustered),
                      and at this point I'm displaying it with the default
               point SLD.
                       It can take as long as 45 seconds to render. I've
               played with
                      the various renderer configurations ... but I'm
        not sure
               how to
                      profile or improve the performance at this stage. Any
               advice?
                       Any additional information I can provide?

                      Thanks so much, --j

                                   ------------------------------------------------------------------------

                                   -------------------------------------------------------------------------
                      This SF.Net email is sponsored by the Moblin Your Move
                      Developer's challenge
                      Build the coolest Linux based applications with Moblin
               SDK & win
                      great prizes
                      Grand prize is a trip for two to an Open Source event
               anywhere
                      in the world
                                   http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;
                      <http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;&gt;
                                   <http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;
                      <http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;&gt;&gt;

                                                  ------------------------------------------------------------------------

                      _______________________________________________
                      Geoserver-users mailing list
                      Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>
               <mailto:Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>>
                      <mailto:Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>
               <mailto:Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>>>

                             https://lists.sourceforge.net/lists/listinfo/geoserver-users

               !DSPAM:4005,488101b977873327367457!

                      ------------------------------------------------------------------------

                      -------------------------------------------------------------------------
               This SF.Net email is sponsored by the Moblin Your Move
               Developer's challenge
               Build the coolest Linux based applications with Moblin
        SDK & win
               great prizes
               Grand prize is a trip for two to an Open Source event
        anywhere
               in the world
                      http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;
                      <http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;&gt;

               !DSPAM:4005,488101b977873327367457!

                      ------------------------------------------------------------------------

               _______________________________________________
               Geoserver-users mailing list
               Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>
               <mailto:Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>>
               https://lists.sourceforge.net/lists/listinfo/geoserver-users

               !DSPAM:4005,488101b977873327367457!

        !DSPAM:4005,48810dce98281012714783!

!DSPAM:4005,4884ad62169228992556831!

Hey folks,

Yeah – I’m connecting to the same exact postgis database with mapserver, and generating the map is an order of magnitude faster. I may have to switch over to mapserver, but I would very much prefer not to. Is there a benchmark test that involved rendering ~800k points? My points heavily overlap, which could be a factor – my map is all geonames features in Africa.

–j

On Mon, Jul 21, 2008 at 11:53 AM, Chris Holmes <cholmes@anonymised.com> wrote:

With MapServer you’re connecting to the exact same postgis database? And it’s an order of magnitude faster?

Shapefiles should be a bit faster than PostGIS, but not that much. And the differences should be about the same between GeoServer and MapServer, see http://www.foss4g2007.org/presentations/view.php?abstract_id=120

Chris

Josh Marcus wrote:

Chris,

Thanks for the help!

I’ve tried it with 1.6.x and the performance seems pretty similar.

I exported my postgis data into a shapefile, and the performance with the shapefile is quite good (I haven’t tried filtering yet). So it seems like an issue with Postgis or Postgis/Geoserver interaction. If I put a filter on the points that reduces the number of points to under 50k, the performance is much better.

Maybe it’s an issue with the way I set up my postgis table? I added a spatial index and clustered based on the spatial index…

Any additional advice would be greatly appreciated. Again, let me know if there is information I can share that would be helpful for diagnosis.

–j

On Fri, Jul 18, 2008 at 6:10 PM, Chris Holmes <cholmes@anonymised.com mailto:[cholmes@anonymised.com](mailto:cholmes@anonymised.com)> wrote:

Are you using nightlies? Or beta-1? We know that performance
dropped for 1.7.x, and made recent efforts to fix it. Though maybe
only shapefile got better.

Could you try it with 1.6.x and see if that’s fast? And then if you
are on the latest nightlies it sounds like we should get our
profiler out and see if we have the same issues with postgis. A lot
changed with 1.7.x, so it’s quite possible it’s slower. Thanks a
ton for bringing up the issue.

best regards,

Chris

Josh Marcus wrote:

Hey there,

I’m using 1.7.x and my jdk is 1.6, and I’ve isolated that my
issue is postgis related, as I dumped my postgis data into a
shapefile – and that renders quite quickly.
–j

On Fri, Jul 18, 2008 at 5:31 PM, Chris Holmes
<cholmes@anonymised.com mailto:[cholmes@anonymised.com](mailto:cholmes@anonymised.com)

<mailto:cholmes@anonymised.com mailto:[cholmes@anonymised.com](mailto:cholmes@anonymised.com)>> wrote:

What version of GeoServer are you using? It should be just
as fast
as MapServer for most all renderings with 1.6.x. One thing
may be
to install java advanced imaging, though I think we don’t
depend on
that for speed as much as we used to. And be sure that your
jdk is
1.6, 1.4 is half as slow.
http://geoserver.org/display/GEOSDOC/2.6+GeoServer+in+Production+Environment
has more hints on running in a production environment, and
may have
some more tips.

Chris

Josh Marcus wrote:

David,

Thanks for the advice! However, I need to apply dynamic
SLDs
– so I will need to actually optimize the speed of the map
generation. Mapserver can generate the same maps almost an
order of magnitude faster.

–j

On Fri, Jul 18, 2008 at 4:05 PM, David Winslow
<dwinslow@anonymised.com mailto:[dwinslow@anonymised.com](mailto:dwinslow@anonymised.com)
<mailto:dwinslow@anonymised.com mailto:[dwinslow@anonymised.com](mailto:dwinslow@anonymised.com)>
<mailto:dwinslow@anonymised.com
mailto:[dwinslow@anonymised.com](mailto:dwinslow@anonymised.com) <mailto:dwinslow@anonymised.com
mailto:[dwinslow@anonymised.com](mailto:dwinslow@anonymised.com)>>> wrote:

Probably the easiest (and most effective) way to
improve WMS
performance is to set up a tile cache for your WMS.
GeoWebCache and
TileCache are two fairly easy options. GeoWebCache
even has a
plugin available for GeoServer.

http://geowebcache.org/
http://tilecache.org/

Hope this helps,
-David Winslow

Josh Marcus wrote:

Hey there,

I’m looking for some advice about how to speed up
responses to
WMS requests for a map I’m generating. The map
consists
of 800k
points, stored in Postgres (with a spatial index and
clustered),
and at this point I’m displaying it with the default
point SLD.
It can take as long as 45 seconds to render. I’ve
played with
the various renderer configurations … but I’m
not sure
how to
profile or improve the performance at this stage. Any
advice?
Any additional information I can provide?

Thanks so much, --j



This SF.Net email is sponsored by the Moblin Your Move
Developer’s challenge
Build the coolest Linux based applications with Moblin
SDK & win
great prizes
Grand prize is a trip for two to an Open Source event
anywhere
in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
<http://moblin-contest.org/redirect.php?banner_id=100&url=/>
<http://moblin-contest.org/redirect.php?banner_id=100&url=/
<http://moblin-contest.org/redirect.php?banner_id=100&url=/>>
<http://moblin-contest.org/redirect.php?banner_id=100&url=/
<http://moblin-contest.org/redirect.php?banner_id=100&url=/>
<http://moblin-contest.org/redirect.php?banner_id=100&url=/
<http://moblin-contest.org/redirect.php?banner_id=100&url=/>>>



Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
mailto:[Geoserver-users@lists.sourceforge.net](mailto:Geoserver-users@lists.sourceforge.net)
<mailto:Geoserver-users@lists.sourceforge.net
mailto:[Geoserver-users@lists.sourceforge.net](mailto:Geoserver-users@lists.sourceforge.net)>
<mailto:Geoserver-users@lists.sourceforge.net
mailto:[Geoserver-users@lists.sourceforge.net](mailto:Geoserver-users@lists.sourceforge.net)
<mailto:Geoserver-users@lists.sourceforge.net

mailto:[Geoserver-users@lists.sourceforge.net](mailto:Geoserver-users@lists.sourceforge.net)>>

https://lists.sourceforge.net/lists/listinfo/geoserver-users

!DSPAM:4005,488101b977873327367457!



This SF.Net email is sponsored by the Moblin Your Move
Developer’s challenge
Build the coolest Linux based applications with Moblin
SDK & win
great prizes
Grand prize is a trip for two to an Open Source event
anywhere
in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
<http://moblin-contest.org/redirect.php?banner_id=100&url=/>
<http://moblin-contest.org/redirect.php?banner_id=100&url=/
<http://moblin-contest.org/redirect.php?banner_id=100&url=/>>

!DSPAM:4005,488101b977873327367457!



Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
mailto:[Geoserver-users@lists.sourceforge.net](mailto:Geoserver-users@lists.sourceforge.net)

<mailto:Geoserver-users@lists.sourceforge.net
mailto:[Geoserver-users@lists.sourceforge.net](mailto:Geoserver-users@lists.sourceforge.net)>
https://lists.sourceforge.net/lists/listinfo/geoserver-users

!DSPAM:4005,488101b977873327367457!

!DSPAM:4005,48810dce98281012714783!

!DSPAM:4005,4884ad62169228992556831!

Hi Josh,

Chiming in a bit late. Those performance benchmarks are based on very simple styles (no thematics, no labels, etc..) so depending on your SLD you could be hitting a case where the render is just slow. Although I do suspect something else is off if its an order of magnitude slower than mapserver.

It would help if you included your SLD and if possible some of your data (a postgis dump would do). That way one of us could run the requests here (in a profiler if necessary) to see what exactly is going on.

-Justin

Josh Marcus wrote:

Hey folks,

Yeah -- I'm connecting to the same exact postgis database with mapserver, and generating the map is an order of magnitude faster. I may have to switch over to mapserver, but I would very much prefer not to. Is there a benchmark test that involved rendering ~800k points? My points heavily overlap, which could be a factor -- my map is all geonames features in Africa.

--j

On Mon, Jul 21, 2008 at 11:53 AM, Chris Holmes <cholmes@anonymised.com <mailto:cholmes@anonymised.com>> wrote:

    With MapServer you're connecting to the exact same postgis database?
    And it's an order of magnitude faster?

    Shapefiles should be a bit faster than PostGIS, but not that much.
     And the differences should be about the same between GeoServer and
    MapServer, see
    http://www.foss4g2007.org/presentations/view.php?abstract_id=120

    Chris

    Josh Marcus wrote:

        Chris,

        Thanks for the help!

        I've tried it with 1.6.x and the performance seems pretty similar.

        I exported my postgis data into a shapefile, and the performance
        with the shapefile is quite good (I haven't tried filtering
        yet). So it seems like an issue with Postgis or
        Postgis/Geoserver interaction. If I put a filter on the points
        that reduces the number of points to under 50k, the performance
        is much better.

        Maybe it's an issue with the way I set up my postgis table? I
        added a spatial index and clustered based on the spatial index...

        Any additional advice would be greatly appreciated. Again, let
        me know if there is information I can share that would be
        helpful for diagnosis.

        --j

        On Fri, Jul 18, 2008 at 6:10 PM, Chris Holmes
        <cholmes@anonymised.com <mailto:cholmes@anonymised.com>
        <mailto:cholmes@anonymised.com>> wrote:

           Are you using nightlies? Or beta-1? We know that performance
           dropped for 1.7.x, and made recent efforts to fix it. Though
        maybe
           only shapefile got better.

           Could you try it with 1.6.x and see if that's fast? And then
        if you
           are on the latest nightlies it sounds like we should get our
           profiler out and see if we have the same issues with postgis.
         A lot
           changed with 1.7.x, so it's quite possible it's slower. Thanks a
           ton for bringing up the issue.

           best regards,

           Chris

           Josh Marcus wrote:

               Hey there,

               I'm using 1.7.x and my jdk is 1.6, and I've isolated that my
               issue is postgis related, as I dumped my postgis data into a
               shapefile -- and that renders quite quickly.
               --j

               On Fri, Jul 18, 2008 at 5:31 PM, Chris Holmes
               <cholmes@anonymised.com <mailto:cholmes@anonymised.com>
        <mailto:cholmes@anonymised.com>
               <mailto:cholmes@anonymised.com
        <mailto:cholmes@anonymised.com>>> wrote:

                  What version of GeoServer are you using? It should be
        just
               as fast
                  as MapServer for most all renderings with 1.6.x. One
        thing
               may be
                  to install java advanced imaging, though I think we don't
               depend on
                  that for speed as much as we used to. And be sure
        that your
               jdk is
                  1.6, 1.4 is half as slow.
                               http://geoserver.org/display/GEOSDOC/2.6+GeoServer+in+Production+Environment
                  has more hints on running in a production environment, and
               may have
                  some more tips.

                  Chris

                  Josh Marcus wrote:

                      David,

                      Thanks for the advice! However, I need to apply
        dynamic
               SLDs
                      -- so I will need to actually optimize the speed
        of the map
                      generation. Mapserver can generate the same maps
        almost an
                      order of magnitude faster.

                      --j

                      On Fri, Jul 18, 2008 at 4:05 PM, David Winslow
                      <dwinslow@anonymised.com
        <mailto:dwinslow@anonymised.com> <mailto:dwinslow@anonymised.com
        <mailto:dwinslow@anonymised.com>>
               <mailto:dwinslow@anonymised.com
        <mailto:dwinslow@anonymised.com> <mailto:dwinslow@anonymised.com
        <mailto:dwinslow@anonymised.com>>>
                      <mailto:dwinslow@anonymised.com
        <mailto:dwinslow@anonymised.com>
               <mailto:dwinslow@anonymised.com
        <mailto:dwinslow@anonymised.com>> <mailto:dwinslow@anonymised.com
        <mailto:dwinslow@anonymised.com>
               <mailto:dwinslow@anonymised.com
        <mailto:dwinslow@anonymised.com>>>>> wrote:

                         Probably the easiest (and most effective) way to
               improve WMS
                         performance is to set up a tile cache for your WMS.
                       GeoWebCache and
                         TileCache are two fairly easy options. GeoWebCache
               even has a
                         plugin available for GeoServer.

                         http://geowebcache.org/
                         http://tilecache.org/

                         Hope this helps,
                         -David Winslow

                         Josh Marcus wrote:

                             Hey there,

                             I'm looking for some advice about how to
        speed up
                      responses to
                             WMS requests for a map I'm generating. The map
               consists
                      of 800k
                             points, stored in Postgres (with a spatial
        index and
                      clustered),
                             and at this point I'm displaying it with
        the default
                      point SLD.
                              It can take as long as 45 seconds to
        render. I've
                      played with
                             the various renderer configurations ... but I'm
               not sure
                      how to
                             profile or improve the performance at this
        stage. Any
                      advice?
                              Any additional information I can provide?

                             Thanks so much, --j

                                                ------------------------------------------------------------------------

                                                -------------------------------------------------------------------------
                             This SF.Net email is sponsored by the
        Moblin Your Move
                             Developer's challenge
                             Build the coolest Linux based applications
        with Moblin
                      SDK & win
                             great prizes
                             Grand prize is a trip for two to an Open
        Source event
                      anywhere
                             in the world
                                                http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;
                      <http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;&gt;
                                   <http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;
                      <http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;&gt;&gt;
                                                <http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;
                      <http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;&gt;
                                   <http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;
                      <http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;&gt;&gt;&gt;

                                                               ------------------------------------------------------------------------

                             _______________________________________________
                             Geoserver-users mailing list
                             Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>
               <mailto:Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>>
                      <mailto:Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>
               <mailto:Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>>>
                                    <mailto:Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>
               <mailto:Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>>
                      <mailto:Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>
               <mailto:Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>>>>

                                          https://lists.sourceforge.net/lists/listinfo/geoserver-users

                                   ------------------------------------------------------------------------

                                   -------------------------------------------------------------------------
                      This SF.Net email is sponsored by the Moblin Your Move
                      Developer's challenge
                      Build the coolest Linux based applications with Moblin
               SDK & win
                      great prizes
                      Grand prize is a trip for two to an Open Source event
               anywhere
                      in the world
                                   http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;
                      <http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;&gt;
                                   <http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;
                      <http://moblin-contest.org/redirect.php?banner_id=100&url=/
        <http://moblin-contest.org/redirect.php?banner_id=100&url=/&gt;&gt;&gt;

                      !DSPAM:4005,488101b977873327367457!

                                   ------------------------------------------------------------------------

                      _______________________________________________
                      Geoserver-users mailing list
                      Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>
               <mailto:Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>>
                      <mailto:Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>
               <mailto:Geoserver-users@lists.sourceforge.net
        <mailto:Geoserver-users@lists.sourceforge.net>>>
                             https://lists.sourceforge.net/lists/listinfo/geoserver-users

                      !DSPAM:4005,488101b977873327367457!

               !DSPAM:4005,48810dce98281012714783!

        !DSPAM:4005,4884ad62169228992556831!

!DSPAM:4007,4884fb0b57845210051143!

------------------------------------------------------------------------

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/

!DSPAM:4007,4884fb0b57845210051143!

------------------------------------------------------------------------

_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

!DSPAM:4007,4884fb0b57845210051143!

--
Justin Deoliveira
The Open Planning Project
jdeolive@anonymised.com

Josh Marcus ha scritto:

Hey folks,

Yeah -- I'm connecting to the same exact postgis database with mapserver, and generating the map is an order of magnitude faster. I may have to switch over to mapserver, but I would very much prefer not to. Is there a benchmark test that involved rendering ~800k points? My points heavily overlap, which could be a factor -- my map is all geonames features in Africa.

We actually never run tests with that many points.
Yet, I'd suggest you turn off antialiasing since that makes quite a difference in drawing speed, and MapServer has antialiasing off by default. To do so, add "&format_options=antialias:none" to your WMS
request.

Failing that, I second Justin suggestion, any chance you can drop us a copy of your data and SLD (by private mail, we won't divulge it).

Cheers
Andrea

I’ve tried turning antialiasing off, but without any luck.

I’ll package up a dump of our data and the SLDs I’ve tried and put it online for testing.

Thanks so much!

–j

On Sun, Jul 27, 2008 at 11:51 AM, Andrea Aime <aaime@anonymised.com> wrote:

Josh Marcus ha scritto:

Hey folks,

Yeah – I’m connecting to the same exact postgis database with mapserver, and generating the map is an order of magnitude faster. I may have to switch over to mapserver, but I would very much prefer not to. Is there a benchmark test that involved rendering ~800k points? My points heavily overlap, which could be a factor – my map is all geonames features in Africa.

We actually never run tests with that many points.
Yet, I’d suggest you turn off antialiasing since that makes quite a difference in drawing speed, and MapServer has antialiasing off by default. To do so, add “&format_options=antialias:none” to your WMS
request.

Failing that, I second Justin suggestion, any chance you can drop us a copy of your data and SLD (by private mail, we won’t divulge it).

Cheers
Andrea