[GRASS-dev] [GRASS GIS] #2171: rfe r.in.gdal: auto-calc memory= value

#2171: rfe r.in.gdal: auto-calc memory= value
--------------------------------------+-------------------------------------
Reporter: hamish | Owner: grass-dev@…
     Type: enhancement | Status: new
Priority: normal | Milestone: 7.0.0
Component: Raster | Version: svn-trunk
Keywords: r.in.gdal, GDAL_CACHEMAX | Platform: All
      Cpu: All |
--------------------------------------+-------------------------------------
Hi, a r.in.gdal wish refined with hints from EvenR,

it would be nice if the r.in.gdal memory= option allowed the user to
specify memory=auto, in which case the value was automatically calculated
from "tile_height * raster_width * band_count * sizeof_datatype" rounded
up to the next megabyte or so for good luck.

This will require changing the parser check to manual testing, but that
shouldn't be too difficult. The default should remain at the current gdal-
internal 40MB for low-resource users who want to import very large files.

for now I've put a hint in the wiki:
  http://grasswiki.osgeo.org/wiki/Importing_data#Large_data

thanks,
Hamish (back soon)

--
Ticket URL: <https://trac.osgeo.org/grass/ticket/2171&gt;
GRASS GIS <http://grass.osgeo.org>

#2171: rfe r.in.gdal: auto-calc memory= value
--------------------------------------+-------------------------------------
Reporter: hamish | Owner: grass-dev@…
     Type: enhancement | Status: new
Priority: normal | Milestone: 7.0.0
Component: Raster | Version: svn-trunk
Keywords: r.in.gdal, GDAL_CACHEMAX | Platform: All
      Cpu: All |
--------------------------------------+-------------------------------------

Comment(by mlennert):

Replying to [ticket:2171 hamish]:
> Hi, a r.in.gdal wish refined with hints from EvenR,
>
> it would be nice if the r.in.gdal memory= option allowed the user to
specify memory=auto, in which case the value was automatically calculated
from "tile_height * raster_width * band_count * sizeof_datatype" rounded
up to the next megabyte or so for good luck.
>
> This will require changing the parser check to manual testing, but that
shouldn't be too difficult. The default should remain at the current gdal-
internal 40MB for low-resource users who want to import very large files.
>
> for now I've put a hint in the wiki:
> http://grasswiki.osgeo.org/wiki/Importing_data#Large_data

As a side note: wouldn't a memory parameter also be beneficial for
r.out.gdal ?

Moritz

--
Ticket URL: <https://trac.osgeo.org/grass/ticket/2171#comment:1&gt;
GRASS GIS <http://grass.osgeo.org>

#2171: rfe r.in.gdal: auto-calc memory= value
--------------------------------------+-------------------------------------
Reporter: hamish | Owner: grass-dev@…
     Type: enhancement | Status: new
Priority: normal | Milestone: 7.0.0
Component: Raster | Version: svn-trunk
Keywords: r.in.gdal, GDAL_CACHEMAX | Platform: All
      Cpu: All |
--------------------------------------+-------------------------------------

Comment(by neteler):

r.in.gdal:
"memory" (cache) parameter added in trunk r61362/r61364 and in relbr7
r61363/r61458.
Leads to notable (!) speed-up. Ticket could be closed.

Concerning extra wish:

Attached a patch for r.out.gdal. For smaller files no improvement, perhaps
useless?
Needs to be tested with large file export.

--
Ticket URL: <http://trac.osgeo.org/grass/ticket/2171#comment:2&gt;
GRASS GIS <http://grass.osgeo.org>