[GRASS-user] Grass GIS Temporary files too large

GRASS GRASS user
1

Hi,

I am trying to run a 3D interpolation with 70k points. When running V.Vol.RST, the simulation runs out of memory for the Temp File on my computer. I have 78 gb of space on my laptop and running a solid state hard drive so relatively small to begin with.

Should I run the simulation from an external hard drive. I have 1 TB available external drive available, or
are there some settings that I can change in Grass or V.Vol.RST to make it work with the Temp file?

If I do run from an external drive, do i have to move all the grass files to the external drive for the temp file to be saved there or is there a setting where i can change the saving location?

I have been looking at the link below which is supposed to explain how to manage large datasets; however, i am too computer/grass illeterate to understand this.
https://grass.osgeo.org/grass72/manuals/variables.html

Thanks
F.

2

On Mon, May 21, 2018 at 8:19 PM, Francois Chartier
<fra.chartier@gmail.com> wrote:

Hi,

I am trying to run a 3D interpolation with 70k points. When running
V.Vol.RST, the simulation runs out of memory for the Temp File on my
computer.

Could you please post the error message?

thanks
Markus

3

Simulation ran all night with the 70 k points and still at 10%. I reran to get the error message but still not there yet.
.

(attachments)

grass_cmd_output may23.txt (980 Bytes)

···

2018-05-22 13:55 GMT-04:00 Markus Neteler <neteler@osgeo.org>:

On Mon, May 21, 2018 at 8:19 PM, Francois Chartier
<fra.chartier@gmail.com> wrote:

Hi,

I am trying to run a 3D interpolation with 70k points. When running
V.Vol.RST, the simulation runs out of memory for the Temp File on my
computer.

Could you please post the error message?

thanks
Markus

4

Hi Francois,

Are you running this on the 1TB external harddrive you mentioned (presumably USB connected)?

That could decrease performance significantly…

Cheers

Stefan

(attachments)

image001.png

···

Simulation ran all night with the 70 k points and still at 10%. I reran to get the error message but still not there yet.

.

2018-05-22 13:55 GMT-04:00 Markus Neteler <neteler@osgeo.org>:

On Mon, May 21, 2018 at 8:19 PM, Francois Chartier
<fra.chartier@gmail.com> wrote:

Hi,

I am trying to run a 3D interpolation with 70k points. When running
V.Vol.RST, the simulation runs out of memory for the Temp File on my
computer.

Could you please post the error message?

thanks
Markus

5

just running on my laptop. to run on external drive, do i need to move all the files on the external drive (copy and paste all grass files)?

(attachments)

image001.png

···

2018-05-23 7:06 GMT-04:00 Stefan Blumentrath <Stefan.Blumentrath@nina.no>:

Hi Francois,

Are you running this on the 1TB external harddrive you mentioned (presumably USB connected)?

That could decrease performance significantly…

Cheers

Stefan

From: grass-user <grass-user-bounces@lists.osgeo.org> On Behalf Of Francois Chartier
Sent: onsdag 23. mai 2018 13.01
To: Markus Neteler <neteler@osgeo.org>
Cc: GRASS user list <grass-user@lists.osgeo.org>
Subject: Re: [GRASS-user] Grass GIS Temporary files too large

Simulation ran all night with the 70 k points and still at 10%. I reran to get the error message but still not there yet.

.

2018-05-22 13:55 GMT-04:00 Markus Neteler <neteler@osgeo.org>:

On Mon, May 21, 2018 at 8:19 PM, Francois Chartier
<fra.chartier@gmail.com> wrote:

Hi,

I am trying to run a 3D interpolation with 70k points. When running
V.Vol.RST, the simulation runs out of memory for the Temp File on my
computer.

Could you please post the error message?

thanks
Markus

6

That is fine. If you have enough space, running on local SSD is your best option.

Just wanted to make sure that not the external hard disk is the bottleneck…

Cheers

Stefan

(attachments)

image001.png

···

just running on my laptop. to run on external drive, do i need to move all the files on the external drive (copy and paste all grass files)?

2018-05-23 7:06 GMT-04:00 Stefan Blumentrath <Stefan.Blumentrath@nina.no>:

Hi Francois,

Are you running this on the 1TB external harddrive you mentioned (presumably USB connected)?

That could decrease performance significantly…

Cheers

Stefan

From: grass-user <grass-user-bounces@lists.osgeo.org> On Behalf Of Francois Chartier
Sent: onsdag 23. mai 2018 13.01
To: Markus Neteler <neteler@osgeo.org>
Cc: GRASS user list <grass-user@lists.osgeo.org>
Subject: Re: [GRASS-user] Grass GIS Temporary files too large

Simulation ran all night with the 70 k points and still at 10%. I reran to get the error message but still not there yet.

.

2018-05-22 13:55 GMT-04:00 Markus Neteler <neteler@osgeo.org>:

On Mon, May 21, 2018 at 8:19 PM, Francois Chartier
<fra.chartier@gmail.com> wrote:

Hi,

I am trying to run a 3D interpolation with 70k points. When running
V.Vol.RST, the simulation runs out of memory for the Temp File on my
computer.

Could you please post the error message?

thanks
Markus

7

thanks a lot. it seems I am might be on the right path with other comments. I could having an issue with a too high resolution.

(attachments)

image001.png

···

2018-05-23 8:03 GMT-04:00 Stefan Blumentrath <Stefan.Blumentrath@nina.no>:

That is fine. If you have enough space, running on local SSD is your best option.

Just wanted to make sure that not the external hard disk is the bottleneck…

Cheers

Stefan

From: Francois Chartier <fra.chartier@gmail.com>
Sent: onsdag 23. mai 2018 13.11
To: Stefan Blumentrath <Stefan.Blumentrath@nina.no>
Cc: Markus Neteler <neteler@osgeo.org>; GRASS user list <grass-user@lists.osgeo.org>

Subject: Re: [GRASS-user] Grass GIS Temporary files too large

just running on my laptop. to run on external drive, do i need to move all the files on the external drive (copy and paste all grass files)?

2018-05-23 7:06 GMT-04:00 Stefan Blumentrath <Stefan.Blumentrath@nina.no>:

Hi Francois,

Are you running this on the 1TB external harddrive you mentioned (presumably USB connected)?

That could decrease performance significantly…

Cheers

Stefan

From: grass-user <grass-user-bounces@lists.osgeo.org> On Behalf Of Francois Chartier
Sent: onsdag 23. mai 2018 13.01
To: Markus Neteler <neteler@osgeo.org>
Cc: GRASS user list <grass-user@lists.osgeo.org>
Subject: Re: [GRASS-user] Grass GIS Temporary files too large

Simulation ran all night with the 70 k points and still at 10%. I reran to get the error message but still not there yet.

.

2018-05-22 13:55 GMT-04:00 Markus Neteler <neteler@osgeo.org>:

On Mon, May 21, 2018 at 8:19 PM, Francois Chartier
<fra.chartier@gmail.com> wrote:

Hi,

I am trying to run a 3D interpolation with 70k points. When running
V.Vol.RST, the simulation runs out of memory for the Temp File on my
computer.

Could you please post the error message?

thanks
Markus