Hi
OS: OS X, El Capitan, grass installed via homebrew.
I have a mega location with 532 read-only mapsets with each around 2500 mapsets
(plus PERMANENT and an read-write analysis mapset).
When using g.list type=rast mapset=* I get the following error: "Unable
to open directory". I guess this is caused by to many open files as I
can execute the command g.list type=rast mapset=... for this mapset
without problems.
(transcript below)
Is this the case? Could the error message be clarified (I fear not) or a
different approach be used to list the maps?
Thanks,
Rainer
,----
| simASM:grassAnalysis> g.list type=rast mapset=*
| ERROR: Unable to open directory
| /Users/rainerkrug/grassdata/simASM/simASM.CapePeninsula.Past.CapePeninsula_0_1.CapePeninsula.47712.2/cell
| simASM:grassAnalysis> g.list type=rast mapset=simASM.CapePeninsula.Past.CapePeninsula_0_1.CapePeninsula.47712.2 | wc -l
| 2615
| simASM:grassAnalysis> g.version -b -r -e --v
| GRASS 7.0.1 (2015)
|
| ./configure --prefix=/usr/local/Cellar/grass-70/7.0.1 --disable-debug --disable-dependency-tracking --enable-shared --with-cxx --with-python --with-blas --with-lapack --with-sqlite --with-odbc --with-geos=/usr/local/opt/geos/bin/geos-config --with-proj-share=/usr/local/opt/proj/share/proj --with-png --with-readline-includes=/usr/local/opt/readline/include --with-readline-libs=/usr/local/opt/readline/lib --with-readline --with-nls-includes=/usr/local/opt/gettext/include --with-nls-libs=/usr/local/opt/gettext/lib --with-nls --with-freetype --without-tcltk --with-includes=/usr/local/opt/gettext/include --with-wxwidgets=/usr/local/opt/wxmac/bin/wx-config --enable-64bit --with-macos-archs=x86_64 --with-cairo-includes=/usr/local/opt/cairo/include/cairo --with-cairo-libs=/usr/local/opt/cairo/lib --with-cairo --with-postgres --with-mysql-includes=/usr/local/opt/mysql/include/mysql --with-mysql-libs=/usr/local/opt/mysql/lib --with-mysql --with-liblas=/usr/local/opt/liblas/bin/liblas-config
| libgis Revision: 64733
| libgis Date: 2015-02-25 01:56:29 +0100 (Wed, 25 Feb 2015)
| PROJ.4: 4.9.1
| GDAL/OGR: 1.11.2
| GEOS: 3.4.2
| SQLite: 3.8.11.1
`----
--
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)
Centre of Excellence for Invasion Biology
Stellenbosch University
South Africa
Tel : +33 - (0)9 53 10 27 44
Cell: +33 - (0)6 85 62 59 98
Fax : +33 - (0)9 58 10 27 44
Fax (D): +49 - (0)3 21 21 25 22 44
email: Rainer@krugs.de
Skype: RMkrug
PGP: 0x0F52F982
On Mon, Nov 2, 2015 at 11:50 AM, Rainer M Krug <Rainer@krugs.de> wrote:
Hi
OS: OS X, El Capitan, grass installed via homebrew.
I have a mega location with 532 read-only mapsets with each around 2500 mapsets
(plus PERMANENT and an read-write analysis mapset).
When using g.list type=rast mapset=* I get the following error: "Unable
to open directory". I guess this is caused by to many open files as I
can execute the command g.list type=rast mapset=... for this mapset
without problems.
You likely hit the current setting of open files. See e.g. this page
how to set a higher limit:
https://grass.osgeo.org/grass70/manuals/r.series.html#management-of-open-file-limits
Please let us know how it goes.
Markus
Markus Neteler <neteler@osgeo.org> writes:
On Mon, Nov 2, 2015 at 11:50 AM, Rainer M Krug <Rainer@krugs.de> wrote:
Hi
OS: OS X, El Capitan, grass installed via homebrew.
I have a mega location with 532 read-only mapsets with each around 2500 mapsets
(plus PERMANENT and an read-write analysis mapset).
When using g.list type=rast mapset=* I get the following error: "Unable
to open directory". I guess this is caused by to many open files as I
can execute the command g.list type=rast mapset=... for this mapset
without problems.
You likely hit the current setting of open files. See e.g. this page
how to set a higher limit:
https://grass.osgeo.org/grass70/manuals/r.series.html#management-of-open-file-limits
Yes - that solved the issue. But I am wondering, if it really is
necessary to keep all these files open just to list the maps?
Thanks,
Rainer
Please let us know how it goes.
Markus
--
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)
Centre of Excellence for Invasion Biology
Stellenbosch University
South Africa
Tel : +33 - (0)9 53 10 27 44
Cell: +33 - (0)6 85 62 59 98
Fax : +33 - (0)9 58 10 27 44
Fax (D): +49 - (0)3 21 21 25 22 44
email: Rainer@krugs.de
Skype: RMkrug
PGP: 0x0F52F982
Rainer M Krug wrote:
I have a mega location with 532 read-only mapsets with each around 2500 mapsets
(plus PERMANENT and an read-write analysis mapset).
When using g.list type=rast mapset=* I get the following error: "Unable
to open directory". I guess this is caused by to many open files as I
can execute the command g.list type=rast mapset=... for this mapset
without problems.
(transcript below)
Is this the case? Could the error message be clarified (I fear not) or a
different approach be used to list the maps?
G_ls2() doesn't call closedir() when it has finished reading the
directory.
Fixed in trunk with r66719.
--
Glynn Clements <glynn@gclements.plus.com>
Glynn Clements <glynn@gclements.plus.com> writes:
Rainer M Krug wrote:
I have a mega location with 532 read-only mapsets with each around 2500 mapsets
(plus PERMANENT and an read-write analysis mapset).
When using g.list type=rast mapset=* I get the following error: "Unable
to open directory". I guess this is caused by to many open files as I
can execute the command g.list type=rast mapset=... for this mapset
without problems.
(transcript below)
Is this the case? Could the error message be clarified (I fear not) or a
different approach be used to list the maps?
G_ls2() doesn't call closedir() when it has finished reading the
directory.
Fixed in trunk with r66719.
Thanks.
I assume this will not be included in 7.0.2?
Rainer
--
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)
Centre of Excellence for Invasion Biology
Stellenbosch University
South Africa
Tel : +33 - (0)9 53 10 27 44
Cell: +33 - (0)6 85 62 59 98
Fax : +33 - (0)9 58 10 27 44
Fax (D): +49 - (0)3 21 21 25 22 44
email: Rainer@krugs.de
Skype: RMkrug
PGP: 0x0F52F982
On Tue, Nov 3, 2015 at 1:09 PM, Rainer M Krug <Rainer@krugs.de> wrote:
Glynn Clements <glynn@gclements.plus.com> writes:
G_ls2() doesn't call closedir() when it has finished reading the
directory.
Fixed in trunk with r66719.
Thanks.
I assume this will not be included in 7.0.2?
It will, already backported.
(but it didn't make it by some minutes into RC2).
Markus
Markus Neteler <neteler@osgeo.org> writes:
On Tue, Nov 3, 2015 at 1:09 PM, Rainer M Krug <Rainer@krugs.de> wrote:
Glynn Clements <glynn@gclements.plus.com> writes:
G_ls2() doesn't call closedir() when it has finished reading the
directory.
Fixed in trunk with r66719.
Thanks.
I assume this will not be included in 7.0.2?
It will, already backported.
Great - thanks
Rainer
(but it didn't make it by some minutes into RC2).
Markus
--
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)
Centre of Excellence for Invasion Biology
Stellenbosch University
South Africa
Tel : +33 - (0)9 53 10 27 44
Cell: +33 - (0)6 85 62 59 98
Fax : +33 - (0)9 58 10 27 44
Fax (D): +49 - (0)3 21 21 25 22 44
email: Rainer@krugs.de
Skype: RMkrug
PGP: 0x0F52F982
Rainer M Krug <Rainer@krugs.de> writes:
Markus Neteler <neteler@osgeo.org> writes:
On Mon, Nov 2, 2015 at 11:50 AM, Rainer M Krug <Rainer@krugs.de> wrote:
Hi
OS: OS X, El Capitan, grass installed via homebrew.
I have a mega location with 532 read-only mapsets with each around 2500 mapsets
(plus PERMANENT and an read-write analysis mapset).
When using g.list type=rast mapset=* I get the following error: "Unable
to open directory". I guess this is caused by to many open files as I
can execute the command g.list type=rast mapset=... for this mapset
without problems.
You likely hit the current setting of open files. See e.g. this page
how to set a higher limit:
https://grass.osgeo.org/grass70/manuals/r.series.html#management-of-open-file-limits
Just to add and possibly to be invcluded in the manual: on OS X the hard
limit is unlimited and the soft limit is 256.
Cheers,
Rainer
Yes - that solved the issue. But I am wondering, if it really is
necessary to keep all these files open just to list the maps?
Thanks,
Rainer
Please let us know how it goes.
Markus
--
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)
Centre of Excellence for Invasion Biology
Stellenbosch University
South Africa
Tel : +33 - (0)9 53 10 27 44
Cell: +33 - (0)6 85 62 59 98
Fax : +33 - (0)9 58 10 27 44
Fax (D): +49 - (0)3 21 21 25 22 44
email: Rainer@krugs.de
Skype: RMkrug
PGP: 0x0F52F982
On Thu, Nov 5, 2015 at 9:07 AM, Rainer M Krug <Rainer@krugs.de> wrote:
Just to add and possibly to be invcluded in the manual: on OS X the hard
limit is unlimited and the soft limit is 256.
maybe we should modify that part and refer to an overview page
describing the various operating systems?
Markus
Markus Neteler <neteler@osgeo.org> writes:
On Thu, Nov 5, 2015 at 9:07 AM, Rainer M Krug <Rainer@krugs.de> wrote:
Just to add and possibly to be invcluded in the manual: on OS X the hard
limit is unlimited and the soft limit is 256.
maybe we should modify that part and refer to an overview page
describing the various operating systems?
I think that would be a good idea as this likely can affect many scripts
and commands.
Apart from the offline documentation, this might even a candidate for
the wiki.
Rainer
Markus
--
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)
Centre of Excellence for Invasion Biology
Stellenbosch University
South Africa
Tel : +33 - (0)9 53 10 27 44
Cell: +33 - (0)6 85 62 59 98
Fax : +33 - (0)9 58 10 27 44
Fax (D): +49 - (0)3 21 21 25 22 44
email: Rainer@krugs.de
Skype: RMkrug
PGP: 0x0F52F982