[GRASS-user] Organizing locations and mapsets on NFS for teams

Hi,

I was wondering if someone knows some well-working solutions for collaborating on locations and mapsets in teams (“best practice”)?

Background: In my organization we have some 70 users working in different projects (n~120) (not all use GRASS though), where new data is generated or acquired which might be of wider interest throughout the organisation.

My aim is that data of common interest is shared in a common GRASS database on NFS. Yet the problem is that things might get messy with all project-mapsets, user-mapsets and “PERMANENT”-like mapsets in one location (in the light of the amount of available GIS data, one PERMANENT mapset appears to be no longer sufficient I guess, esp. when also space time datasets are hosted in the GRASS DB).

The solution described here: https://grasswiki.osgeo.org/wiki/Location_and_Mapsets with common GRASS DB on NFS linked into users home directory is somewhat sexy in order to keep the “user mapsets” out of the common GRASS GIS DB. The drawback however is, that users explicitly have to switch between the two GRASS DBs if they want to share data on NFS, if I understood the consequences correctly. Is someone aware of some nice “one-click- tools” which might be used to sync between home and NFS GRASS DB. Would one need to write a wrapper script around r./v.pack and r./v.unpack for such a job (if not entire (and tidy!) mapsets can be copied) to simplify synchronization for basic users?

In addition, if users generate one mapset for every dataset they might be willing to share, this may lead to way to many mapsets. Furthermore, such mapsets do not end up in the search path automatically as data in PERMANENT would… I was considering to group data as far as possible into INSPIRE themes / ISO topics (meaning one mapset per topic plus extra mapsets for time series data). But then different users would need to be able to add data in those mapsets meaning modify them (as it would be the case for PERMANENT cause there is not one person handling all data anyway)… Does someone work with a “data janitor user” others may “su” to in order to do general data maintenance?

How do you deal with mapsets for projects where different users collaborate? Do you use project name as a prefix followed by user name or something like this, so that mapsets for a project are grouped? Do you use project user accounts?

I am grateful for any recommendations or info on how others organize locations and mapsets in a collaborative environment…

Cheers

Stefan

On Thu, Oct 1, 2015 at 12:19 PM, Blumentrath, Stefan
<Stefan.Blumentrath@nina.no> wrote:
...

The solution described here:
https://grasswiki.osgeo.org/wiki/Location_and_Mapsets with common GRASS DB
on NFS linked into users home directory is somewhat sexy in order to keep
the “user mapsets” out of the common GRASS GIS DB. The drawback however is,
that users explicitly have to switch between the two GRASS DBs if they want
to share data on NFS, if I understood the consequences correctly.

Are you sure about this? Do you refer to the section "Student machine(s)"?

In my group, we simply have all in /grassdata/ which is on NFS
(actually with a big BeeGFS device behind).
Works nicely.

Markus

Hi Markus,

Thanks for your reply.
Yes, I was referring to the "Using GRASS GIS locations in a network"/"Student machine(s)" section. I overlooked the "NFS read-only reason" for this solution...

Do you (or anyone else) have a smart solution for keeping your locations on NFS tidy? Are you and your colleagues only very disciplined or do you have a kind of data care taker who cleans up the GRASS DB regularly and maybe archives expired projects?

Do you use specific naming conventions (esp. for mapsets but maybe also maps)? We copied the convention used on the wiki-page to name locations by CRS, but I am less sure what to do when it comes to mapsets... Here, I was considering using prefixes like "G_" for all mapsets of general interest (probably "GT_" for TGIS-mapsets) followed by a thematic name / keyword, "P_" followed by project name for project mapsets, and "U_" followed by user name for user mapsets... So at least these conceptually different mapset types group / order logicaly...

And how do you maintain the PERMANENT mapset(s) on NFS. Does only the creator of the location use / modify it? Are there any solutions for doing that in a collaborative approach (which might be used for other mapsets too)? I mean in terms of access rights...

Do you use a metadata repository to make it transparent for everybody what data is in what mapset?
  
Sorry for the bunch of questions. Using GRASS already helps a lot to have and keep the (growing amounts of) data well structured, but a description of recommended practices or field-proven solution might help users to get even more out of it...

Kind regards
Stefan

-----Original Message-----
From: neteler.osgeo@gmail.com [mailto:neteler.osgeo@gmail.com] On Behalf Of Markus Neteler
Sent: 4. oktober 2015 09:01
To: Blumentrath, Stefan <Stefan.Blumentrath@nina.no>
Cc: grass-user grass-user (grass-user@lists.osgeo.org) <grass-user@lists.osgeo.org>
Subject: Re: [GRASS-user] Organizing locations and mapsets on NFS for teams

On Thu, Oct 1, 2015 at 12:19 PM, Blumentrath, Stefan <Stefan.Blumentrath@nina.no> wrote:
...

The solution described here:
https://grasswiki.osgeo.org/wiki/Location_and_Mapsets with common
GRASS DB on NFS linked into users home directory is somewhat sexy in
order to keep the “user mapsets” out of the common GRASS GIS DB. The
drawback however is, that users explicitly have to switch between the
two GRASS DBs if they want to share data on NFS, if I understood the consequences correctly.

Are you sure about this? Do you refer to the section "Student machine(s)"?

In my group, we simply have all in /grassdata/ which is on NFS (actually with a big BeeGFS device behind).
Works nicely.

Markus

Hi again,

Two related things:
I just started collecting GRASS data which has been floating around in different GRASS DBs in my institute into one, central DB.
In that context I am implementing a kind of naming convention (like the one sketched below) in order to make the data order systematically.

My two questions are now:
1) Would it be much work to implement a filter in the Location and Mapset selection window, which would reduce the list to "mapsets owned by me" (e.g. in a tickbox), as these are the only ones I technically can use for working anyway?
2) Is it possible in the WX GUI to allow the user to change the distribution of horizontal space used for the "mapset box" and the "locations box", meaning, that I can make the mapset box wider myself if I have longer mapset names?

Would you consider it relevant enough for an enhancement ticket?

Kind regards,
Stefan

-----Original Message-----
From: grass-user-bounces@lists.osgeo.org [mailto:grass-user-bounces@lists.osgeo.org] On Behalf Of Blumentrath, Stefan
Sent: 4. oktober 2015 15:23
To: Markus Neteler <neteler@osgeo.org>
Cc: grass-user grass-user (grass-user@lists.osgeo.org) <grass-user@lists.osgeo.org>
Subject: Re: [GRASS-user] Organizing locations and mapsets on NFS for teams

Hi Markus,

Thanks for your reply.
Yes, I was referring to the "Using GRASS GIS locations in a network"/"Student machine(s)" section. I overlooked the "NFS read-only reason" for this solution...

Do you (or anyone else) have a smart solution for keeping your locations on NFS tidy? Are you and your colleagues only very disciplined or do you have a kind of data care taker who cleans up the GRASS DB regularly and maybe archives expired projects?

Do you use specific naming conventions (esp. for mapsets but maybe also maps)? We copied the convention used on the wiki-page to name locations by CRS, but I am less sure what to do when it comes to mapsets... Here, I was considering using prefixes like "G_" for all mapsets of general interest (probably "GT_" for TGIS-mapsets) followed by a thematic name / keyword, "P_" followed by project name for project mapsets, and "U_" followed by user name for user mapsets... So at least these conceptually different mapset types group / order logicaly...

And how do you maintain the PERMANENT mapset(s) on NFS. Does only the creator of the location use / modify it? Are there any solutions for doing that in a collaborative approach (which might be used for other mapsets too)? I mean in terms of access rights...

Do you use a metadata repository to make it transparent for everybody what data is in what mapset?
  
Sorry for the bunch of questions. Using GRASS already helps a lot to have and keep the (growing amounts of) data well structured, but a description of recommended practices or field-proven solution might help users to get even more out of it...

Kind regards
Stefan

-----Original Message-----
From: neteler.osgeo@gmail.com [mailto:neteler.osgeo@gmail.com] On Behalf Of Markus Neteler
Sent: 4. oktober 2015 09:01
To: Blumentrath, Stefan <Stefan.Blumentrath@nina.no>
Cc: grass-user grass-user (grass-user@lists.osgeo.org) <grass-user@lists.osgeo.org>
Subject: Re: [GRASS-user] Organizing locations and mapsets on NFS for teams

On Thu, Oct 1, 2015 at 12:19 PM, Blumentrath, Stefan <Stefan.Blumentrath@nina.no> wrote:
...

The solution described here:
https://grasswiki.osgeo.org/wiki/Location_and_Mapsets with common
GRASS DB on NFS linked into users home directory is somewhat sexy in
order to keep the “user mapsets” out of the common GRASS GIS DB. The
drawback however is, that users explicitly have to switch between the
two GRASS DBs if they want to share data on NFS, if I understood the consequences correctly.

Are you sure about this? Do you refer to the section "Student machine(s)"?

In my group, we simply have all in /grassdata/ which is on NFS (actually with a big BeeGFS device behind).
Works nicely.

Markus
_______________________________________________
grass-user mailing list
grass-user@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/grass-user

On Fri, Feb 5, 2016 at 3:55 AM, Blumentrath, Stefan <
Stefan.Blumentrath@nina.no> wrote:

Hi again,

Two related things:
I just started collecting GRASS data which has been floating around in
different GRASS DBs in my institute into one, central DB.
In that context I am implementing a kind of naming convention (like the
one sketched below) in order to make the data order systematically.

My two questions are now:
1) Would it be much work to implement a filter in the Location and Mapset
selection window, which would reduce the list to "mapsets owned by me"
(e.g. in a tickbox), as these are the only ones I technically can use for
working anyway?
2) Is it possible in the WX GUI to allow the user to change the
distribution of horizontal space used for the "mapset box" and the
"locations box", meaning, that I can make the mapset box wider myself if I
have longer mapset names?

Would you consider it relevant enough for an enhancement ticket?

yes, please create a ticket, at least the 2) should be easy.

Anna

Kind regards,
Stefan

-----Original Message-----
From: grass-user-bounces@lists.osgeo.org [mailto:
grass-user-bounces@lists.osgeo.org] On Behalf Of Blumentrath, Stefan
Sent: 4. oktober 2015 15:23
To: Markus Neteler <neteler@osgeo.org>
Cc: grass-user grass-user (grass-user@lists.osgeo.org) <
grass-user@lists.osgeo.org>
Subject: Re: [GRASS-user] Organizing locations and mapsets on NFS for teams

Hi Markus,

Thanks for your reply.
Yes, I was referring to the "Using GRASS GIS locations in a
network"/"Student machine(s)" section. I overlooked the "NFS read-only
reason" for this solution...

Do you (or anyone else) have a smart solution for keeping your locations
on NFS tidy? Are you and your colleagues only very disciplined or do you
have a kind of data care taker who cleans up the GRASS DB regularly and
maybe archives expired projects?

Do you use specific naming conventions (esp. for mapsets but maybe also
maps)? We copied the convention used on the wiki-page to name locations by
CRS, but I am less sure what to do when it comes to mapsets... Here, I was
considering using prefixes like "G_" for all mapsets of general interest
(probably "GT_" for TGIS-mapsets) followed by a thematic name / keyword,
"P_" followed by project name for project mapsets, and "U_" followed by
user name for user mapsets... So at least these conceptually different
mapset types group / order logicaly...

And how do you maintain the PERMANENT mapset(s) on NFS. Does only the
creator of the location use / modify it? Are there any solutions for doing
that in a collaborative approach (which might be used for other mapsets
too)? I mean in terms of access rights...

Do you use a metadata repository to make it transparent for everybody what
data is in what mapset?

Sorry for the bunch of questions. Using GRASS already helps a lot to have
and keep the (growing amounts of) data well structured, but a description
of recommended practices or field-proven solution might help users to get
even more out of it...

Kind regards
Stefan

-----Original Message-----
From: neteler.osgeo@gmail.com [mailto:neteler.osgeo@gmail.com] On Behalf
Of Markus Neteler
Sent: 4. oktober 2015 09:01
To: Blumentrath, Stefan <Stefan.Blumentrath@nina.no>
Cc: grass-user grass-user (grass-user@lists.osgeo.org) <
grass-user@lists.osgeo.org>
Subject: Re: [GRASS-user] Organizing locations and mapsets on NFS for teams

On Thu, Oct 1, 2015 at 12:19 PM, Blumentrath, Stefan <
Stefan.Blumentrath@nina.no> wrote:
...
> The solution described here:
> https://grasswiki.osgeo.org/wiki/Location_and_Mapsets with common
> GRASS DB on NFS linked into users home directory is somewhat sexy in
> order to keep the “user mapsets” out of the common GRASS GIS DB. The
> drawback however is, that users explicitly have to switch between the
> two GRASS DBs if they want to share data on NFS, if I understood the
consequences correctly.

Are you sure about this? Do you refer to the section "Student machine(s)"?

In my group, we simply have all in /grassdata/ which is on NFS (actually
with a big BeeGFS device behind).
Works nicely.

Markus
_______________________________________________
grass-user mailing list
grass-user@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/grass-user
_______________________________________________
grass-user mailing list
grass-user@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/grass-user