[GRASS-dev] Automatic/CI compilation on macOS

wenzeslaus · March 5, 2020, 3:58am

Dear all,

I made some updates towards updating the conda recipe for GRASS GIS on macOS by Eric Hutton, but it is not working yet. You can find the WIP PR here:

https://github.com/csdms-stack/grass-recipe/pull/1

You can see the current state in Travis linked from the PR or in GitHub Actions of my fork:

https://github.com/wenzeslaus/grass-recipe/tree/updates-for-7.8-and-above
https://github.com/wenzeslaus/grass-recipe/actions

If you think a different approach is more appropriate and want to try it out, you can consider contributing to the following repository which now, for example, contains a homebrew-osgeo4mac based branch. Again see the current state in GitHub Actions:

https://github.com/GRASS-GIS/grass-gis-experimental-ci/tree/homebrew-osgeo4mac

If you have some ideas for fixing the errors, please let me know, here, by PRs, issues, or links to other repos.

Thanks,

Vaclav

Rainer_Krug · March 5, 2020, 9:27am

OK - found the ci.

The formula installs, but I get a warning at the end, which results in a warning, which is than interpreted as an error. The warning (which I also get locally) is the following:

If it is the case that you can change the shebang at the beginning of

he script to enforce Python 3 usage.

#!/usr/bin/env python

Should be changed into

#!/usr/bin/env python3

I suspect that this needs to be done in GRASS itself?

Rainer

On 5 Mar 2020, at 09:40, Rainer Krug <rainer_krug@icloud.com> wrote:

Sorry for chiming in so late - haven’t followed GRASS closely and I might raise points which have already been discussed.

I can not comment on conda, as I never used it.

I made a fix on the home-brew-osgeo4mac branch as the test using for the brew test needs the name of the formula. I tried the installation and the brew test locally, and it works.

Where can I see the log from the ci?

There were also discussions on the R mailing list to support Conda, and it definitely has its user base, but O don’t think it is as widely used as home-brew. So supporting both would be the best option.

Especially, if I am not mistaken, the support for the osgeo4mac-grass formula for home-brew is already taken care of by osgeo4mac.

Cheers,

Rainer

On 5 Mar 2020, at 04:58, Vaclav Petras <wenzeslaus@gmail.com> wrote:

Dear all,

I made some updates towards updating the conda recipe for GRASS GIS on macOS by Eric Hutton, but it is not working yet. You can find the WIP PR here:

https://github.com/csdms-stack/grass-recipe/pull/1

You can see the current state in Travis linked from the PR or in GitHub Actions of my fork:

https://github.com/wenzeslaus/grass-recipe/tree/updates-for-7.8-and-above
https://github.com/wenzeslaus/grass-recipe/actions

If you think a different approach is more appropriate and want to try it out, you can consider contributing to the following repository which now, for example, contains a homebrew-osgeo4mac based branch. Again see the current state in GitHub Actions:

https://github.com/GRASS-GIS/grass-gis-experimental-ci/tree/homebrew-osgeo4mac

If you have some ideas for fixing the errors, please let me know, here, by PRs, issues, or links to other repos.

Thanks,

Vaclav

grass-dev mailing list
grass-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/grass-dev

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

wenzeslaus · March 5, 2020, 1:52pm

On Thu, Mar 5, 2020 at 4:27 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - found the ci.

The formula installs, but I get a warning at the end, which results in a warning, which is than interpreted as an error. The warning (which I also get locally) is the following:

If it is the case that you can change the shebang at the beginning of

he script to enforce Python 3 usage.

#!/usr/bin/env python

Should be changed into

#!/usr/bin/env python3

I suspect that this needs to be done in GRASS itself?

Hi, thanks for looking into this. 7.8.2 (and also above) has python3 everywhere in shebang. See e.g.:

$ grep -Irn “/usr/bin/env python[^3]”
scripts/g.extension/g.extension.py:1059: “#!/usr/bin/env python\n”,
scripts/g.extension/g.extension.py:1308: “#!/usr/bin/env python\n”,

(these two are in fact code which is doing the replacement to python3)

Can you please investigate locally where the message coming from?

Vaclav

Rainer_Krug · March 5, 2020, 3:22pm

On 5 Mar 2020, at 14:52, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 4:27 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - found the ci.

The formula installs, but I get a warning at the end, which results in a warning, which is than interpreted as an error. The warning (which I also get locally) is the following:

If it is the case that you can change the shebang at the beginning of

he script to enforce Python 3 usage.

#!/usr/bin/env python

Should be changed into

#!/usr/bin/env python3

I suspect that this needs to be done in GRASS itself?

Hi, thanks for looking into this. 7.8.2 (and also above) has python3 everywhere in shebang. See e.g.:

$ grep -Irn “/usr/bin/env python[^3]”
scripts/g.extension/g.extension.py:1059: “#!/usr/bin/env python\n”,
scripts/g.extension/g.extension.py:1308: “#!/usr/bin/env python\n”,

(these two are in fact code which is doing the replacement to python3)

Can you please investigate locally where the message coming from?

The message comes from the formula as a Caveat. I think it is always displayed. But at the moment, I am not to sure where the error code comes from, as I get an error code at the end of the brew command of 0 locally.

I will look into this.

Do you know, why there is a

uses: actions/checkout@v2

In the action?

It seems, that it will be executed last, and there is no checkout needed.

Rainer

Vaclav

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

Rainer_Krug · March 5, 2020, 3:28pm

On 5 Mar 2020, at 16:22, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 14:52, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 4:27 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - found the ci.

The formula installs, but I get a warning at the end, which results in a warning, which is than interpreted as an error. The warning (which I also get locally) is the following:

If it is the case that you can change the shebang at the beginning of

he script to enforce Python 3 usage.

#!/usr/bin/env python

Should be changed into

#!/usr/bin/env python3

I suspect that this needs to be done in GRASS itself?

Hi, thanks for looking into this. 7.8.2 (and also above) has python3 everywhere in shebang. See e.g.:

$ grep -Irn “/usr/bin/env python[^3]”
scripts/g.extension/g.extension.py:1059: “#!/usr/bin/env python\n”,
scripts/g.extension/g.extension.py:1308: “#!/usr/bin/env python\n”,

(these two are in fact code which is doing the replacement to python3)

Can you please investigate locally where the message coming from?

The message comes from the formula as a Caveat. I think it is always displayed. But at the moment, I am not to sure where the error code comes from, as I get an error code at the end of the brew command of 0 locally.

I will look into this.

Please ignore the following about the checkout.

Found it.

Do you know, why there is a

uses: actions/checkout@v2

In the action?

It seems, that it will be executed last, and there is no checkout needed.

Rainer

Vaclav

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

Rainer_Krug · March 5, 2020, 4:13pm

OK - one step closer to success. Now I just have to know the location where the data for the tests can be downloaded from (I guess). Please check the log to at https://github.com/GRASS-GIS/grass-gis-experimental-ci/runs/487969965?check_suite_focus=true for the Basic test and the Thorough test. I will look at the return code later, when the tests are running.

Rainer

On 5 Mar 2020, at 16:28, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 16:22, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 14:52, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 4:27 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - found the ci.

The formula installs, but I get a warning at the end, which results in a warning, which is than interpreted as an error. The warning (which I also get locally) is the following:

If it is the case that you can change the shebang at the beginning of

he script to enforce Python 3 usage.

#!/usr/bin/env python

Should be changed into

#!/usr/bin/env python3

I suspect that this needs to be done in GRASS itself?

Hi, thanks for looking into this. 7.8.2 (and also above) has python3 everywhere in shebang. See e.g.:

$ grep -Irn “/usr/bin/env python[^3]”
scripts/g.extension/g.extension.py:1059: “#!/usr/bin/env python\n”,
scripts/g.extension/g.extension.py:1308: “#!/usr/bin/env python\n”,

(these two are in fact code which is doing the replacement to python3)

Can you please investigate locally where the message coming from?

The message comes from the formula as a Caveat. I think it is always displayed. But at the moment, I am not to sure where the error code comes from, as I get an error code at the end of the brew command of 0 locally.

I will look into this.

Please ignore the following about the checkout.

Found it.

Do you know, why there is a

uses: actions/checkout@v2

In the action?

It seems, that it will be executed last, and there is no checkout needed.

Rainer

Vaclav

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

wenzeslaus · March 5, 2020, 4:53pm

On Thu, Mar 5, 2020 at 11:37 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - one step closer to success. Now I just have to know the location where the data for the tests can be downloaded from (I guess).

Everything is in the repo, well, it needs to be, I guess the only question is where in the repo, so:

https://github.com/GRASS-GIS/grass-gis-experimental-ci/blob/homebrew-osgeo4mac/test_thorough.sh

Please check the log to at https://github.com/GRASS-GIS/grass-gis-experimental-ci/runs/487969965?check_suite_focus=true for the Basic test and the Thorough test. I will look at the return code later, when the tests are running.

The problem there is probably a bad/missing path to PROJ db. I think it complains during the configuration already, so perhaps correct --with-proj-share will fix it. The runtime way of setting it is PROJ_LIB environmental variable. You can try something along these lines.

Rainer

On 5 Mar 2020, at 16:28, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 16:22, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 14:52, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 4:27 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - found the ci.

The formula installs, but I get a warning at the end, which results in a warning, which is than interpreted as an error. The warning (which I also get locally) is the following:

If it is the case that you can change the shebang at the beginning of

he script to enforce Python 3 usage.

#!/usr/bin/env python

Should be changed into

#!/usr/bin/env python3

I suspect that this needs to be done in GRASS itself?

Hi, thanks for looking into this. 7.8.2 (and also above) has python3 everywhere in shebang. See e.g.:

$ grep -Irn “/usr/bin/env python[^3]”
scripts/g.extension/g.extension.py:1059: “#!/usr/bin/env python\n”,
scripts/g.extension/g.extension.py:1308: “#!/usr/bin/env python\n”,

(these two are in fact code which is doing the replacement to python3)

Can you please investigate locally where the message coming from?

The message comes from the formula as a Caveat. I think it is always displayed. But at the moment, I am not to sure where the error code comes from, as I get an error code at the end of the brew command of 0 locally.

I will look into this.

Please ignore the following about the checkout.

Found it.

Do you know, why there is a

uses: actions/checkout@v2

In the action?

It seems, that it will be executed last, and there is no checkout needed.

Rainer

Vaclav

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

Rainer_Krug · March 5, 2020, 6:52pm

On 5 Mar 2020, at 17:53, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 11:37 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - one step closer to success. Now I just have to know the location where the data for the tests can be downloaded from (I guess).

Everything is in the repo, well, it needs to be, I guess the only question is where in the repo, so:

https://github.com/GRASS-GIS/grass-gis-experimental-ci/blob/homebrew-osgeo4mac/test_thorough.sh

Please check the log to at https://github.com/GRASS-GIS/grass-gis-experimental-ci/runs/487969965?check_suite_focus=true for the Basic test and the Thorough test. I will look at the return code later, when the tests are running.

The problem there is probably a bad/missing path to PROJ db. I think it complains during the configuration already, so perhaps correct --with-proj-share will fix it. The runtime way of setting it is PROJ_LIB environmental variable. You can try something along these lines.

I am trying to find the file proj.db but can’t find it - can you give me any indication, where it can be found in Linux (home-brew should use similar locations)?

Thanks,

Rainer

Rainer

On 5 Mar 2020, at 16:28, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 16:22, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 14:52, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 4:27 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - found the ci.

The formula installs, but I get a warning at the end, which results in a warning, which is than interpreted as an error. The warning (which I also get locally) is the following:

If it is the case that you can change the shebang at the beginning of

he script to enforce Python 3 usage.

#!/usr/bin/env python

Should be changed into

#!/usr/bin/env python3

I suspect that this needs to be done in GRASS itself?

Hi, thanks for looking into this. 7.8.2 (and also above) has python3 everywhere in shebang. See e.g.:

$ grep -Irn “/usr/bin/env python[^3]”
scripts/g.extension/g.extension.py:1059: “#!/usr/bin/env python\n”,
scripts/g.extension/g.extension.py:1308: “#!/usr/bin/env python\n”,

(these two are in fact code which is doing the replacement to python3)

Can you please investigate locally where the message coming from?

The message comes from the formula as a Caveat. I think it is always displayed. But at the moment, I am not to sure where the error code comes from, as I get an error code at the end of the brew command of 0 locally.

I will look into this.

Please ignore the following about the checkout.

Found it.

Do you know, why there is a

uses: actions/checkout@v2

In the action?

It seems, that it will be executed last, and there is no checkout needed.

Rainer

Vaclav

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

wenzeslaus · March 5, 2020, 8:38pm

On Thu, Mar 5, 2020 at 1:52 PM Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 17:53, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 11:37 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - one step closer to success. Now I just have to know the location where the data for the tests can be downloaded from (I guess).

Everything is in the repo, well, it needs to be, I guess the only question is where in the repo, so:

https://github.com/GRASS-GIS/grass-gis-experimental-ci/blob/homebrew-osgeo4mac/test_thorough.sh

Please check the log to at https://github.com/GRASS-GIS/grass-gis-experimental-ci/runs/487969965?check_suite_focus=true for the Basic test and the Thorough test. I will look at the return code later, when the tests are running.

The problem there is probably a bad/missing path to PROJ db. I think it complains during the configuration already, so perhaps correct --with-proj-share will fix it. The runtime way of setting it is PROJ_LIB environmental variable. You can try something along these lines.

I am trying to find the file proj.db but can’t find it - can you give me any indication, where it can be found in Linux (home-brew should use similar locations)?

Often it is in /usr/share/proj. Now you can find things like that in the Docker/Singularity/Vagrant configurations included in GRASS GIS source code or in the CIs, e.g., here:

https://github.com/GRASS-GIS/grass-gis-experimental-ci/blob/master/build.sh#L39

Rainer

On 5 Mar 2020, at 16:28, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 16:22, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 14:52, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 4:27 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - found the ci.

The formula installs, but I get a warning at the end, which results in a warning, which is than interpreted as an error. The warning (which I also get locally) is the following:

If it is the case that you can change the shebang at the beginning of

he script to enforce Python 3 usage.

#!/usr/bin/env python

Should be changed into

#!/usr/bin/env python3

I suspect that this needs to be done in GRASS itself?

Hi, thanks for looking into this. 7.8.2 (and also above) has python3 everywhere in shebang. See e.g.:

$ grep -Irn “/usr/bin/env python[^3]”
scripts/g.extension/g.extension.py:1059: “#!/usr/bin/env python\n”,
scripts/g.extension/g.extension.py:1308: “#!/usr/bin/env python\n”,

(these two are in fact code which is doing the replacement to python3)

Can you please investigate locally where the message coming from?

The message comes from the formula as a Caveat. I think it is always displayed. But at the moment, I am not to sure where the error code comes from, as I get an error code at the end of the brew command of 0 locally.

I will look into this.

Please ignore the following about the checkout.

Found it.

Do you know, why there is a

uses: actions/checkout@v2

In the action?

It seems, that it will be executed last, and there is no checkout needed.

Rainer

Vaclav

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

Rainer_Krug · March 6, 2020, 7:44am

OK. Looking at the parameters GRASS is compiled with (grass78 —config), I get the following proj related parameter (the complete output at the end of the email):

–with-proj-includes=/usr/local/opt/osgeo-proj/include
–with-proj-libs=/usr/local/opt/osgeo-proj/lib
–with-proj-share=/usr/local/opt/osgeo-proj/share/proj

Which seem to be correct, and proj.db is in the proj-share directory.

08:37 $ ls -la /usr/local/opt/osgeo-proj/share/proj

total 12408

drwxr-xr-x 15 rainerkrug staff 480 Feb 10 11:16 .

drwxr-xr-x 4 rainerkrug staff 128 Feb 10 11:16 …

-rw-r–r-- 1 rainerkrug staff 1183 Feb 10 11:16 CH

-rw-r–r-- 1 rainerkrug staff 728 Feb 10 11:16 GL27

-rw-r–r-- 1 rainerkrug staff 2099 Feb 10 11:16 ITRF2000

-rw-r–r-- 1 rainerkrug staff 3660 Feb 10 11:16 ITRF2008

-rw-r–r-- 1 rainerkrug staff 3468 Feb 10 11:16 ITRF2014

-rw-r–r-- 1 rainerkrug staff 6385 Feb 10 11:16 nad.lst

-rw-r–r-- 1 rainerkrug staff 19535 Feb 10 11:16 nad27

-rw-r–r-- 1 rainerkrug staff 16593 Feb 10 11:16 nad83

-rw-r–r-- 1 rainerkrug staff 232 Feb 10 11:16 null

-rw-r–r-- 1 rainerkrug staff 3915 Feb 10 11:16 other.extra

-rw-r–r-- 1 rainerkrug staff 6234112 Feb 10 11:16 proj.db

-rw-r–r-- 1 rainerkrug staff 32060 Feb 10 11:16 projjson.schema.json

-rw-r–r-- 1 rainerkrug staff 7079 Feb 10 11:16 world

So it looks fine, but I, even locally, get the following error when running the simple test:

08:40 $ grass78 --tmp-location EPSG:4326 --exec g.region res=0.1 -p

Starting GRASS GIS…

Creating new GRASS GIS location …

ERROR: b’proj_get_authorities_from_database: Cannot find proj.db

Here is the complete output from --config:

08:35 $ grass78 --config

x86_64-apple-darwin17.7.0

./configure --prefix=/usr/local/Cellar/osgeo-grass/7.8.2_3 --with-cxx --enable-shared --enable-largefile --with-nls --with-includes=/usr/local/include --with-libs=/usr/local/LIB --with-python=/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/vendor/bin/python-config --with-tcltk --with-netcdf=/usr/local/opt/osgeo-netcdf/bin/nc-config --with-zstd --with-zstd-includes=/usr/local/opt/zstd/include --with-zstd-libs=/usr/local/opt/zstd/lib --with-readline --with-readline-includes=/usr/local/opt/readline/include --with-readline-libs=/usr/local/opt/readline/lib --with-blas --with-blas-includes=/usr/local/opt/openblas/include --with-blas-libs=/usr/local/opt/openblas/lib --with-lapack --with-lapack-includes=/usr/local/opt/lapack/include --with-lapack-libs=/usr/local/opt/lapack/lib --with-geos=/usr/local/opt/geos/bin/geos-config --with-geos-includes=/usr/local/opt/geos/include --with-geos-libs=/usr/local/opt/geos/lib --with-odbc --with-odbc-includes=/usr/local/opt/unixodbc/include --with-odbc-libs=/usr/local/opt/unixodbc/lib --with-gdal=/usr/local/opt/osgeo-gdal/bin/gdal-config --with-zlib-includes=/usr/local/opt/zlib/include --with-zlib-libs=/usr/local/opt/zlib/lib --with-bzlib --with-bzlib-includes=/usr/local/opt/bzip2/include --with-bzlib-libs=/usr/local/opt/bzip2/lib --with-cairo --with-cairo-includes=/usr/local/opt/cairo/include/cairo --with-cairo-libs=/usr/local/opt/cairo/lib --with-cairo-ldflags=-lfontconfig --with-freetype --with-freetype-includes=/usr/local/opt/freetype/include/freetype2 --with-freetype-libs=/usr/local/opt/freetype/lib --with-proj-includes=/usr/local/opt/osgeo-proj/include --with-proj-libs=/usr/local/opt/osgeo-proj/lib --with-proj-share=/usr/local/opt/osgeo-proj/share/proj --with-tiff --with-tiff-includes=/usr/local/opt/libtiff/include --with-tiff-libs=/usr/local/opt/libtiff/lib --with-png --with-png-includes=/usr/local/opt/libpng/include --with-png-libs=/usr/local/opt/libpng/lib --with-regex --with-fftw --with-fftw-includes=/usr/local/opt/fftw/include --with-fftw-libs=/usr/local/opt/fftw/lib --with-sqlite --with-sqlite-includes=/usr/local/opt/sqlite/include --with-sqlite-libs=/usr/local/opt/sqlite/lib --with-liblas=/usr/local/opt/osgeo-liblas/bin/liblas-config --with-postgres --with-postgres-includes=/usr/local/opt/osgeo-postgresql/include --with-postgres-libs=/usr/local/opt/osgeo-postgresql/lib --with-mysql --with-mysql-includes=/usr/local/opt/mysql/include/mysql --with-mysql-libs=/usr/local/opt/mysql/lib --with-pthread --with-pthread-includes=/usr/local/opt/boost/include/boost/thread --with-pthread-libs=/usr/local/opt/boost/lib --with-macosx-sdk=/Applications/Xcode-10.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk --with-macosx-archs=x86_64 --with-opengl-includes=/Applications/Xcode-10.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/System/Library/Frameworks/OpenGL.framework/Headers --with-wxwidgets=/usr/local/opt/wxmac/bin/wx-config

clang

/usr/local/Cellar/osgeo-grass/7.8.2_3/grass78

Traceback (most recent call last):

File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 2025, in main

index = sys.argv.index(batch_exec_param)

ValueError: ‘–exec’ is not in list

During handling of the above exception, another exception occurred:

Traceback (most recent call last):

File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 2216, in

main()

File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 2030, in main

params = parse_cmdline(sys.argv[1:], default_gui=default_gui)

File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 1951, in parse_cmdline

print_params()

File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 1862, in print_params

“%s\n” % val[0].split(‘:’)[1].rstrip(‘$"\n’).strip())

IndexError: list index out of range

Any suggestions what the problem is?

Rainer

On 5 Mar 2020, at 21:38, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 1:52 PM Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 17:53, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 11:37 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - one step closer to success. Now I just have to know the location where the data for the tests can be downloaded from (I guess).

Everything is in the repo, well, it needs to be, I guess the only question is where in the repo, so:

https://github.com/GRASS-GIS/grass-gis-experimental-ci/blob/homebrew-osgeo4mac/test_thorough.sh

Please check the log to at https://github.com/GRASS-GIS/grass-gis-experimental-ci/runs/487969965?check_suite_focus=true for the Basic test and the Thorough test. I will look at the return code later, when the tests are running.

The problem there is probably a bad/missing path to PROJ db. I think it complains during the configuration already, so perhaps correct --with-proj-share will fix it. The runtime way of setting it is PROJ_LIB environmental variable. You can try something along these lines.

I am trying to find the file proj.db but can’t find it - can you give me any indication, where it can be found in Linux (home-brew should use similar locations)?

Often it is in /usr/share/proj. Now you can find things like that in the Docker/Singularity/Vagrant configurations included in GRASS GIS source code or in the CIs, e.g., here:

https://github.com/GRASS-GIS/grass-gis-experimental-ci/blob/master/build.sh#L39

Rainer

On 5 Mar 2020, at 16:28, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 16:22, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 14:52, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 4:27 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - found the ci.

The formula installs, but I get a warning at the end, which results in a warning, which is than interpreted as an error. The warning (which I also get locally) is the following:

If it is the case that you can change the shebang at the beginning of

he script to enforce Python 3 usage.

#!/usr/bin/env python

Should be changed into

#!/usr/bin/env python3

I suspect that this needs to be done in GRASS itself?

Hi, thanks for looking into this. 7.8.2 (and also above) has python3 everywhere in shebang. See e.g.:

$ grep -Irn “/usr/bin/env python[^3]”
scripts/g.extension/g.extension.py:1059: “#!/usr/bin/env python\n”,
scripts/g.extension/g.extension.py:1308: “#!/usr/bin/env python\n”,

(these two are in fact code which is doing the replacement to python3)

Can you please investigate locally where the message coming from?

The message comes from the formula as a Caveat. I think it is always displayed. But at the moment, I am not to sure where the error code comes from, as I get an error code at the end of the brew command of 0 locally.

I will look into this.

Please ignore the following about the checkout.

Found it.

Do you know, why there is a

uses: actions/checkout@v2

In the action?

It seems, that it will be executed last, and there is no checkout needed.

Rainer

Vaclav

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

Markus_Metz · March 6, 2020, 5:40pm

On Fri, Mar 6, 2020 at 8:50 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK. Looking at the parameters GRASS is compiled with (grass78 —config), I get the following proj related parameter (the complete output at the end of the email):

–with-proj-includes=/usr/local/opt/osgeo-proj/include
–with-proj-libs=/usr/local/opt/osgeo-proj/lib
–with-proj-share=/usr/local/opt/osgeo-proj/share/proj

Which seem to be correct, and proj.db is in the proj-share directory.

08:37 $ ls -la /usr/local/opt/osgeo-proj/share/proj
total 12408
drwxr-xr-x 15 rainerkrug staff 480 Feb 10 11:16 .
drwxr-xr-x 4 rainerkrug staff 128 Feb 10 11:16 …
-rw-r–r-- 1 rainerkrug staff 1183 Feb 10 11:16 CH
-rw-r–r-- 1 rainerkrug staff 728 Feb 10 11:16 GL27
-rw-r–r-- 1 rainerkrug staff 2099 Feb 10 11:16 ITRF2000
-rw-r–r-- 1 rainerkrug staff 3660 Feb 10 11:16 ITRF2008
-rw-r–r-- 1 rainerkrug staff 3468 Feb 10 11:16 ITRF2014
-rw-r–r-- 1 rainerkrug staff 6385 Feb 10 11:16 nad.lst
-rw-r–r-- 1 rainerkrug staff 19535 Feb 10 11:16 nad27
-rw-r–r-- 1 rainerkrug staff 16593 Feb 10 11:16 nad83
-rw-r–r-- 1 rainerkrug staff 232 Feb 10 11:16 null
-rw-r–r-- 1 rainerkrug staff 3915 Feb 10 11:16 other.extra
-rw-r–r-- 1 rainerkrug staff 6234112 Feb 10 11:16 proj.db
-rw-r–r-- 1 rainerkrug staff 32060 Feb 10 11:16 projjson.schema.json
-rw-r–r-- 1 rainerkrug staff 7079 Feb 10 11:16 world

So it looks fine, but I, even locally, get the following error when running the simple test:

08:40 $ grass78 --tmp-location EPSG:4326 --exec g.region res=0.1 -p
Starting GRASS GIS…
Creating new GRASS GIS location …
ERROR: b’proj_get_authorities_from_database: Cannot find proj.db

This error comes directly from PROJ.
Try

export PROJ_LIB=“usr/local/opt/osgeo-proj/share/proj”

before starting GRASS. This will tell PROJ where its own share data are.

Markus M

Here is the complete output from --config:

08:35 $ grass78 --config
x86_64-apple-darwin17.7.0
./configure --prefix=/usr/local/Cellar/osgeo-grass/7.8.2_3 --with-cxx --enable-shared --enable-largefile --with-nls --with-includes=/usr/local/include --with-libs=/usr/local/LIB --with-python=/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/vendor/bin/python-config --with-tcltk --with-netcdf=/usr/local/opt/osgeo-netcdf/bin/nc-config --with-zstd --with-zstd-includes=/usr/local/opt/zstd/include --with-zstd-libs=/usr/local/opt/zstd/lib --with-readline --with-readline-includes=/usr/local/opt/readline/include --with-readline-libs=/usr/local/opt/readline/lib --with-blas --with-blas-includes=/usr/local/opt/openblas/include --with-blas-libs=/usr/local/opt/openblas/lib --with-lapack --with-lapack-includes=/usr/local/opt/lapack/include --with-lapack-libs=/usr/local/opt/lapack/lib --with-geos=/usr/local/opt/geos/bin/geos-config --with-geos-includes=/usr/local/opt/geos/include --with-geos-libs=/usr/local/opt/geos/lib --with-odbc --with-odbc-includes=/usr/local/opt/unixodbc/include --with-odbc-libs=/usr/local/opt/unixodbc/lib --with-gdal=/usr/local/opt/osgeo-gdal/bin/gdal-config --with-zlib-includes=/usr/local/opt/zlib/include --with-zlib-libs=/usr/local/opt/zlib/lib --with-bzlib --with-bzlib-includes=/usr/local/opt/bzip2/include --with-bzlib-libs=/usr/local/opt/bzip2/lib --with-cairo --with-cairo-includes=/usr/local/opt/cairo/include/cairo --with-cairo-libs=/usr/local/opt/cairo/lib --with-cairo-ldflags=-lfontconfig --with-freetype --with-freetype-includes=/usr/local/opt/freetype/include/freetype2 --with-freetype-libs=/usr/local/opt/freetype/lib --with-proj-includes=/usr/local/opt/osgeo-proj/include --with-proj-libs=/usr/local/opt/osgeo-proj/lib --with-proj-share=/usr/local/opt/osgeo-proj/share/proj --with-tiff --with-tiff-includes=/usr/local/opt/libtiff/include --with-tiff-libs=/usr/local/opt/libtiff/lib --with-png --with-png-includes=/usr/local/opt/libpng/include --with-png-libs=/usr/local/opt/libpng/lib --with-regex --with-fftw --with-fftw-includes=/usr/local/opt/fftw/include --with-fftw-libs=/usr/local/opt/fftw/lib --with-sqlite --with-sqlite-includes=/usr/local/opt/sqlite/include --with-sqlite-libs=/usr/local/opt/sqlite/lib --with-liblas=/usr/local/opt/osgeo-liblas/bin/liblas-config --with-postgres --with-postgres-includes=/usr/local/opt/osgeo-postgresql/include --with-postgres-libs=/usr/local/opt/osgeo-postgresql/lib --with-mysql --with-mysql-includes=/usr/local/opt/mysql/include/mysql --with-mysql-libs=/usr/local/opt/mysql/lib --with-pthread --with-pthread-includes=/usr/local/opt/boost/include/boost/thread --with-pthread-libs=/usr/local/opt/boost/lib --with-macosx-sdk=/Applications/Xcode-10.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk --with-macosx-archs=x86_64 --with-opengl-includes=/Applications/Xcode-10.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/System/Library/Frameworks/OpenGL.framework/Headers --with-wxwidgets=/usr/local/opt/wxmac/bin/wx-config
clang
/usr/local/Cellar/osgeo-grass/7.8.2_3/grass78
Traceback (most recent call last):
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 2025, in main
index = sys.argv.index(batch_exec_param)
ValueError: ‘–exec’ is not in list

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 2216, in
main()
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 2030, in main
params = parse_cmdline(sys.argv[1:], default_gui=default_gui)
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 1951, in parse_cmdline
print_params()
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 1862, in print_params
“%s\n” % val[0].split(‘:’)[1].rstrip(‘$"\n’).strip())
IndexError: list index out of range

Any suggestions what the problem is?

Rainer

On 5 Mar 2020, at 21:38, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 1:52 PM Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 17:53, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 11:37 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - one step closer to success. Now I just have to know the location where the data for the tests can be downloaded from (I guess).

Everything is in the repo, well, it needs to be, I guess the only question is where in the repo, so:

https://github.com/GRASS-GIS/grass-gis-experimental-ci/blob/homebrew-osgeo4mac/test_thorough.sh

Please check the log to at https://github.com/GRASS-GIS/grass-gis-experimental-ci/runs/487969965?check_suite_focus=true for the Basic test and the Thorough test. I will look at the return code later, when the tests are running.

The problem there is probably a bad/missing path to PROJ db. I think it complains during the configuration already, so perhaps correct --with-proj-share will fix it. The runtime way of setting it is PROJ_LIB environmental variable. You can try something along these lines.

I am trying to find the file proj.db but can’t find it - can you give me any indication, where it can be found in Linux (home-brew should use similar locations)?

Often it is in /usr/share/proj. Now you can find things like that in the Docker/Singularity/Vagrant configurations included in GRASS GIS source code or in the CIs, e.g., here:

https://github.com/GRASS-GIS/grass-gis-experimental-ci/blob/master/build.sh#L39

Rainer

On 5 Mar 2020, at 16:28, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 16:22, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 14:52, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 4:27 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - found the ci.

The formula installs, but I get a warning at the end, which results in a warning, which is than interpreted as an error. The warning (which I also get locally) is the following:

If it is the case that you can change the shebang at the beginning of

he script to enforce Python 3 usage.

#!/usr/bin/env python

Should be changed into

#!/usr/bin/env python3

I suspect that this needs to be done in GRASS itself?

Hi, thanks for looking into this. 7.8.2 (and also above) has python3 everywhere in shebang. See e.g.:

$ grep -Irn “/usr/bin/env python[^3]”
scripts/g.extension/g.extension.py:1059: “#!/usr/bin/env python\n”,
scripts/g.extension/g.extension.py:1308: “#!/usr/bin/env python\n”,

(these two are in fact code which is doing the replacement to python3)

Can you please investigate locally where the message coming from?

The message comes from the formula as a Caveat. I think it is always displayed. But at the moment, I am not to sure where the error code comes from, as I get an error code at the end of the brew command of 0 locally.

I will look into this.

Please ignore the following about the checkout.

Found it.

Do you know, why there is a

uses: actions/checkout@v2

In the action?

It seems, that it will be executed last, and there is no checkout needed.

Rainer

Vaclav

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

grass-dev mailing list
grass-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/grass-dev

Rainer_Krug · March 8, 2020, 4:11pm

On 6 Mar 2020, at 18:40, Markus Metz <markus.metz.giswork@gmail.com> wrote:

On Fri, Mar 6, 2020 at 8:50 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK. Looking at the parameters GRASS is compiled with (grass78 —config), I get the following proj related parameter (the complete output at the end of the email):

–with-proj-includes=/usr/local/opt/osgeo-proj/include
–with-proj-libs=/usr/local/opt/osgeo-proj/lib
–with-proj-share=/usr/local/opt/osgeo-proj/share/proj

Which seem to be correct, and proj.db is in the proj-share directory.

08:37 $ ls -la /usr/local/opt/osgeo-proj/share/proj
total 12408
drwxr-xr-x 15 rainerkrug staff 480 Feb 10 11:16 .
drwxr-xr-x 4 rainerkrug staff 128 Feb 10 11:16 …
-rw-r–r-- 1 rainerkrug staff 1183 Feb 10 11:16 CH
-rw-r–r-- 1 rainerkrug staff 728 Feb 10 11:16 GL27
-rw-r–r-- 1 rainerkrug staff 2099 Feb 10 11:16 ITRF2000
-rw-r–r-- 1 rainerkrug staff 3660 Feb 10 11:16 ITRF2008
-rw-r–r-- 1 rainerkrug staff 3468 Feb 10 11:16 ITRF2014
-rw-r–r-- 1 rainerkrug staff 6385 Feb 10 11:16 nad.lst
-rw-r–r-- 1 rainerkrug staff 19535 Feb 10 11:16 nad27
-rw-r–r-- 1 rainerkrug staff 16593 Feb 10 11:16 nad83
-rw-r–r-- 1 rainerkrug staff 232 Feb 10 11:16 null
-rw-r–r-- 1 rainerkrug staff 3915 Feb 10 11:16 other.extra
-rw-r–r-- 1 rainerkrug staff 6234112 Feb 10 11:16 proj.db
-rw-r–r-- 1 rainerkrug staff 32060 Feb 10 11:16 projjson.schema.json
-rw-r–r-- 1 rainerkrug staff 7079 Feb 10 11:16 world

So it looks fine, but I, even locally, get the following error when running the simple test:

08:40 $ grass78 --tmp-location EPSG:4326 --exec g.region res=0.1 -p
Starting GRASS GIS…
Creating new GRASS GIS location …
ERROR: b’proj_get_authorities_from_database: Cannot find proj.db

This error comes directly from PROJ.
Try

export PROJ_LIB=“usr/local/opt/osgeo-proj/share/proj”

before starting GRASS. This will tell PROJ where its own share data are.

Does not work:

17:03 $ export PROJ_LIB=“/usr/local/opt/osgeo-proj/share/proj”

~

17:03 $ grass78 --tmp-location EPSG:4326 --exec g.region res=0.1 -p

Starting GRASS GIS…

Creating new GRASS GIS location …

ERROR: b’proj_get_authorities_from_database: Cannot find proj.db

Exiting…

✘-1 ~

17:03 $ ls -la /usr/local/opt/osgeo-proj/share/proj

total 12408

drwxr-xr-x 15 rainerkrug staff 480 Feb 10 11:16 .

drwxr-xr-x 4 rainerkrug staff 128 Feb 10 11:16 …

-rw-r–r-- 1 rainerkrug staff 1183 Feb 10 11:16 CH

-rw-r–r-- 1 rainerkrug staff 728 Feb 10 11:16 GL27

-rw-r–r-- 1 rainerkrug staff 2099 Feb 10 11:16 ITRF2000

-rw-r–r-- 1 rainerkrug staff 3660 Feb 10 11:16 ITRF2008

-rw-r–r-- 1 rainerkrug staff 3468 Feb 10 11:16 ITRF2014

-rw-r–r-- 1 rainerkrug staff 6385 Feb 10 11:16 nad.lst

-rw-r–r-- 1 rainerkrug staff 19535 Feb 10 11:16 nad27

-rw-r–r-- 1 rainerkrug staff 16593 Feb 10 11:16 nad83

-rw-r–r-- 1 rainerkrug staff 232 Feb 10 11:16 null

-rw-r–r-- 1 rainerkrug staff 3915 Feb 10 11:16 other.extra

-rw-r–r-- 1 rainerkrug staff 6234112 Feb 10 11:16 proj.db

-rw-r–r-- 1 rainerkrug staff 32060 Feb 10 11:16 projjson.schema.json

-rw-r–r-- 1 rainerkrug staff 7079 Feb 10 11:16 world

Any other suggestion?

Markus M

Here is the complete output from --config:

08:35 $ grass78 --config
x86_64-apple-darwin17.7.0
./configure --prefix=/usr/local/Cellar/osgeo-grass/7.8.2_3 --with-cxx --enable-shared --enable-largefile --with-nls --with-includes=/usr/local/include --with-libs=/usr/local/LIB --with-python=/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/vendor/bin/python-config --with-tcltk --with-netcdf=/usr/local/opt/osgeo-netcdf/bin/nc-config --with-zstd --with-zstd-includes=/usr/local/opt/zstd/include --with-zstd-libs=/usr/local/opt/zstd/lib --with-readline --with-readline-includes=/usr/local/opt/readline/include --with-readline-libs=/usr/local/opt/readline/lib --with-blas --with-blas-includes=/usr/local/opt/openblas/include --with-blas-libs=/usr/local/opt/openblas/lib --with-lapack --with-lapack-includes=/usr/local/opt/lapack/include --with-lapack-libs=/usr/local/opt/lapack/lib --with-geos=/usr/local/opt/geos/bin/geos-config --with-geos-includes=/usr/local/opt/geos/include --with-geos-libs=/usr/local/opt/geos/lib --with-odbc --with-odbc-includes=/usr/local/opt/unixodbc/include --with-odbc-libs=/usr/local/opt/unixodbc/lib --with-gdal=/usr/local/opt/osgeo-gdal/bin/gdal-config --with-zlib-includes=/usr/local/opt/zlib/include --with-zlib-libs=/usr/local/opt/zlib/lib --with-bzlib --with-bzlib-includes=/usr/local/opt/bzip2/include --with-bzlib-libs=/usr/local/opt/bzip2/lib --with-cairo --with-cairo-includes=/usr/local/opt/cairo/include/cairo --with-cairo-libs=/usr/local/opt/cairo/lib --with-cairo-ldflags=-lfontconfig --with-freetype --with-freetype-includes=/usr/local/opt/freetype/include/freetype2 --with-freetype-libs=/usr/local/opt/freetype/lib --with-proj-includes=/usr/local/opt/osgeo-proj/include --with-proj-libs=/usr/local/opt/osgeo-proj/lib --with-proj-share=/usr/local/opt/osgeo-proj/share/proj --with-tiff --with-tiff-includes=/usr/local/opt/libtiff/include --with-tiff-libs=/usr/local/opt/libtiff/lib --with-png --with-png-includes=/usr/local/opt/libpng/include --with-png-libs=/usr/local/opt/libpng/lib --with-regex --with-fftw --with-fftw-includes=/usr/local/opt/fftw/include --with-fftw-libs=/usr/local/opt/fftw/lib --with-sqlite --with-sqlite-includes=/usr/local/opt/sqlite/include --with-sqlite-libs=/usr/local/opt/sqlite/lib --with-liblas=/usr/local/opt/osgeo-liblas/bin/liblas-config --with-postgres --with-postgres-includes=/usr/local/opt/osgeo-postgresql/include --with-postgres-libs=/usr/local/opt/osgeo-postgresql/lib --with-mysql --with-mysql-includes=/usr/local/opt/mysql/include/mysql --with-mysql-libs=/usr/local/opt/mysql/lib --with-pthread --with-pthread-includes=/usr/local/opt/boost/include/boost/thread --with-pthread-libs=/usr/local/opt/boost/lib --with-macosx-sdk=/Applications/Xcode-10.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk --with-macosx-archs=x86_64 --with-opengl-includes=/Applications/Xcode-10.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/System/Library/Frameworks/OpenGL.framework/Headers --with-wxwidgets=/usr/local/opt/wxmac/bin/wx-config
clang
/usr/local/Cellar/osgeo-grass/7.8.2_3/grass78
Traceback (most recent call last):
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 2025, in main
index = sys.argv.index(batch_exec_param)
ValueError: ‘–exec’ is not in list

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 2216, in
main()
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 2030, in main
params = parse_cmdline(sys.argv[1:], default_gui=default_gui)
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 1951, in parse_cmdline
print_params()
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 1862, in print_params
“%s\n” % val[0].split(‘:’)[1].rstrip(‘$"\n’).strip())
IndexError: list index out of range

Any suggestions what the problem is?

Rainer

On 5 Mar 2020, at 21:38, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 1:52 PM Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 17:53, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 11:37 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - one step closer to success. Now I just have to know the location where the data for the tests can be downloaded from (I guess).

Everything is in the repo, well, it needs to be, I guess the only question is where in the repo, so:

https://github.com/GRASS-GIS/grass-gis-experimental-ci/blob/homebrew-osgeo4mac/test_thorough.sh

Please check the log to at https://github.com/GRASS-GIS/grass-gis-experimental-ci/runs/487969965?check_suite_focus=true for the Basic test and the Thorough test. I will look at the return code later, when the tests are running.

The problem there is probably a bad/missing path to PROJ db. I think it complains during the configuration already, so perhaps correct --with-proj-share will fix it. The runtime way of setting it is PROJ_LIB environmental variable. You can try something along these lines.

I am trying to find the file proj.db but can’t find it - can you give me any indication, where it can be found in Linux (home-brew should use similar locations)?

Often it is in /usr/share/proj. Now you can find things like that in the Docker/Singularity/Vagrant configurations included in GRASS GIS source code or in the CIs, e.g., here:

https://github.com/GRASS-GIS/grass-gis-experimental-ci/blob/master/build.sh#L39

Rainer

On 5 Mar 2020, at 16:28, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 16:22, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 14:52, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 4:27 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - found the ci.

The formula installs, but I get a warning at the end, which results in a warning, which is than interpreted as an error. The warning (which I also get locally) is the following:

If it is the case that you can change the shebang at the beginning of

he script to enforce Python 3 usage.

#!/usr/bin/env python

Should be changed into

#!/usr/bin/env python3

I suspect that this needs to be done in GRASS itself?

Hi, thanks for looking into this. 7.8.2 (and also above) has python3 everywhere in shebang. See e.g.:

$ grep -Irn “/usr/bin/env python[^3]”
scripts/g.extension/g.extension.py:1059: “#!/usr/bin/env python\n”,
scripts/g.extension/g.extension.py:1308: “#!/usr/bin/env python\n”,

(these two are in fact code which is doing the replacement to python3)

Can you please investigate locally where the message coming from?

The message comes from the formula as a Caveat. I think it is always displayed. But at the moment, I am not to sure where the error code comes from, as I get an error code at the end of the brew command of 0 locally.

I will look into this.

Please ignore the following about the checkout.

Found it.

Do you know, why there is a

uses: actions/checkout@v2

In the action?

It seems, that it will be executed last, and there is no checkout needed.

Rainer

Vaclav

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

grass-dev mailing list
grass-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/grass-dev

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

wenzeslaus · March 31, 2020, 1:50am

Hi Rainer,

Unfortunately, I don’t have any update for this, but I thought I will (inter-)link a detailed analysis on grass-user by Veronika and related PR:

[GRASS-user] Problems on MacOS Catalina Installation via Homebrew “Cannot find proj.db”
https://lists.osgeo.org/pipermail/grass-user/2020-March/081377.html

[Bug] Update build GRASS as macOS application #457 (linked comment and below)

https://github.com/OSGeo/grass/issues/457#issuecomment-603575140

Vaclav

On Sun, Mar 8, 2020 at 12:35 PM Rainer M Krug <Rainer@krugs.de> wrote:

On 6 Mar 2020, at 18:40, Markus Metz <markus.metz.giswork@gmail.com> wrote:

On Fri, Mar 6, 2020 at 8:50 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK. Looking at the parameters GRASS is compiled with (grass78 —config), I get the following proj related parameter (the complete output at the end of the email):

–with-proj-includes=/usr/local/opt/osgeo-proj/include
–with-proj-libs=/usr/local/opt/osgeo-proj/lib
–with-proj-share=/usr/local/opt/osgeo-proj/share/proj

Which seem to be correct, and proj.db is in the proj-share directory.

08:37 $ ls -la /usr/local/opt/osgeo-proj/share/proj
total 12408
drwxr-xr-x 15 rainerkrug staff 480 Feb 10 11:16 .
drwxr-xr-x 4 rainerkrug staff 128 Feb 10 11:16 …
-rw-r–r-- 1 rainerkrug staff 1183 Feb 10 11:16 CH
-rw-r–r-- 1 rainerkrug staff 728 Feb 10 11:16 GL27
-rw-r–r-- 1 rainerkrug staff 2099 Feb 10 11:16 ITRF2000
-rw-r–r-- 1 rainerkrug staff 3660 Feb 10 11:16 ITRF2008
-rw-r–r-- 1 rainerkrug staff 3468 Feb 10 11:16 ITRF2014
-rw-r–r-- 1 rainerkrug staff 6385 Feb 10 11:16 nad.lst
-rw-r–r-- 1 rainerkrug staff 19535 Feb 10 11:16 nad27
-rw-r–r-- 1 rainerkrug staff 16593 Feb 10 11:16 nad83
-rw-r–r-- 1 rainerkrug staff 232 Feb 10 11:16 null
-rw-r–r-- 1 rainerkrug staff 3915 Feb 10 11:16 other.extra
-rw-r–r-- 1 rainerkrug staff 6234112 Feb 10 11:16 proj.db
-rw-r–r-- 1 rainerkrug staff 32060 Feb 10 11:16 projjson.schema.json
-rw-r–r-- 1 rainerkrug staff 7079 Feb 10 11:16 world

So it looks fine, but I, even locally, get the following error when running the simple test:

08:40 $ grass78 --tmp-location EPSG:4326 --exec g.region res=0.1 -p
Starting GRASS GIS…
Creating new GRASS GIS location …
ERROR: b’proj_get_authorities_from_database: Cannot find proj.db

This error comes directly from PROJ.
Try

export PROJ_LIB=“usr/local/opt/osgeo-proj/share/proj”

before starting GRASS. This will tell PROJ where its own share data are.

Does not work:

17:03 $ export PROJ_LIB=“/usr/local/opt/osgeo-proj/share/proj”

~

17:03 $ grass78 --tmp-location EPSG:4326 --exec g.region res=0.1 -p

Starting GRASS GIS…

Creating new GRASS GIS location …

ERROR: b’proj_get_authorities_from_database: Cannot find proj.db

Exiting…

✘-1 ~

17:03 $ ls -la /usr/local/opt/osgeo-proj/share/proj

total 12408

drwxr-xr-x 15 rainerkrug staff 480 Feb 10 11:16 .

drwxr-xr-x 4 rainerkrug staff 128 Feb 10 11:16 …

-rw-r–r-- 1 rainerkrug staff 1183 Feb 10 11:16 CH

-rw-r–r-- 1 rainerkrug staff 728 Feb 10 11:16 GL27

-rw-r–r-- 1 rainerkrug staff 2099 Feb 10 11:16 ITRF2000

-rw-r–r-- 1 rainerkrug staff 3660 Feb 10 11:16 ITRF2008

-rw-r–r-- 1 rainerkrug staff 3468 Feb 10 11:16 ITRF2014

-rw-r–r-- 1 rainerkrug staff 6385 Feb 10 11:16 nad.lst

-rw-r–r-- 1 rainerkrug staff 19535 Feb 10 11:16 nad27

-rw-r–r-- 1 rainerkrug staff 16593 Feb 10 11:16 nad83

-rw-r–r-- 1 rainerkrug staff 232 Feb 10 11:16 null

-rw-r–r-- 1 rainerkrug staff 3915 Feb 10 11:16 other.extra

-rw-r–r-- 1 rainerkrug staff 6234112 Feb 10 11:16 proj.db

-rw-r–r-- 1 rainerkrug staff 32060 Feb 10 11:16 projjson.schema.json

-rw-r–r-- 1 rainerkrug staff 7079 Feb 10 11:16 world

Any other suggestion?

Markus M

Here is the complete output from --config:

08:35 $ grass78 --config
x86_64-apple-darwin17.7.0
./configure --prefix=/usr/local/Cellar/osgeo-grass/7.8.2_3 --with-cxx --enable-shared --enable-largefile --with-nls --with-includes=/usr/local/include --with-libs=/usr/local/LIB --with-python=/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/vendor/bin/python-config --with-tcltk --with-netcdf=/usr/local/opt/osgeo-netcdf/bin/nc-config --with-zstd --with-zstd-includes=/usr/local/opt/zstd/include --with-zstd-libs=/usr/local/opt/zstd/lib --with-readline --with-readline-includes=/usr/local/opt/readline/include --with-readline-libs=/usr/local/opt/readline/lib --with-blas --with-blas-includes=/usr/local/opt/openblas/include --with-blas-libs=/usr/local/opt/openblas/lib --with-lapack --with-lapack-includes=/usr/local/opt/lapack/include --with-lapack-libs=/usr/local/opt/lapack/lib --with-geos=/usr/local/opt/geos/bin/geos-config --with-geos-includes=/usr/local/opt/geos/include --with-geos-libs=/usr/local/opt/geos/lib --with-odbc --with-odbc-includes=/usr/local/opt/unixodbc/include --with-odbc-libs=/usr/local/opt/unixodbc/lib --with-gdal=/usr/local/opt/osgeo-gdal/bin/gdal-config --with-zlib-includes=/usr/local/opt/zlib/include --with-zlib-libs=/usr/local/opt/zlib/lib --with-bzlib --with-bzlib-includes=/usr/local/opt/bzip2/include --with-bzlib-libs=/usr/local/opt/bzip2/lib --with-cairo --with-cairo-includes=/usr/local/opt/cairo/include/cairo --with-cairo-libs=/usr/local/opt/cairo/lib --with-cairo-ldflags=-lfontconfig --with-freetype --with-freetype-includes=/usr/local/opt/freetype/include/freetype2 --with-freetype-libs=/usr/local/opt/freetype/lib --with-proj-includes=/usr/local/opt/osgeo-proj/include --with-proj-libs=/usr/local/opt/osgeo-proj/lib --with-proj-share=/usr/local/opt/osgeo-proj/share/proj --with-tiff --with-tiff-includes=/usr/local/opt/libtiff/include --with-tiff-libs=/usr/local/opt/libtiff/lib --with-png --with-png-includes=/usr/local/opt/libpng/include --with-png-libs=/usr/local/opt/libpng/lib --with-regex --with-fftw --with-fftw-includes=/usr/local/opt/fftw/include --with-fftw-libs=/usr/local/opt/fftw/lib --with-sqlite --with-sqlite-includes=/usr/local/opt/sqlite/include --with-sqlite-libs=/usr/local/opt/sqlite/lib --with-liblas=/usr/local/opt/osgeo-liblas/bin/liblas-config --with-postgres --with-postgres-includes=/usr/local/opt/osgeo-postgresql/include --with-postgres-libs=/usr/local/opt/osgeo-postgresql/lib --with-mysql --with-mysql-includes=/usr/local/opt/mysql/include/mysql --with-mysql-libs=/usr/local/opt/mysql/lib --with-pthread --with-pthread-includes=/usr/local/opt/boost/include/boost/thread --with-pthread-libs=/usr/local/opt/boost/lib --with-macosx-sdk=/Applications/Xcode-10.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk --with-macosx-archs=x86_64 --with-opengl-includes=/Applications/Xcode-10.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/System/Library/Frameworks/OpenGL.framework/Headers --with-wxwidgets=/usr/local/opt/wxmac/bin/wx-config
clang
/usr/local/Cellar/osgeo-grass/7.8.2_3/grass78
Traceback (most recent call last):
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 2025, in main
index = sys.argv.index(batch_exec_param)
ValueError: ‘–exec’ is not in list

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 2216, in
main()
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 2030, in main
params = parse_cmdline(sys.argv[1:], default_gui=default_gui)
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 1951, in parse_cmdline
print_params()
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 1862, in print_params
“%s\n” % val[0].split(‘:’)[1].rstrip(‘$"\n’).strip())
IndexError: list index out of range

Any suggestions what the problem is?

Rainer

On 5 Mar 2020, at 21:38, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 1:52 PM Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 17:53, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 11:37 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - one step closer to success. Now I just have to know the location where the data for the tests can be downloaded from (I guess).

Everything is in the repo, well, it needs to be, I guess the only question is where in the repo, so:

https://github.com/GRASS-GIS/grass-gis-experimental-ci/blob/homebrew-osgeo4mac/test_thorough.sh

Please check the log to at https://github.com/GRASS-GIS/grass-gis-experimental-ci/runs/487969965?check_suite_focus=true for the Basic test and the Thorough test. I will look at the return code later, when the tests are running.

The problem there is probably a bad/missing path to PROJ db. I think it complains during the configuration already, so perhaps correct --with-proj-share will fix it. The runtime way of setting it is PROJ_LIB environmental variable. You can try something along these lines.

I am trying to find the file proj.db but can’t find it - can you give me any indication, where it can be found in Linux (home-brew should use similar locations)?

Often it is in /usr/share/proj. Now you can find things like that in the Docker/Singularity/Vagrant configurations included in GRASS GIS source code or in the CIs, e.g., here:

https://github.com/GRASS-GIS/grass-gis-experimental-ci/blob/master/build.sh#L39

Rainer

On 5 Mar 2020, at 16:28, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 16:22, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 14:52, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 4:27 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - found the ci.

The formula installs, but I get a warning at the end, which results in a warning, which is than interpreted as an error. The warning (which I also get locally) is the following:

If it is the case that you can change the shebang at the beginning of

he script to enforce Python 3 usage.

#!/usr/bin/env python

Should be changed into

#!/usr/bin/env python3

I suspect that this needs to be done in GRASS itself?

Hi, thanks for looking into this. 7.8.2 (and also above) has python3 everywhere in shebang. See e.g.:

$ grep -Irn “/usr/bin/env python[^3]”
scripts/g.extension/g.extension.py:1059: “#!/usr/bin/env python\n”,
scripts/g.extension/g.extension.py:1308: “#!/usr/bin/env python\n”,

(these two are in fact code which is doing the replacement to python3)

Can you please investigate locally where the message coming from?

The message comes from the formula as a Caveat. I think it is always displayed. But at the moment, I am not to sure where the error code comes from, as I get an error code at the end of the brew command of 0 locally.

I will look into this.

Please ignore the following about the checkout.

Found it.

Do you know, why there is a

uses: actions/checkout@v2

In the action?

It seems, that it will be executed last, and there is no checkout needed.

Rainer

Vaclav

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

grass-dev mailing list
grass-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/grass-dev

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

Rainer_Krug · March 31, 2020, 12:53pm

Thanks Vaclav

I will wait and see.If you could please post here if something happens, as I am not following grass-user?

Thanks,

Rainer

On 31 Mar 2020, at 03:50, Vaclav Petras <wenzeslaus@gmail.com> wrote:

Hi Rainer,

Unfortunately, I don’t have any update for this, but I thought I will (inter-)link a detailed analysis on grass-user by Veronika and related PR:

[GRASS-user] Problems on MacOS Catalina Installation via Homebrew “Cannot find proj.db”
https://lists.osgeo.org/pipermail/grass-user/2020-March/081377.html

[Bug] Update build GRASS as macOS application #457 (linked comment and below)

https://github.com/OSGeo/grass/issues/457#issuecomment-603575140

Vaclav

On Sun, Mar 8, 2020 at 12:35 PM Rainer M Krug <Rainer@krugs.de> wrote:

On 6 Mar 2020, at 18:40, Markus Metz <markus.metz.giswork@gmail.com> wrote:

On Fri, Mar 6, 2020 at 8:50 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK. Looking at the parameters GRASS is compiled with (grass78 —config), I get the following proj related parameter (the complete output at the end of the email):

–with-proj-includes=/usr/local/opt/osgeo-proj/include
–with-proj-libs=/usr/local/opt/osgeo-proj/lib
–with-proj-share=/usr/local/opt/osgeo-proj/share/proj

Which seem to be correct, and proj.db is in the proj-share directory.

08:37 $ ls -la /usr/local/opt/osgeo-proj/share/proj
total 12408
drwxr-xr-x 15 rainerkrug staff 480 Feb 10 11:16 .
drwxr-xr-x 4 rainerkrug staff 128 Feb 10 11:16 …
-rw-r–r-- 1 rainerkrug staff 1183 Feb 10 11:16 CH
-rw-r–r-- 1 rainerkrug staff 728 Feb 10 11:16 GL27
-rw-r–r-- 1 rainerkrug staff 2099 Feb 10 11:16 ITRF2000
-rw-r–r-- 1 rainerkrug staff 3660 Feb 10 11:16 ITRF2008
-rw-r–r-- 1 rainerkrug staff 3468 Feb 10 11:16 ITRF2014
-rw-r–r-- 1 rainerkrug staff 6385 Feb 10 11:16 nad.lst
-rw-r–r-- 1 rainerkrug staff 19535 Feb 10 11:16 nad27
-rw-r–r-- 1 rainerkrug staff 16593 Feb 10 11:16 nad83
-rw-r–r-- 1 rainerkrug staff 232 Feb 10 11:16 null
-rw-r–r-- 1 rainerkrug staff 3915 Feb 10 11:16 other.extra
-rw-r–r-- 1 rainerkrug staff 6234112 Feb 10 11:16 proj.db
-rw-r–r-- 1 rainerkrug staff 32060 Feb 10 11:16 projjson.schema.json
-rw-r–r-- 1 rainerkrug staff 7079 Feb 10 11:16 world

So it looks fine, but I, even locally, get the following error when running the simple test:

08:40 $ grass78 --tmp-location EPSG:4326 --exec g.region res=0.1 -p
Starting GRASS GIS…
Creating new GRASS GIS location …
ERROR: b’proj_get_authorities_from_database: Cannot find proj.db

This error comes directly from PROJ.
Try

export PROJ_LIB=“usr/local/opt/osgeo-proj/share/proj”

before starting GRASS. This will tell PROJ where its own share data are.

Does not work:

17:03 $ export PROJ_LIB=“/usr/local/opt/osgeo-proj/share/proj”

~

17:03 $ grass78 --tmp-location EPSG:4326 --exec g.region res=0.1 -p

Starting GRASS GIS…

Creating new GRASS GIS location …

ERROR: b’proj_get_authorities_from_database: Cannot find proj.db

Exiting…

✘-1 ~

17:03 $ ls -la /usr/local/opt/osgeo-proj/share/proj

total 12408

drwxr-xr-x 15 rainerkrug staff 480 Feb 10 11:16 .

drwxr-xr-x 4 rainerkrug staff 128 Feb 10 11:16 …

-rw-r–r-- 1 rainerkrug staff 1183 Feb 10 11:16 CH

-rw-r–r-- 1 rainerkrug staff 728 Feb 10 11:16 GL27

-rw-r–r-- 1 rainerkrug staff 2099 Feb 10 11:16 ITRF2000

-rw-r–r-- 1 rainerkrug staff 3660 Feb 10 11:16 ITRF2008

-rw-r–r-- 1 rainerkrug staff 3468 Feb 10 11:16 ITRF2014

-rw-r–r-- 1 rainerkrug staff 6385 Feb 10 11:16 nad.lst

-rw-r–r-- 1 rainerkrug staff 19535 Feb 10 11:16 nad27

-rw-r–r-- 1 rainerkrug staff 16593 Feb 10 11:16 nad83

-rw-r–r-- 1 rainerkrug staff 232 Feb 10 11:16 null

-rw-r–r-- 1 rainerkrug staff 3915 Feb 10 11:16 other.extra

-rw-r–r-- 1 rainerkrug staff 6234112 Feb 10 11:16 proj.db

-rw-r–r-- 1 rainerkrug staff 32060 Feb 10 11:16 projjson.schema.json

-rw-r–r-- 1 rainerkrug staff 7079 Feb 10 11:16 world

Any other suggestion?

Markus M

Here is the complete output from --config:

08:35 $ grass78 --config
x86_64-apple-darwin17.7.0
./configure --prefix=/usr/local/Cellar/osgeo-grass/7.8.2_3 --with-cxx --enable-shared --enable-largefile --with-nls --with-includes=/usr/local/include --with-libs=/usr/local/LIB --with-python=/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/vendor/bin/python-config --with-tcltk --with-netcdf=/usr/local/opt/osgeo-netcdf/bin/nc-config --with-zstd --with-zstd-includes=/usr/local/opt/zstd/include --with-zstd-libs=/usr/local/opt/zstd/lib --with-readline --with-readline-includes=/usr/local/opt/readline/include --with-readline-libs=/usr/local/opt/readline/lib --with-blas --with-blas-includes=/usr/local/opt/openblas/include --with-blas-libs=/usr/local/opt/openblas/lib --with-lapack --with-lapack-includes=/usr/local/opt/lapack/include --with-lapack-libs=/usr/local/opt/lapack/lib --with-geos=/usr/local/opt/geos/bin/geos-config --with-geos-includes=/usr/local/opt/geos/include --with-geos-libs=/usr/local/opt/geos/lib --with-odbc --with-odbc-includes=/usr/local/opt/unixodbc/include --with-odbc-libs=/usr/local/opt/unixodbc/lib --with-gdal=/usr/local/opt/osgeo-gdal/bin/gdal-config --with-zlib-includes=/usr/local/opt/zlib/include --with-zlib-libs=/usr/local/opt/zlib/lib --with-bzlib --with-bzlib-includes=/usr/local/opt/bzip2/include --with-bzlib-libs=/usr/local/opt/bzip2/lib --with-cairo --with-cairo-includes=/usr/local/opt/cairo/include/cairo --with-cairo-libs=/usr/local/opt/cairo/lib --with-cairo-ldflags=-lfontconfig --with-freetype --with-freetype-includes=/usr/local/opt/freetype/include/freetype2 --with-freetype-libs=/usr/local/opt/freetype/lib --with-proj-includes=/usr/local/opt/osgeo-proj/include --with-proj-libs=/usr/local/opt/osgeo-proj/lib --with-proj-share=/usr/local/opt/osgeo-proj/share/proj --with-tiff --with-tiff-includes=/usr/local/opt/libtiff/include --with-tiff-libs=/usr/local/opt/libtiff/lib --with-png --with-png-includes=/usr/local/opt/libpng/include --with-png-libs=/usr/local/opt/libpng/lib --with-regex --with-fftw --with-fftw-includes=/usr/local/opt/fftw/include --with-fftw-libs=/usr/local/opt/fftw/lib --with-sqlite --with-sqlite-includes=/usr/local/opt/sqlite/include --with-sqlite-libs=/usr/local/opt/sqlite/lib --with-liblas=/usr/local/opt/osgeo-liblas/bin/liblas-config --with-postgres --with-postgres-includes=/usr/local/opt/osgeo-postgresql/include --with-postgres-libs=/usr/local/opt/osgeo-postgresql/lib --with-mysql --with-mysql-includes=/usr/local/opt/mysql/include/mysql --with-mysql-libs=/usr/local/opt/mysql/lib --with-pthread --with-pthread-includes=/usr/local/opt/boost/include/boost/thread --with-pthread-libs=/usr/local/opt/boost/lib --with-macosx-sdk=/Applications/Xcode-10.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk --with-macosx-archs=x86_64 --with-opengl-includes=/Applications/Xcode-10.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/System/Library/Frameworks/OpenGL.framework/Headers --with-wxwidgets=/usr/local/opt/wxmac/bin/wx-config
clang
/usr/local/Cellar/osgeo-grass/7.8.2_3/grass78
Traceback (most recent call last):
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 2025, in main
index = sys.argv.index(batch_exec_param)
ValueError: ‘–exec’ is not in list

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 2216, in
main()
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 2030, in main
params = parse_cmdline(sys.argv[1:], default_gui=default_gui)
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 1951, in parse_cmdline
print_params()
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 1862, in print_params
“%s\n” % val[0].split(‘:’)[1].rstrip(‘$"\n’).strip())
IndexError: list index out of range

Any suggestions what the problem is?

Rainer

On 5 Mar 2020, at 21:38, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 1:52 PM Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 17:53, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 11:37 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - one step closer to success. Now I just have to know the location where the data for the tests can be downloaded from (I guess).

Everything is in the repo, well, it needs to be, I guess the only question is where in the repo, so:

https://github.com/GRASS-GIS/grass-gis-experimental-ci/blob/homebrew-osgeo4mac/test_thorough.sh

Please check the log to at https://github.com/GRASS-GIS/grass-gis-experimental-ci/runs/487969965?check_suite_focus=true for the Basic test and the Thorough test. I will look at the return code later, when the tests are running.

The problem there is probably a bad/missing path to PROJ db. I think it complains during the configuration already, so perhaps correct --with-proj-share will fix it. The runtime way of setting it is PROJ_LIB environmental variable. You can try something along these lines.

I am trying to find the file proj.db but can’t find it - can you give me any indication, where it can be found in Linux (home-brew should use similar locations)?

Often it is in /usr/share/proj. Now you can find things like that in the Docker/Singularity/Vagrant configurations included in GRASS GIS source code or in the CIs, e.g., here:

https://github.com/GRASS-GIS/grass-gis-experimental-ci/blob/master/build.sh#L39

Rainer

On 5 Mar 2020, at 16:28, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 16:22, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 14:52, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 4:27 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - found the ci.

The formula installs, but I get a warning at the end, which results in a warning, which is than interpreted as an error. The warning (which I also get locally) is the following:

If it is the case that you can change the shebang at the beginning of

he script to enforce Python 3 usage.

#!/usr/bin/env python

Should be changed into

#!/usr/bin/env python3

I suspect that this needs to be done in GRASS itself?

Hi, thanks for looking into this. 7.8.2 (and also above) has python3 everywhere in shebang. See e.g.:

$ grep -Irn “/usr/bin/env python[^3]”
scripts/g.extension/g.extension.py:1059: “#!/usr/bin/env python\n”,
scripts/g.extension/g.extension.py:1308: “#!/usr/bin/env python\n”,

(these two are in fact code which is doing the replacement to python3)

Can you please investigate locally where the message coming from?

The message comes from the formula as a Caveat. I think it is always displayed. But at the moment, I am not to sure where the error code comes from, as I get an error code at the end of the brew command of 0 locally.

I will look into this.

Please ignore the following about the checkout.

Found it.

Do you know, why there is a

uses: actions/checkout@v2

In the action?

It seems, that it will be executed last, and there is no checkout needed.

Rainer

Vaclav

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

grass-dev mailing list
grass-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/grass-dev

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

nila · August 12, 2020, 4:14pm

Hi!

Just want to give you an update on the issue. I managed to get CI build working for Mac [1, 2].

In addition I’m working on a bash script-package [3] (based on Michael’s excellent instructions on grasswiki [4]) which uses conda too, for a very simplified procedure to build an app bundle. It is working, but needs testing.

Best,
Nicklas

[1] https://github.com/nilason/grass-gis-experimental-ci/tree/conda-updates
[2] https://github.com/GRASS-GIS/grass-gis-experimental-ci/pull/3
[3] https://github.com/nilason/grass-conda
[4] https://grasswiki.osgeo.org/wiki/Compiling_on_macOS_using_Anaconda

On 31 Mar 2020, at 14:53, Rainer M Krug <Rainer@krugs.de> wrote:

Thanks Vaclav

I will wait and see.If you could please post here if something happens, as I am not following grass-user?

Thanks,

Rainer

On 31 Mar 2020, at 03:50, Vaclav Petras <wenzeslaus@gmail.com> wrote:

Hi Rainer,

Unfortunately, I don’t have any update for this, but I thought I will (inter-)link a detailed analysis on grass-user by Veronika and related PR:

[GRASS-user] Problems on MacOS Catalina Installation via Homebrew “Cannot find proj.db”
https://lists.osgeo.org/pipermail/grass-user/2020-March/081377.html

[Bug] Update build GRASS as macOS application #457 (linked comment and below)

https://github.com/OSGeo/grass/issues/457#issuecomment-603575140

Vaclav

On Sun, Mar 8, 2020 at 12:35 PM Rainer M Krug <Rainer@krugs.de> wrote:

On 6 Mar 2020, at 18:40, Markus Metz <markus.metz.giswork@gmail.com> wrote:

On Fri, Mar 6, 2020 at 8:50 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK. Looking at the parameters GRASS is compiled with (grass78 —config), I get the following proj related parameter (the complete output at the end of the email):

–with-proj-includes=/usr/local/opt/osgeo-proj/include
–with-proj-libs=/usr/local/opt/osgeo-proj/lib
–with-proj-share=/usr/local/opt/osgeo-proj/share/proj

Which seem to be correct, and proj.db is in the proj-share directory.

08:37 $ ls -la /usr/local/opt/osgeo-proj/share/proj
total 12408
drwxr-xr-x 15 rainerkrug staff 480 Feb 10 11:16 .
drwxr-xr-x 4 rainerkrug staff 128 Feb 10 11:16 …
-rw-r–r-- 1 rainerkrug staff 1183 Feb 10 11:16 CH
-rw-r–r-- 1 rainerkrug staff 728 Feb 10 11:16 GL27
-rw-r–r-- 1 rainerkrug staff 2099 Feb 10 11:16 ITRF2000
-rw-r–r-- 1 rainerkrug staff 3660 Feb 10 11:16 ITRF2008
-rw-r–r-- 1 rainerkrug staff 3468 Feb 10 11:16 ITRF2014
-rw-r–r-- 1 rainerkrug staff 6385 Feb 10 11:16 nad.lst
-rw-r–r-- 1 rainerkrug staff 19535 Feb 10 11:16 nad27
-rw-r–r-- 1 rainerkrug staff 16593 Feb 10 11:16 nad83
-rw-r–r-- 1 rainerkrug staff 232 Feb 10 11:16 null
-rw-r–r-- 1 rainerkrug staff 3915 Feb 10 11:16 other.extra
-rw-r–r-- 1 rainerkrug staff 6234112 Feb 10 11:16 proj.db
-rw-r–r-- 1 rainerkrug staff 32060 Feb 10 11:16 projjson.schema.json
-rw-r–r-- 1 rainerkrug staff 7079 Feb 10 11:16 world

So it looks fine, but I, even locally, get the following error when running the simple test:

08:40 $ grass78 --tmp-location EPSG:4326 --exec g.region res=0.1 -p
Starting GRASS GIS…
Creating new GRASS GIS location …
ERROR: b’proj_get_authorities_from_database: Cannot find proj.db

This error comes directly from PROJ.
Try

export PROJ_LIB=“usr/local/opt/osgeo-proj/share/proj”

before starting GRASS. This will tell PROJ where its own share data are.

Does not work:

17:03 $ export PROJ_LIB=“/usr/local/opt/osgeo-proj/share/proj”

~

17:03 $ grass78 --tmp-location EPSG:4326 --exec g.region res=0.1 -p

Starting GRASS GIS…

Creating new GRASS GIS location …

ERROR: b’proj_get_authorities_from_database: Cannot find proj.db

Exiting…

✘-1 ~

17:03 $ ls -la /usr/local/opt/osgeo-proj/share/proj

total 12408

drwxr-xr-x 15 rainerkrug staff 480 Feb 10 11:16 .

drwxr-xr-x 4 rainerkrug staff 128 Feb 10 11:16 …

-rw-r–r-- 1 rainerkrug staff 1183 Feb 10 11:16 CH

-rw-r–r-- 1 rainerkrug staff 728 Feb 10 11:16 GL27

-rw-r–r-- 1 rainerkrug staff 2099 Feb 10 11:16 ITRF2000

-rw-r–r-- 1 rainerkrug staff 3660 Feb 10 11:16 ITRF2008

-rw-r–r-- 1 rainerkrug staff 3468 Feb 10 11:16 ITRF2014

-rw-r–r-- 1 rainerkrug staff 6385 Feb 10 11:16 nad.lst

-rw-r–r-- 1 rainerkrug staff 19535 Feb 10 11:16 nad27

-rw-r–r-- 1 rainerkrug staff 16593 Feb 10 11:16 nad83

-rw-r–r-- 1 rainerkrug staff 232 Feb 10 11:16 null

-rw-r–r-- 1 rainerkrug staff 3915 Feb 10 11:16 other.extra

-rw-r–r-- 1 rainerkrug staff 6234112 Feb 10 11:16 proj.db

-rw-r–r-- 1 rainerkrug staff 32060 Feb 10 11:16 projjson.schema.json

-rw-r–r-- 1 rainerkrug staff 7079 Feb 10 11:16 world

Any other suggestion?

Markus M

Here is the complete output from --config:

08:35 $ grass78 --config
x86_64-apple-darwin17.7.0
./configure --prefix=/usr/local/Cellar/osgeo-grass/7.8.2_3 --with-cxx --enable-shared --enable-largefile --with-nls --with-includes=/usr/local/include --with-libs=/usr/local/LIB --with-python=/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/vendor/bin/python-config --with-tcltk --with-netcdf=/usr/local/opt/osgeo-netcdf/bin/nc-config --with-zstd --with-zstd-includes=/usr/local/opt/zstd/include --with-zstd-libs=/usr/local/opt/zstd/lib --with-readline --with-readline-includes=/usr/local/opt/readline/include --with-readline-libs=/usr/local/opt/readline/lib --with-blas --with-blas-includes=/usr/local/opt/openblas/include --with-blas-libs=/usr/local/opt/openblas/lib --with-lapack --with-lapack-includes=/usr/local/opt/lapack/include --with-lapack-libs=/usr/local/opt/lapack/lib --with-geos=/usr/local/opt/geos/bin/geos-config --with-geos-includes=/usr/local/opt/geos/include --with-geos-libs=/usr/local/opt/geos/lib --with-odbc --with-odbc-includes=/usr/local/opt/unixodbc/include --with-odbc-libs=/usr/local/opt/unixodbc/lib --with-gdal=/usr/local/opt/osgeo-gdal/bin/gdal-config --with-zlib-includes=/usr/local/opt/zlib/include --with-zlib-libs=/usr/local/opt/zlib/lib --with-bzlib --with-bzlib-includes=/usr/local/opt/bzip2/include --with-bzlib-libs=/usr/local/opt/bzip2/lib --with-cairo --with-cairo-includes=/usr/local/opt/cairo/include/cairo --with-cairo-libs=/usr/local/opt/cairo/lib --with-cairo-ldflags=-lfontconfig --with-freetype --with-freetype-includes=/usr/local/opt/freetype/include/freetype2 --with-freetype-libs=/usr/local/opt/freetype/lib --with-proj-includes=/usr/local/opt/osgeo-proj/include --with-proj-libs=/usr/local/opt/osgeo-proj/lib --with-proj-share=/usr/local/opt/osgeo-proj/share/proj --with-tiff --with-tiff-includes=/usr/local/opt/libtiff/include --with-tiff-libs=/usr/local/opt/libtiff/lib --with-png --with-png-includes=/usr/local/opt/libpng/include --with-png-libs=/usr/local/opt/libpng/lib --with-regex --with-fftw --with-fftw-includes=/usr/local/opt/fftw/include --with-fftw-libs=/usr/local/opt/fftw/lib --with-sqlite --with-sqlite-includes=/usr/local/opt/sqlite/include --with-sqlite-libs=/usr/local/opt/sqlite/lib --with-liblas=/usr/local/opt/osgeo-liblas/bin/liblas-config --with-postgres --with-postgres-includes=/usr/local/opt/osgeo-postgresql/include --with-postgres-libs=/usr/local/opt/osgeo-postgresql/lib --with-mysql --with-mysql-includes=/usr/local/opt/mysql/include/mysql --with-mysql-libs=/usr/local/opt/mysql/lib --with-pthread --with-pthread-includes=/usr/local/opt/boost/include/boost/thread --with-pthread-libs=/usr/local/opt/boost/lib --with-macosx-sdk=/Applications/Xcode-10.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk --with-macosx-archs=x86_64 --with-opengl-includes=/Applications/Xcode-10.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/System/Library/Frameworks/OpenGL.framework/Headers --with-wxwidgets=/usr/local/opt/wxmac/bin/wx-config
clang
/usr/local/Cellar/osgeo-grass/7.8.2_3/grass78
Traceback (most recent call last):
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 2025, in main
index = sys.argv.index(batch_exec_param)
ValueError: ‘–exec’ is not in list

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 2216, in
main()
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 2030, in main
params = parse_cmdline(sys.argv[1:], default_gui=default_gui)
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 1951, in parse_cmdline
print_params()
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 1862, in print_params
“%s\n” % val[0].split(‘:’)[1].rstrip(‘$"\n’).strip())
IndexError: list index out of range

Any suggestions what the problem is?

Rainer

On 5 Mar 2020, at 21:38, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 1:52 PM Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 17:53, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 11:37 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - one step closer to success. Now I just have to know the location where the data for the tests can be downloaded from (I guess).

Everything is in the repo, well, it needs to be, I guess the only question is where in the repo, so:

https://github.com/GRASS-GIS/grass-gis-experimental-ci/blob/homebrew-osgeo4mac/test_thorough.sh

Please check the log to at https://github.com/GRASS-GIS/grass-gis-experimental-ci/runs/487969965?check_suite_focus=true for the Basic test and the Thorough test. I will look at the return code later, when the tests are running.

The problem there is probably a bad/missing path to PROJ db. I think it complains during the configuration already, so perhaps correct --with-proj-share will fix it. The runtime way of setting it is PROJ_LIB environmental variable. You can try something along these lines.

I am trying to find the file proj.db but can’t find it - can you give me any indication, where it can be found in Linux (home-brew should use similar locations)?

Often it is in /usr/share/proj. Now you can find things like that in the Docker/Singularity/Vagrant configurations included in GRASS GIS source code or in the CIs, e.g., here:

https://github.com/GRASS-GIS/grass-gis-experimental-ci/blob/master/build.sh#L39

Rainer

On 5 Mar 2020, at 16:28, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 16:22, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 14:52, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 4:27 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - found the ci.

The formula installs, but I get a warning at the end, which results in a warning, which is than interpreted as an error. The warning (which I also get locally) is the following:

If it is the case that you can change the shebang at the beginning of

he script to enforce Python 3 usage.

#!/usr/bin/env python

Should be changed into

#!/usr/bin/env python3

I suspect that this needs to be done in GRASS itself?

Hi, thanks for looking into this. 7.8.2 (and also above) has python3 everywhere in shebang. See e.g.:

$ grep -Irn “/usr/bin/env python[^3]”
scripts/g.extension/g.extension.py:1059: “#!/usr/bin/env python\n”,
scripts/g.extension/g.extension.py:1308: “#!/usr/bin/env python\n”,

(these two are in fact code which is doing the replacement to python3)

Can you please investigate locally where the message coming from?

The message comes from the formula as a Caveat. I think it is always displayed. But at the moment, I am not to sure where the error code comes from, as I get an error code at the end of the brew command of 0 locally.

I will look into this.

Please ignore the following about the checkout.

Found it.

Do you know, why there is a

uses: actions/checkout@v2

In the action?

It seems, that it will be executed last, and there is no checkout needed.

Rainer

Vaclav

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

grass-dev mailing list
grass-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/grass-dev

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

grass-dev mailing list
grass-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/grass-dev

wenzeslaus · September 15, 2020, 3:23am

Hi Nicklas,

Thanks, these look great. What do you suggest as next steps?

It would be great to have at least one of these running in the main repo. I don’t know if we need all, but each has its specifics. An App bundle would make sense as a test of a primary way of distributing. (There is a lot of additional code in grass-conda repo, but we do have a ton of code for Windows packaging in the repo.) Plain build inside conda would be nice and simple for the testing purposes. An actual conda package build, possibly cross-platform in the future, sounds like the right thing to do since conda is already involved.

BTW, I merged your Install.make fix. Please, consider doing more of these. “enable OSX Help Viewer” and other macOS-only cases should go to the main code rather than being a patch. The PYTHON var (Python executable (which is used for ?)) would make sense as something configurable.

Vaclav

On Wed, Aug 12, 2020 at 12:14 PM Nicklas Larsson <n_larsson@yahoo.com> wrote:

Hi!

Just want to give you an update on the issue. I managed to get CI build working for Mac [1, 2].

In addition I’m working on a bash script-package [3] (based on Michael’s excellent instructions on grasswiki [4]) which uses conda too, for a very simplified procedure to build an app bundle. It is working, but needs testing.

Best,
Nicklas

[1] https://github.com/nilason/grass-gis-experimental-ci/tree/conda-updates
[2] https://github.com/GRASS-GIS/grass-gis-experimental-ci/pull/3
[3] https://github.com/nilason/grass-conda
[4] https://grasswiki.osgeo.org/wiki/Compiling_on_macOS_using_Anaconda

On 31 Mar 2020, at 14:53, Rainer M Krug <Rainer@krugs.de> wrote:

Thanks Vaclav

I will wait and see.If you could please post here if something happens, as I am not following grass-user?

Thanks,

Rainer

On 31 Mar 2020, at 03:50, Vaclav Petras <wenzeslaus@gmail.com> wrote:

Hi Rainer,

Unfortunately, I don’t have any update for this, but I thought I will (inter-)link a detailed analysis on grass-user by Veronika and related PR:

[GRASS-user] Problems on MacOS Catalina Installation via Homebrew “Cannot find proj.db”
https://lists.osgeo.org/pipermail/grass-user/2020-March/081377.html

[Bug] Update build GRASS as macOS application #457 (linked comment and below)

https://github.com/OSGeo/grass/issues/457#issuecomment-603575140

Vaclav

On Sun, Mar 8, 2020 at 12:35 PM Rainer M Krug <Rainer@krugs.de> wrote:

On 6 Mar 2020, at 18:40, Markus Metz <markus.metz.giswork@gmail.com> wrote:

On Fri, Mar 6, 2020 at 8:50 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK. Looking at the parameters GRASS is compiled with (grass78 —config), I get the following proj related parameter (the complete output at the end of the email):

–with-proj-includes=/usr/local/opt/osgeo-proj/include
–with-proj-libs=/usr/local/opt/osgeo-proj/lib
–with-proj-share=/usr/local/opt/osgeo-proj/share/proj

Which seem to be correct, and proj.db is in the proj-share directory.

08:37 $ ls -la /usr/local/opt/osgeo-proj/share/proj
total 12408
drwxr-xr-x 15 rainerkrug staff 480 Feb 10 11:16 .
drwxr-xr-x 4 rainerkrug staff 128 Feb 10 11:16 …
-rw-r–r-- 1 rainerkrug staff 1183 Feb 10 11:16 CH
-rw-r–r-- 1 rainerkrug staff 728 Feb 10 11:16 GL27
-rw-r–r-- 1 rainerkrug staff 2099 Feb 10 11:16 ITRF2000
-rw-r–r-- 1 rainerkrug staff 3660 Feb 10 11:16 ITRF2008
-rw-r–r-- 1 rainerkrug staff 3468 Feb 10 11:16 ITRF2014
-rw-r–r-- 1 rainerkrug staff 6385 Feb 10 11:16 nad.lst
-rw-r–r-- 1 rainerkrug staff 19535 Feb 10 11:16 nad27
-rw-r–r-- 1 rainerkrug staff 16593 Feb 10 11:16 nad83
-rw-r–r-- 1 rainerkrug staff 232 Feb 10 11:16 null
-rw-r–r-- 1 rainerkrug staff 3915 Feb 10 11:16 other.extra
-rw-r–r-- 1 rainerkrug staff 6234112 Feb 10 11:16 proj.db
-rw-r–r-- 1 rainerkrug staff 32060 Feb 10 11:16 projjson.schema.json
-rw-r–r-- 1 rainerkrug staff 7079 Feb 10 11:16 world

So it looks fine, but I, even locally, get the following error when running the simple test:

08:40 $ grass78 --tmp-location EPSG:4326 --exec g.region res=0.1 -p
Starting GRASS GIS…
Creating new GRASS GIS location …
ERROR: b’proj_get_authorities_from_database: Cannot find proj.db

This error comes directly from PROJ.
Try

export PROJ_LIB=“usr/local/opt/osgeo-proj/share/proj”

before starting GRASS. This will tell PROJ where its own share data are.

Does not work:

17:03 $ export PROJ_LIB=“/usr/local/opt/osgeo-proj/share/proj”

~

17:03 $ grass78 --tmp-location EPSG:4326 --exec g.region res=0.1 -p

Starting GRASS GIS…

Creating new GRASS GIS location …

ERROR: b’proj_get_authorities_from_database: Cannot find proj.db

Exiting…

✘-1 ~

17:03 $ ls -la /usr/local/opt/osgeo-proj/share/proj

total 12408

drwxr-xr-x 15 rainerkrug staff 480 Feb 10 11:16 .

drwxr-xr-x 4 rainerkrug staff 128 Feb 10 11:16 …

-rw-r–r-- 1 rainerkrug staff 1183 Feb 10 11:16 CH

-rw-r–r-- 1 rainerkrug staff 728 Feb 10 11:16 GL27

-rw-r–r-- 1 rainerkrug staff 2099 Feb 10 11:16 ITRF2000

-rw-r–r-- 1 rainerkrug staff 3660 Feb 10 11:16 ITRF2008

-rw-r–r-- 1 rainerkrug staff 3468 Feb 10 11:16 ITRF2014

-rw-r–r-- 1 rainerkrug staff 6385 Feb 10 11:16 nad.lst

-rw-r–r-- 1 rainerkrug staff 19535 Feb 10 11:16 nad27

-rw-r–r-- 1 rainerkrug staff 16593 Feb 10 11:16 nad83

-rw-r–r-- 1 rainerkrug staff 232 Feb 10 11:16 null

-rw-r–r-- 1 rainerkrug staff 3915 Feb 10 11:16 other.extra

-rw-r–r-- 1 rainerkrug staff 6234112 Feb 10 11:16 proj.db

-rw-r–r-- 1 rainerkrug staff 32060 Feb 10 11:16 projjson.schema.json

-rw-r–r-- 1 rainerkrug staff 7079 Feb 10 11:16 world

Any other suggestion?

Markus M

Here is the complete output from --config:

08:35 $ grass78 --config
x86_64-apple-darwin17.7.0
./configure --prefix=/usr/local/Cellar/osgeo-grass/7.8.2_3 --with-cxx --enable-shared --enable-largefile --with-nls --with-includes=/usr/local/include --with-libs=/usr/local/LIB --with-python=/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/vendor/bin/python-config --with-tcltk --with-netcdf=/usr/local/opt/osgeo-netcdf/bin/nc-config --with-zstd --with-zstd-includes=/usr/local/opt/zstd/include --with-zstd-libs=/usr/local/opt/zstd/lib --with-readline --with-readline-includes=/usr/local/opt/readline/include --with-readline-libs=/usr/local/opt/readline/lib --with-blas --with-blas-includes=/usr/local/opt/openblas/include --with-blas-libs=/usr/local/opt/openblas/lib --with-lapack --with-lapack-includes=/usr/local/opt/lapack/include --with-lapack-libs=/usr/local/opt/lapack/lib --with-geos=/usr/local/opt/geos/bin/geos-config --with-geos-includes=/usr/local/opt/geos/include --with-geos-libs=/usr/local/opt/geos/lib --with-odbc --with-odbc-includes=/usr/local/opt/unixodbc/include --with-odbc-libs=/usr/local/opt/unixodbc/lib --with-gdal=/usr/local/opt/osgeo-gdal/bin/gdal-config --with-zlib-includes=/usr/local/opt/zlib/include --with-zlib-libs=/usr/local/opt/zlib/lib --with-bzlib --with-bzlib-includes=/usr/local/opt/bzip2/include --with-bzlib-libs=/usr/local/opt/bzip2/lib --with-cairo --with-cairo-includes=/usr/local/opt/cairo/include/cairo --with-cairo-libs=/usr/local/opt/cairo/lib --with-cairo-ldflags=-lfontconfig --with-freetype --with-freetype-includes=/usr/local/opt/freetype/include/freetype2 --with-freetype-libs=/usr/local/opt/freetype/lib --with-proj-includes=/usr/local/opt/osgeo-proj/include --with-proj-libs=/usr/local/opt/osgeo-proj/lib --with-proj-share=/usr/local/opt/osgeo-proj/share/proj --with-tiff --with-tiff-includes=/usr/local/opt/libtiff/include --with-tiff-libs=/usr/local/opt/libtiff/lib --with-png --with-png-includes=/usr/local/opt/libpng/include --with-png-libs=/usr/local/opt/libpng/lib --with-regex --with-fftw --with-fftw-includes=/usr/local/opt/fftw/include --with-fftw-libs=/usr/local/opt/fftw/lib --with-sqlite --with-sqlite-includes=/usr/local/opt/sqlite/include --with-sqlite-libs=/usr/local/opt/sqlite/lib --with-liblas=/usr/local/opt/osgeo-liblas/bin/liblas-config --with-postgres --with-postgres-includes=/usr/local/opt/osgeo-postgresql/include --with-postgres-libs=/usr/local/opt/osgeo-postgresql/lib --with-mysql --with-mysql-includes=/usr/local/opt/mysql/include/mysql --with-mysql-libs=/usr/local/opt/mysql/lib --with-pthread --with-pthread-includes=/usr/local/opt/boost/include/boost/thread --with-pthread-libs=/usr/local/opt/boost/lib --with-macosx-sdk=/Applications/Xcode-10.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk --with-macosx-archs=x86_64 --with-opengl-includes=/Applications/Xcode-10.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/System/Library/Frameworks/OpenGL.framework/Headers --with-wxwidgets=/usr/local/opt/wxmac/bin/wx-config
clang
/usr/local/Cellar/osgeo-grass/7.8.2_3/grass78
Traceback (most recent call last):
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 2025, in main
index = sys.argv.index(batch_exec_param)
ValueError: ‘–exec’ is not in list

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 2216, in
main()
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 2030, in main
params = parse_cmdline(sys.argv[1:], default_gui=default_gui)
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 1951, in parse_cmdline
print_params()
File “/usr/local/Cellar/osgeo-grass/7.8.2_3/libexec/bin/grass78”, line 1862, in print_params
“%s\n” % val[0].split(‘:’)[1].rstrip(‘$"\n’).strip())
IndexError: list index out of range

Any suggestions what the problem is?

Rainer

On 5 Mar 2020, at 21:38, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 1:52 PM Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 17:53, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 11:37 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - one step closer to success. Now I just have to know the location where the data for the tests can be downloaded from (I guess).

Everything is in the repo, well, it needs to be, I guess the only question is where in the repo, so:

https://github.com/GRASS-GIS/grass-gis-experimental-ci/blob/homebrew-osgeo4mac/test_thorough.sh

Please check the log to at https://github.com/GRASS-GIS/grass-gis-experimental-ci/runs/487969965?check_suite_focus=true for the Basic test and the Thorough test. I will look at the return code later, when the tests are running.

The problem there is probably a bad/missing path to PROJ db. I think it complains during the configuration already, so perhaps correct --with-proj-share will fix it. The runtime way of setting it is PROJ_LIB environmental variable. You can try something along these lines.

I am trying to find the file proj.db but can’t find it - can you give me any indication, where it can be found in Linux (home-brew should use similar locations)?

Often it is in /usr/share/proj. Now you can find things like that in the Docker/Singularity/Vagrant configurations included in GRASS GIS source code or in the CIs, e.g., here:

https://github.com/GRASS-GIS/grass-gis-experimental-ci/blob/master/build.sh#L39

Rainer

On 5 Mar 2020, at 16:28, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 16:22, Rainer M Krug <Rainer@krugs.de> wrote:

On 5 Mar 2020, at 14:52, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Thu, Mar 5, 2020 at 4:27 AM Rainer M Krug <Rainer@krugs.de> wrote:

OK - found the ci.

The formula installs, but I get a warning at the end, which results in a warning, which is than interpreted as an error. The warning (which I also get locally) is the following:

If it is the case that you can change the shebang at the beginning of

he script to enforce Python 3 usage.

#!/usr/bin/env python

Should be changed into

#!/usr/bin/env python3

I suspect that this needs to be done in GRASS itself?

Hi, thanks for looking into this. 7.8.2 (and also above) has python3 everywhere in shebang. See e.g.:

$ grep -Irn “/usr/bin/env python[^3]”
scripts/g.extension/g.extension.py:1059: “#!/usr/bin/env python\n”,
scripts/g.extension/g.extension.py:1308: “#!/usr/bin/env python\n”,

(these two are in fact code which is doing the replacement to python3)

Can you please investigate locally where the message coming from?

The message comes from the formula as a Caveat. I think it is always displayed. But at the moment, I am not to sure where the error code comes from, as I get an error code at the end of the brew command of 0 locally.

I will look into this.

Please ignore the following about the checkout.

Found it.

Do you know, why there is a

uses: actions/checkout@v2

In the action?

It seems, that it will be executed last, and there is no checkout needed.

Rainer

Vaclav

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57
email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

grass-dev mailing list
grass-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/grass-dev

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

–
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany)

Orcid ID: 0000-0002-7490-0066

Department of Evolutionary Biology and Environmental Studies
University of Zürich
Office Y34-J-74
Winterthurerstrasse 190
8075 Zürich
Switzerland

Office: +41 (0)44 635 47 64
Cell: +41 (0)78 630 66 57

email: Rainer.Krug@uzh.ch
Rainer@krugs.de
Skype: RMkrug

PGP: 0x0F52F982

grass-dev mailing list
grass-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/grass-dev

grass-dev mailing list
grass-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/grass-dev