[GRASS-dev] Tests down to 58% (from 81%)

GRASS GIS GRASS GIS developer
1

Hi,

just to let you know in case you haven’t noticed, something between r61753 and 61763 broke a lot of temporal tests.

Vaclav

http://fatra.cnr.ncsu.edu/grassgistests/reports_for_date-2014-08-27-07-00/report_for_nc_spm_08_grass7_nc/testfiles.html
http://fatra.cnr.ncsu.edu/grassgistests/reports_for_date-2014-08-28-07-00/report_for_nc_spm_08_grass7_nc/testfiles.html

2

On Thu, Sep 4, 2014 at 4:43 PM, Vaclav Petras <wenzeslaus@gmail.com> wrote:

Hi,

just to let you know in case you haven't noticed, something between r61753
and 61763 broke a lot of temporal tests.

... "excellent", in a sense that your test suite starts to catch new issues!

We can narrow that down to r61760-r61763, before it was PNG driver stuff etc.

one wish:

http://fatra.cnr.ncsu.edu/grassgistests/reports_for_date-2014-08-27-07-00/report_for_nc_spm_08_grass7_nc/testfiles.html
http://fatra.cnr.ncsu.edu/grassgistests/reports_for_date-2014-08-28-07-00/report_for_nc_spm_08_grass7_nc/testfiles.html

Since you track "success" or "failed", could you please add an
additional column to retain the last rev number of "success" (maybe as
link to trac changeset)? Then one could easily navigate to the
subsequent changes.

thanks
Markus

3

2014-09-04 16:43 GMT+02:00 Vaclav Petras <wenzeslaus@gmail.com>:

Hi,

just to let you know in case you haven't noticed, something between r61753
and 61763 broke a lot of temporal tests.

Oh, no. I will try to investigate this. Thank you for checking this.

Soeren

Vaclav

http://fatra.cnr.ncsu.edu/grassgistests/reports_for_date-2014-08-27-07-00/report_for_nc_spm_08_grass7_nc/testfiles.html
http://fatra.cnr.ncsu.edu/grassgistests/reports_for_date-2014-08-28-07-00/report_for_nc_spm_08_grass7_nc/testfiles.html

4

On Thu, Sep 4, 2014 at 11:18 AM, Markus Neteler <neteler@osgeo.org> wrote:

Since you track "success" or "failed", could you please add an
additional column to retain the last rev number of "success" (maybe as
link to trac changeset)? Then one could easily navigate to the
subsequent changes.

The problem is that I do not track anything specific. I just generate the
HTML report and that's it. There might be some solution using key-value
files and searching through test report directory tree but the ultimate
solution is to store test result (values for report) in database and then
generate report from the database (so that current and previous values are
accessible in the same way and also better organized).

5

I have hopefully fixed the issues that caused the failure of tests in
r61806 and added some additional shell test files to the testsuite in
r61807.

Regarding the tests, can you please install python-ply (PLY[1] package
for temporal algebra lex and yacc parser) at the test server, so that
the temporal algebra tests will work, at least most of them?

Best regards
Soeren

[1] http://www.dabeaz.com/ply/

2014-09-04 21:27 GMT+02:00 Sören Gebbert <soerengebbert@googlemail.com>:

2014-09-04 16:43 GMT+02:00 Vaclav Petras <wenzeslaus@gmail.com>:

Hi,

just to let you know in case you haven't noticed, something between r61753
and 61763 broke a lot of temporal tests.

Oh, no. I will try to investigate this. Thank you for checking this.

Soeren

Vaclav

http://fatra.cnr.ncsu.edu/grassgistests/reports_for_date-2014-08-27-07-00/report_for_nc_spm_08_grass7_nc/testfiles.html
http://fatra.cnr.ncsu.edu/grassgistests/reports_for_date-2014-08-28-07-00/report_for_nc_spm_08_grass7_nc/testfiles.html

6

On Fri, Sep 5, 2014 at 4:18 PM, Sören Gebbert <soerengebbert@googlemail.com>
wrote:

I have hopefully fixed the issues that caused the failure of tests in
r61806 and added some additional shell test files to the testsuite in
r61807.

Great thanks, we can check tomorrow.

Regarding the tests, can you please install python-ply (PLY[1] package
for temporal algebra lex and yacc parser) at the test server, so that
the temporal algebra tests will work, at least most of them?

Let me wait with this for tomorrow, so we can see what was improved.

Best regards
Soeren

[1] http://www.dabeaz.com/ply/

2014-09-04 21:27 GMT+02:00 Sören Gebbert <soerengebbert@googlemail.com>:
> 2014-09-04 16:43 GMT+02:00 Vaclav Petras <wenzeslaus@gmail.com>:
>> Hi,
>>
>> just to let you know in case you haven't noticed, something between
r61753
>> and 61763 broke a lot of temporal tests.
>
> Oh, no. I will try to investigate this. Thank you for checking this.
>
> Soeren
>
>>
>> Vaclav
>>
>>
http://fatra.cnr.ncsu.edu/grassgistests/reports_for_date-2014-08-27-07-00/report_for_nc_spm_08_grass7_nc/testfiles.html
>>
http://fatra.cnr.ncsu.edu/grassgistests/reports_for_date-2014-08-28-07-00/report_for_nc_spm_08_grass7_nc/testfiles.html
>>
>>

7

On Fri, Sep 5, 2014 at 5:36 PM, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Fri, Sep 5, 2014 at 4:18 PM, Sören Gebbert <
soerengebbert@googlemail.com> wrote:

I have hopefully fixed the issues that caused the failure of tests in
r61806 and added some additional shell test files to the testsuite in
r61807.

Great thanks, we can check tomorrow.

Tests are at 86% successful test files.

There is a problem with t.rast.to.rast3.

http://fatra.cnr.ncsu.edu/grassgistests/reports_for_date-2014-09-06-07-00/report_for_nc_spm_08_grass7_nc/temporal/t.rast.to.rast3/test_strds_to_rast3/index.html

Perhaps a missing region settings.

Regarding the tests, can you please install python-ply (PLY[1] package

for temporal algebra lex and yacc parser) at the test server, so that
the temporal algebra tests will work, at least most of them?

Let me wait with this for tomorrow, so we can see what was improved.

Installed, so let's see tomorrow.

Best regards

Soeren

[1] http://www.dabeaz.com/ply/

2014-09-04 21:27 GMT+02:00 Sören Gebbert <soerengebbert@googlemail.com>:
> 2014-09-04 16:43 GMT+02:00 Vaclav Petras <wenzeslaus@gmail.com>:
>> Hi,
>>
>> just to let you know in case you haven't noticed, something between
r61753
>> and 61763 broke a lot of temporal tests.
>
> Oh, no. I will try to investigate this. Thank you for checking this.
>
> Soeren
>
>>
>> Vaclav
>>
>>
http://fatra.cnr.ncsu.edu/grassgistests/reports_for_date-2014-08-27-07-00/report_for_nc_spm_08_grass7_nc/testfiles.html
>>
http://fatra.cnr.ncsu.edu/grassgistests/reports_for_date-2014-08-28-07-00/report_for_nc_spm_08_grass7_nc/testfiles.html
>>
>>

8

On Sat, Sep 6, 2014 at 11:42 AM, Vaclav Petras <wenzeslaus@gmail.com> wrote:

Regarding the tests, can you please install python-ply (PLY[1] package

for temporal algebra lex and yacc parser) at the test server, so that
the temporal algebra tests will work, at least most of them?

Let me wait with this for tomorrow, so we can see what was improved.

Installed, so let's see tomorrow.

Perhaps the issue is that it is missing in

http://grass.osgeo.org/grass70/source/REQUIREMENTS.html

and in

http://grasswiki.osgeo.org/wiki/Compile_and_Install_Ubuntu
...

9

On Sat, Sep 6, 2014 at 11:45 AM, Vaclav Petras <wenzeslaus@gmail.com> wrote:

On Sat, Sep 6, 2014 at 11:42 AM, Vaclav Petras <wenzeslaus@gmail.com>
wrote:

Regarding the tests, can you please install python-ply (PLY[1] package

for temporal algebra lex and yacc parser) at the test server, so that
the temporal algebra tests will work, at least most of them?

Let me wait with this for tomorrow, so we can see what was improved.

Installed, so let's see tomorrow.

Perhaps the issue is that it is missing in

http://grass.osgeo.org/grass70/source/REQUIREMENTS.html

and in

http://grasswiki.osgeo.org/wiki/Compile_and_Install_Ubuntu
...

Great! Now we have 88% test files successful (was 86%), and 99% tests
successful (was 96%).

http://fatra.cnr.ncsu.edu/grassgistests/reports_for_date-2014-09-06-07-00/report_for_nc_spm_08_grass7_nc/testfiles.html
http://fatra.cnr.ncsu.edu/grassgistests/reports_for_date-2014-09-07-07-00/report_for_nc_spm_08_grass7_nc/testfiles.html