[GRASS-dev] Question about SVN access via Trac

The Trac page is nice. It’s easy to quickly access the source code and bug tracker, and the view changes feature is especially helpful. One thing that seems missing is the ability to download a tarball of all or part of the source code. This was particularly handy to give non-developers easy access to code in GRASS addons. Is this something that can be added or was it specific to the SVN web access features of the old addons site?

Michael


C. Michael Barton, Professor of Anthropology
Director of Graduate Studies
School of Human Evolution & Social Change
Center for Social Dynamics & Complexity
Arizona State University

Phone: 480-965-6262
Fax: 480-965-7671
www: <www.public.asu.edu/~cmbarton>

Michael Barton wrote:

The Trac page is nice. It's easy to quickly access the source code and bug tracker, and the view changes feature is especially helpful. One thing that seems missing is the ability to download a tarball of all or part of the source code. This was particularly handy to give non-developers easy access to code in GRASS addons. Is this something that can be added or was it specific to the SVN web access features of the old addons site?

Michael,

A number of projects run cronjobs on download.osgeo.org to prepare night
SVN snapshots. Would this satisfy the need you see? I can work with anyone
interested in setting this up.

Best regards,
--
---------------------------------------+--------------------------------------
I set the clouds in motion - turn up | Frank Warmerdam, warmerdam@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush | President OSGeo, http://osgeo.org

Hi Frank,

2007/12/11, Frank Warmerdam <warmerdam@pobox.com>:

Michael Barton wrote:
> The Trac page is nice. It's easy to quickly access the source code and
> bug tracker, and the view changes feature is especially helpful. One
> thing that seems missing is the ability to download a tarball of all or
> part of the source code. This was particularly handy to give
> non-developers easy access to code in GRASS addons. Is this something
> that can be added or was it specific to the SVN web access features of
> the old addons site?

Michael,

A number of projects run cronjobs on download.osgeo.org to prepare night
SVN snapshots. Would this satisfy the need you see? I can work with anyone
interested in setting this up.

I guess building night SVN snapshots for GRASS would be OK...

for trunk:
http://svn.osgeo.org/grass/grass/trunk/
-> grass-svn-trunk-YYYY.MM.DD.tar.gz
and stable branch:
http://svn.osgeo.org/grass/grass/branches/releasebranch_6_2/
-> grass-svn-stable-YYYY.MM.DD.tar.gz

Regards, Martin

Best regards,
--
---------------------------------------+--------------------------------------
I set the clouds in motion - turn up | Frank Warmerdam, warmerdam@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush | President OSGeo, http://osgeo.org

_______________________________________________
grass-dev mailing list
grass-dev@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/grass-dev

--
Martin Landa <landa.martin@gmail.com> * http://gama.fsv.cvut.cz/~landa *

Moritz Lennert wrote:

Michael,

A number of projects run cronjobs on download.osgeo.org to prepare night
SVN snapshots. Would this satisfy the need you see? I can work with anyone
interested in setting this up.

I think that a 'download tarball' button would be nice, as this allows to download a tarball of just any directory you want.

>

This seems to be implemented in Trac, but needs to be configured via the 'downloadable_paths' variable. See http://trac.edgewall.org/wiki/TracIni#svn.

Moritz,

I reviewed this and it appears this just gives the one-file-at-a-time
downloading option. It does not appear to allow downloading directories
and directory trees as a tarball.

But it's obviously also a question of resource usage this might imply for the osgeo server.

We do disallow robots into many parts of Trac to avoid big downloads.
We used to have a lot of problems with google and other robots requesting
huge version diffs (ie. between r1 and r20000 on /trunk!) during their
scans. In many cases this produced multi-gigabyte diffs and would crash
the main server.

Beyond that it isn't such an issue. But given that Trac does not seem
to provide the desired service, I think we are back to preparing
nightly tarballs.

Best regards,
--
---------------------------------------+--------------------------------------
I set the clouds in motion - turn up | Frank Warmerdam, warmerdam@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush | President OSGeo, http://osgeo.org

I think the nightly tarballs would suffice. Can this be done for the Addons directories too?

Michael

On Dec 11, 2007, at 9:18 AM, Frank Warmerdam wrote:

Moritz Lennert wrote:

Michael,

A number of projects run cronjobs on download.osgeo.org to prepare night
SVN snapshots. Would this satisfy the need you see? I can work with anyone
interested in setting this up.

I think that a 'download tarball' button would be nice, as this allows to download a tarball of just any directory you want.

>

This seems to be implemented in Trac, but needs to be configured via the 'downloadable_paths' variable. See TracIni – The Trac Project.

Moritz,

I reviewed this and it appears this just gives the one-file-at-a-time
downloading option. It does not appear to allow downloading directories
and directory trees as a tarball.

But it's obviously also a question of resource usage this might imply for the osgeo server.

We do disallow robots into many parts of Trac to avoid big downloads.
We used to have a lot of problems with google and other robots requesting
huge version diffs (ie. between r1 and r20000 on /trunk!) during their
scans. In many cases this produced multi-gigabyte diffs and would crash
the main server.

Beyond that it isn't such an issue. But given that Trac does not seem
to provide the desired service, I think we are back to preparing
nightly tarballs.

Best regards,
--
---------------------------------------+--------------------------------------
I set the clouds in motion - turn up | Frank Warmerdam, warmerdam@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush | President OSGeo, http://osgeo.org

Michael Barton wrote:

I think the nightly tarballs would suffice. Can this be done for the Addons directories too?

Michael,

It can be pretty much whatever you want. I am attaching two scripts
I use for gdal. One, mkgdaldist.sh prepares a source distribution from
subversion. The other, gdalnightlysvn.sh, uses mkgdaldist.sh to create
trunk and stable branch snapshots and rotates them into the OSGeo download
directory for gdal nightly snapshots.

Basically, if the GRASS project can provide a script or scripts that
does this rough task, I'm prepared to setup a cronjob, or better yet
whoever on the GRASS project that has a userid on download.osgeo.org
could set it up, perhaps asking me questions.

Best regards,
--
---------------------------------------+--------------------------------------
I set the clouds in motion - turn up | Frank Warmerdam, warmerdam@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush | President OSGeo, http://osgeo.org

(attachments)

gdalnightlysvn.sh (1.4 KB)
mkgdaldist.sh (3.3 KB)

Thanks Frank. This sounds very flexible.

Michael
______________________________
Michael Barton, Professor & Curator
School of Human Diversity and Social Change
Arizona State University
Tempe, AZ 85287-2402
USA

voice: 480-965-6262; fax: 480-965-7671
www: http://www.public.asu.edu/~cmbarton

On Dec 11, 2007, at 10:01 AM, Frank Warmerdam wrote:

Michael Barton wrote:

I think the nightly tarballs would suffice. Can this be done for the Addons directories too?

Michael,

It can be pretty much whatever you want. I am attaching two scripts
I use for gdal. One, mkgdaldist.sh prepares a source distribution from
subversion. The other, gdalnightlysvn.sh, uses mkgdaldist.sh to create
trunk and stable branch snapshots and rotates them into the OSGeo download
directory for gdal nightly snapshots.

Basically, if the GRASS project can provide a script or scripts that
does this rough task, I'm prepared to setup a cronjob, or better yet
whoever on the GRASS project that has a userid on download.osgeo.org
could set it up, perhaps asking me questions.

Best regards,
--
---------------------------------------+--------------------------------------
I set the clouds in motion - turn up | Frank Warmerdam, warmerdam@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush | President OSGeo, http://osgeo.org

<gdalnightlysvn.sh><mkgdaldist.sh>

Michael wrote:

The Trac page is nice. It's easy to quickly access the source code
and bug tracker, and the view changes feature is especially helpful.
One thing that seems missing is the ability to download a tarball of
all or part of the source code. This was particularly handy to give
non-developers easy access to code in GRASS addons.

Frank:

>> A number of projects run cronjobs on download.osgeo.org to prepare
>> night SVN snapshots. Would this satisfy the need you see? I can
>> work with anyone interested in setting this up.

Moritz:

> I think that a 'download tarball' button would be nice, as this
> allows to download a tarball of just any directory you want.
>
> This seems to be implemented in Trac, but needs to be configured
> via the 'downloadable_paths' variable.

Frank:

I reviewed this and it appears this just gives the one-file-at-a-time
downloading option. It does not appear to allow downloading
directories and directory trees as a tarball.

One thing I have been very keen to keep from the grass CVS is a ViewCVS
interface (now known as ViewVC). This provides the directory level
tarball functionality Michael asks for (link at the bottom of each
page).

The trac one is pretty nice:
  http://trac.osgeo.org/grass/browser
But I still prefer ViewCVS:
  http://freegis.org/cgi-bin/viewcvs.cgi/

there was an example here, but it seems to be no longer active:
  http://josef.fsv.cvut.cz/cgi-bin/viewcvs.cgi/?root=grass7svn

other projects provide multiple browsing methods, e.g. for gpsd:
  http://developer.berlios.de/svn/?group_id=2116

[with respect to gpsd, Frank might I suggest leaning on Eric to see if
they might like to join osgeo? I believe there was initial interest, it
would seem a nice project to have on board]

hmph: picking out a random GRASS file to look at the Trac SVN browser
shows that something is misaligned- the d.colors/curses.c file is
showing the SVN history for (apparently) the r.out.gdal help page.

http://trac.osgeo.org/grass/changeset?old_path=grass%2Ftrunk%2Fdisplay%2Fd.colors%2Fcurses.c&old=29409&new_path=grass%2Ftrunk%2Fdisplay%2Fd.colors%2Fcurses.c&new=29409

Frank:

Beyond that it isn't such an issue. But given that Trac does not
seem to provide the desired service, I think we are back to preparing
nightly tarballs.

with respect to naming the nightly/weekly SVN branch snapshots, I would
suggest (for solely consistency's sake) maintaining the current naming
scheme. e.g. grass-6.3.svn_src_snapshot_2007_12_08.tar.gz

thanks,
Hamish

ps- the spam filter on the old email address just wasn't keeping up,
and many folks mistook the real address for spamproofing, so I've taken
on a new one. yay fetchyahoo.pl

      ____________________________________________________________________________________
Never miss a thing. Make Yahoo your home page.
http://www.yahoo.com/r/hs

Hi all,

2007/12/11, Hamish B <hamish_b@yahoo.com>:

The trac one is pretty nice:
  http://trac.osgeo.org/grass/browser
But I still prefer ViewCVS:
  http://freegis.org/cgi-bin/viewcvs.cgi/

there was an example here, but it seems to be no longer active:
  http://josef.fsv.cvut.cz/cgi-bin/viewcvs.cgi/?root=grass7svn

BTW, I am planning to rsync GRASS SVN repo on josef server, ViewCVS
interface will be available there, I just need to find free time for
that.

hmph: picking out a random GRASS file to look at the Trac SVN browser
shows that something is misaligned- the d.colors/curses.c file is
showing the SVN history for (apparently) the r.out.gdal help page.

It is seems OK for me, changeset for r29409 is connected to the change
in r.out.gdal help page, see log message for r29409 and

http://trac.osgeo.org/grass/changeset/29409

and

http://trac.osgeo.org/grass/changeset/20310

http://trac.osgeo.org/grass/changeset?old_path=grass%2Ftrunk%2Fdisplay%2Fd.colors%2Fcurses.c&old=29409&new_path=grass%2Ftrunk%2Fdisplay%2Fd.colors%2Fcurses.c&new=29409

Martin

--
Martin Landa <landa.martin@gmail.com> * http://gama.fsv.cvut.cz/~landa *

On 11/12/07 17:18, Frank Warmerdam wrote:

Moritz Lennert wrote:

Michael,

A number of projects run cronjobs on download.osgeo.org to prepare night
SVN snapshots. Would this satisfy the need you see? I can work with anyone
interested in setting this up.

I think that a 'download tarball' button would be nice, as this allows to download a tarball of just any directory you want.

>

This seems to be implemented in Trac, but needs to be configured via the 'downloadable_paths' variable. See http://trac.edgewall.org/wiki/TracIni#svn.

Moritz,

I reviewed this and it appears this just gives the one-file-at-a-time
downloading option. It does not appear to allow downloading directories
and directory trees as a tarball.

I'm not going to make issue of this (I do think that there are more important issues), but at [1] you are able to download directories. They actually seem to limit downloading to fairly low-level directories, not giving the opportunity to download a tarball of the entire repository [2]. BTW, I got this address from a discussion in trac's trac available at [3], but I am definitely not an expert on Trac, so there might be some other hacks behind this.

Moritz

[1] http://trac-hacks.org/browser/pydocplugin/
[2] http://trac-hacks.org/browser
[3] http://trac.edgewall.org/ticket/238