[SAC] [OSGeo] #1857: Gogs fills up disk space by storing packages

#1857: Gogs fills up disk space by storing packages
---------------------------+--------------------------------
Reporter: strk | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone:
Component: Systems Admin | Keywords: gogs, tracsvn, git
---------------------------+--------------------------------
TracSVN ended up out of space today, looking at the machine I found
osgeolive-doc git repository having an archive/ directory containing 440
tar.gz files and 340 .zip files, as if a web bot triggered generation and
Gogs cached the packages.

I'll see what can be done to tweak/disable the caches and/or instruct bots
not to do that.

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/1857&gt;
OSGeo <http://www.osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#1857: Gogs fills up disk space by storing packages
--------------------------------+--------------------
Reporter: strk | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone:
Component: Systems Admin | Resolution:
Keywords: gogs, tracsvn, git |
--------------------------------+--------------------

Comment (by strk):

Running the "Delete all repositories archives" operation from the Gogs
admin panel freed up 48GB of space, from 92G used to 44G used !

Filed an upstream ticket to make this operation periodic:
https://github.com/go-gitea/gitea/issues/769

Will now see if I can understand what generated all those archives (maybe
a robots.txt could prevent that)

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/1857#comment:1&gt;
OSGeo <http://www.osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#1857: Gogs fills up disk space by storing packages
--------------------------------+--------------------
Reporter: strk | Owner: sac@…
     Type: task | Status: new
Priority: normal | Milestone:
Component: Systems Admin | Resolution:
Keywords: gogs, tracsvn, git |
--------------------------------+--------------------

Comment (by strk):

I confirm the archive downloaders were bots.
One in particular keeps hitting at the moment: {{{http://mj12bot.com/\}}}
Logs are in the form: "GET /gogs.*/archive/"

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/1857#comment:2&gt;
OSGeo <http://www.osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

#1857: Gogs fills up disk space by storing packages
--------------------------------+---------------------
Reporter: strk | Owner: sac@…
     Type: task | Status: closed
Priority: normal | Milestone:
Component: Systems Admin | Resolution: fixed
Keywords: gogs, tracsvn, git |
--------------------------------+---------------------
Changes (by strk):

* status: new => closed
* resolution: => fixed

Comment:

I've filed #1858 to prevent bots, this one is closed for now.

--
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/1857#comment:3&gt;
OSGeo <http://www.osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.