---------- Forwarded message ----------
From: munin@webextra.osgeo.osuosl.org
Date: Tue, 19 Mar 2013 23:40:08 -0700 (PDT)
Subject: Munin Notification backup.osgeo.org Disk usage in percent
To: munin@localhost
osgeo.org :: backup.osgeo.org :: Disk usage in percent
WARNINGs: /backup is 97.52 (outside range [:92]).
... we really need more disk space (now!). Simply deleting some
backups is not a solution.
Best
Markus
On 03/20/2013 01:56 AM, Markus Neteler wrote:
---------- Forwarded message ----------
From: munin@webextra.osgeo.osuosl.org
Date: Tue, 19 Mar 2013 23:40:08 -0700 (PDT)
Subject: Munin Notification backup.osgeo.org Disk usage in percent
To: munin@localhostosgeo.org :: backup.osgeo.org :: Disk usage in percent
WARNINGs: /backup is 97.52 (outside range [:92]).
... we really need more disk space (now!). Simply deleting some
backups is not a solution.Best
Markus
Email sent to OSUOSL on previous ticket. I proposed $1500-$2500 for 4-6TB of backup (That's a 1U server with 2 or 3 TB disks in RAID 6).
If they can offer backup service under $1000/yr I might suggest we take that, assuming our backup solution is about the same cost per year on a 3-5 year. Otherwise I've asked for them to price a machine to meet those needs.
I do think some people do need to sit down an audit what is backed up especially on Projects and Adhoc where we might be backing up things like Tile Caches on accident. I noticed a few users home directories being in the 7 G+ range and wonder if we really need to backup all the data in those folders.
When I get a chance I'll glance at the rules to make sure we're not keeping too many copies of things that don't change often/ever and see how many days worth of Trac/SVN we're hanging on to.
Thanks,
Alex
On Wed, Mar 20, 2013 at 6:59 PM, Alex Mandel <tech_dev@wildintellect.com> wrote:
...
I do think some people do need to sit down an audit what is backed up
especially on Projects and Adhoc where we might be backing up things like
Tile Caches on accident. I noticed a few users home directories being in the
7 G+ range and wonder if we really need to backup all the data in those
folders.
Likely not (e.g., I can easily identify some stuff in my home to be excluded).
Note that Bacula supports a simple mechanism to exclude directories, for example
by defining:
Exclude Dir Containing = .excludeme
Then simply do this as a user:
cd /path/to/exclude
touch .excludeme
The one (soon) day implemented exclude string should be documented here:
http://wiki.osgeo.org/wiki/SAC:Backups#Bacula
thanks,
Markus
On 03/20/2013 04:15 PM, Markus Neteler wrote:
On Wed, Mar 20, 2013 at 6:59 PM, Alex Mandel <tech_dev@wildintellect.com> wrote:
...I do think some people do need to sit down an audit what is backed up
especially on Projects and Adhoc where we might be backing up things like
Tile Caches on accident. I noticed a few users home directories being in the
7 G+ range and wonder if we really need to backup all the data in those
folders.Likely not (e.g., I can easily identify some stuff in my home to be excluded).
Note that Bacula supports a simple mechanism to exclude directories, for example
by defining:Exclude Dir Containing = .excludeme
Then simply do this as a user:
cd /path/to/exclude
touch .excludemeThe one (soon) day implemented exclude string should be documented here:
http://wiki.osgeo.org/wiki/SAC:Backups#Baculathanks,
Markus
I'm well aware of how to configure bacula. It's a policy question/issue not a technical one. Basically, do we assign quotas, tell people it has to be in folder x, or come up with some other way to differentiate what actually needs to be backed up vs what is random stuff or easily retrievable from other sources (public data sets)?
Thanks,
Alex
Hi,
On Fri, Apr 5, 2013 at 4:30 PM, <munin@webextra.osgeo.osuosl.org> wrote:
osgeo.org :: backup.osgeo.org :: Disk usage in percent
WARNINGs: /backup is 97.99 (outside range [:92]).
so, the crash is forthcoming... (if no action is taken).
On Thu, Mar 21, 2013 at 12:15 AM, Markus Neteler <neteler@osgeo.org> wrote:
...
Note that Bacula supports a simple mechanism to exclude directories, for example
by defining:Exclude Dir Containing = .excludeme
Then simply do this as a user:
cd /path/to/exclude
touch .excludeme
Any chance to get this added to the Bacula conf?
I really hesitate to hack it myself.
thanks
Markus
On Fri, Apr 05, 2013 at 04:42:29PM +0200, Markus Neteler wrote:
I really hesitate to hack it myself.
Instead adding dozends of excludes to the Bacula backup configuration,
my favourite is still to sensibly separate various stuff into different
directory trees and finally just to back up the relevant parts.
Volatile content like a TileCache cache dir for example would find a
perfect place below /var/cache/ - and then we'll add a general rule to
prevent backup of /var/cache/ on *every* server.
This just requires someone to resume communication with the affected
projects.
Cheers,
Martin.
--
Unix _IS_ user friendly - it's just selective about who its friends are !
--------------------------------------------------------------------------
On Fri, Apr 5, 2013 at 5:11 PM, Martin Spott <Martin.Spott@mgras.net> wrote:
On Fri, Apr 05, 2013 at 04:42:29PM +0200, Markus Neteler wrote:
I really hesitate to hack it myself.
Instead adding dozends of excludes to the Bacula backup configuration,
my favourite is still to sensibly separate various stuff into different
directory trees and finally just to back up the relevant parts.
Volatile content like a TileCache cache dir for example would find a
perfect place below /var/cache/ - and then we'll add a general rule to
prevent backup of /var/cache/ on *every* server.This just requires someone to resume communication with the affected
projects.
Do we have a volunteer?
For the list:
On Sun, May 12, 2013 at 12:50 AM, <munin@webextra.osgeo.osuosl.org> wrote:
osgeo.org :: backup.osgeo.org :: Disk usage in percent
WARNINGs: /backup is 97.28 (outside range [:92]).
... the problem is back.
ciao
Markus