[SAC] [OSGeo] #126: mysql binary logs filling disk

Committees SAC mailing list
1

#126: mysql binary logs filling disk
----------------------+-----------------------------------------------------
Reporter: warmerdam | Owner: sac@lists.osgeo.org
    Type: task | Status: new
Priority: major | Component: SAC
Keywords: |
----------------------+-----------------------------------------------------
On www.osgeo.org the mysql binary logs in /var/lib/mysql have grown to
175GB, filling the disks.

It seems these logs are described at:

   http://dev.mysql.com/doc/refman/5.0/en/binary-log.html

I have purged some older logs by issuing the following mysql command:

   purge master logs before '2007-06-01';

But I think we need to figure out why the logs are so huge, whether we
even need them, and how to purge them more appropriately. According to
notes in the purge command docs you can set an automatic purge limit in
your mysql.cnf file using the expire_log_days keyword.

--
Ticket URL: <http://trac.osgeo.org/osgeo/ticket/126&gt;
OSGeo <http://www.osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

2

#126: mysql binary logs filling disk
------------------------+---------------------------------------------------
  Reporter: warmerdam | Owner: sac@lists.osgeo.org
      Type: task | Status: new
  Priority: major | Component: SAC
Resolution: | Keywords:
------------------------+---------------------------------------------------
Comment (by sbarnes):

The original reason for using binary logs is for doing incremental backups
via mysql Zamanda Recovery tool. Binary logs are a requirment for the
tool.

http://mysqlbackup.zmanda.com/index.php/Quick_start_example

I'm not married to this tool if anyone has a better suggestion.

--
Ticket URL: <http://trac.osgeo.org/osgeo/ticket/126#comment:1&gt;
OSGeo <http://www.osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

3

#126: mysql binary logs filling disk
------------------------+---------------------------------------------------
  Reporter: warmerdam | Owner: sac@lists.osgeo.org
      Type: task | Status: new
  Priority: major | Component: SAC
Resolution: | Keywords:
------------------------+---------------------------------------------------
Comment (by warmerdam):

Shawn,

Is Zamanda backup in place for mysql? How long do the binary logs need to
be kept around?

--
Ticket URL: <http://trac.osgeo.org/osgeo/ticket/126#comment:2&gt;
OSGeo <http://www.osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.

4

#126: mysql binary logs filling disk
------------------------+---------------------------------------------------
  Reporter: warmerdam | Owner: sac@lists.osgeo.org
      Type: task | Status: new
  Priority: major | Component: SAC
Resolution: | Keywords:
------------------------+---------------------------------------------------
Comment (by sbarnes):

Frank,

Yes, Zamanda is running. The binary logs have to be kept as long as we
keep the backup, we can set the number of days to whatever we want.

Right now zamanda keeps logs for 1 week. So we can purge the binary logs
older than one week.

--
Ticket URL: <http://trac.osgeo.org/osgeo/ticket/126#comment:3&gt;
OSGeo <http://www.osgeo.org/&gt;
OSGeo committee and general foundation issue tracker.