Did MapBender get migrated to the alternate data store? Did it work OK?
-----Original Message-----
From: sac-bounces@lists.osgeo.org [mailto:sac-bounces@lists.osgeo.org]
On Behalf Of Robert Bray
Sent: Wednesday, February 14, 2007 15:57
To: System Administration Committee Discussion/OSGeo
Subject: [SAC] MapGuide SVN Down Again
Importance: High
After some investigation, it appears that the backup scripts are causing the issue. We had backup scripts being run out of /home/sbarnes/scripts that were hung, then root came along and ran its own (and hung). It appears interaction of these scripts is locking the repository and causing our issues.
Shawn,
Can you investigate why crons might still be running out of your home directory? Here's what the process table looked like when I checked earlier tonight:
I think some of our repositories are quite large to be doing full dumps as frequently as we are (~8 times per day). Gzipped, the mapguide repository is ~710mb, and doing a full delta dump of probably takes quite a while and is stepping on incoming commits.
I propose change things to do incrementals throughout the day at the same frequency we are currently doing them and a single full backup outside of peak development hours. Someone please propose a good UTC time to do a full dump so as not to step on folks. We are worldly enough to make this somewhat hard
Howard
On Feb 14, 2007, at 6:09 PM, Jason Birch wrote:
Did MapBender get migrated to the alternate data store? Did it work OK?
-----Original Message-----
From: sac-bounces@lists.osgeo.org [mailto:sac-bounces@lists.osgeo.org]
On Behalf Of Robert Bray
Sent: Wednesday, February 14, 2007 15:57
To: System Administration Committee Discussion/OSGeo
Subject: [SAC] MapGuide SVN Down Again
Importance: High
2nd time today...help!
Thanks,
Bob
_______________________________________________
Sac mailing list
Sac@lists.osgeo.org Sac Info Page
_______________________________________________
Sac mailing list
Sac@lists.osgeo.org Sac Info Page
After some investigation, it appears that the backup scripts are causing the issue. We had backup scripts being run out of /home/sbarnes/scripts that were hung, then root came along and ran its own (and hung). It appears interaction of these scripts is locking the repository and causing our issues.
Have you looked at using svnadmin hotcopy? Per the manual:
"You can run this command at any time and make a safe copy of the repository, regardless of whether other processes are using the repository."
- -gary
On Feb 14, 2007, at 4:19 PM, Howard Butler wrote:
Fixed.
After some investigation, it appears that the backup scripts are causing the issue. We had backup scripts being run out of /home/sbarnes/scripts that were hung, then root came along and ran its own (and hung). It appears interaction of these scripts is locking the repository and causing our issues.
Shawn,
Can you investigate why crons might still be running out of your home directory? Here's what the process table looked like when I checked earlier tonight:
I think some of our repositories are quite large to be doing full dumps as frequently as we are (~8 times per day). Gzipped, the mapguide repository is ~710mb, and doing a full delta dump of probably takes quite a while and is stepping on incoming commits.
I propose change things to do incrementals throughout the day at the same frequency we are currently doing them and a single full backup outside of peak development hours. Someone please propose a good UTC time to do a full dump so as not to step on folks. We are worldly enough to make this somewhat hard
Howard
On Feb 14, 2007, at 6:09 PM, Jason Birch wrote:
Did MapBender get migrated to the alternate data store? Did it work OK?
-----Original Message-----
From: sac-bounces@lists.osgeo.org [mailto:sac-bounces@lists.osgeo.org]
On Behalf Of Robert Bray
Sent: Wednesday, February 14, 2007 15:57
To: System Administration Committee Discussion/OSGeo
Subject: [SAC] MapGuide SVN Down Again
Importance: High
After some investigation, it appears that the backup scripts are causing
the issue. We had backup scripts being run out of /home/sbarnes/scripts
that were hung, then root came along and ran its own (and hung). It
appears interaction of these scripts is locking the repository and
causing our issues.
Shawn,
Can you investigate why crons might still be running out of your home
directory? Here's what the process table looked like when I checked
earlier tonight:
I think some of our repositories are quite large to be doing full dumps
as frequently as we are (~8 times per day). Gzipped, the mapguide
repository is ~710mb, and doing a full delta dump of probably takes
quite a while and is stepping on incoming commits.
I propose change things to do incrementals throughout the day at the
same frequency we are currently doing them and a single full backup
outside of peak development hours. Someone please propose a good UTC
time to do a full dump so as not to step on folks. We are worldly
enough to make this somewhat hard
Howard
On Feb 14, 2007, at 6:09 PM, Jason Birch wrote:
Did MapBender get migrated to the alternate data store? Did it work OK?
-----Original Message-----
From: sac-bounces@lists.osgeo.org [mailto:sac-bounces@lists.osgeo.org]
On Behalf Of Robert Bray
Sent: Wednesday, February 14, 2007 15:57
To: System Administration Committee Discussion/OSGeo
Subject: [SAC] MapGuide SVN Down Again
Importance: High
I've fixed the script to not use the backup scripts in ~/sbarnes
I've ran tests with the same setup on a test box i have using the same
scripts for backup and the bdb doesn't cause a lock that needs a recover
or hang. But, yes the dumps do take quite a bit of time to complete.
Definitely an incremental backup is the better way to backup the
repositories.
shawn
shawn barnes wrote:
Yes, i'll look into this right now.
Howard Butler wrote:
Fixed.
After some investigation, it appears that the backup scripts are causing
the issue. We had backup scripts being run out of /home/sbarnes/scripts
that were hung, then root came along and ran its own (and hung). It
appears interaction of these scripts is locking the repository and
causing our issues.
Shawn,
Can you investigate why crons might still be running out of your home
directory? Here's what the process table looked like when I checked
earlier tonight:
I think some of our repositories are quite large to be doing full dumps
as frequently as we are (~8 times per day). Gzipped, the mapguide
repository is ~710mb, and doing a full delta dump of probably takes
quite a while and is stepping on incoming commits.
I propose change things to do incrementals throughout the day at the
same frequency we are currently doing them and a single full backup
outside of peak development hours. Someone please propose a good UTC
time to do a full dump so as not to step on folks. We are worldly
enough to make this somewhat hard
Howard
On Feb 14, 2007, at 6:09 PM, Jason Birch wrote:
Did MapBender get migrated to the alternate data store? Did it work OK?
-----Original Message-----
From: sac-bounces@lists.osgeo.org [mailto:sac-bounces@lists.osgeo.org]
On Behalf Of Robert Bray
Sent: Wednesday, February 14, 2007 15:57
To: System Administration Committee Discussion/OSGeo
Subject: [SAC] MapGuide SVN Down Again
Importance: High