Skip to content

Lions and Tigers and Unscheduled Outages, Oh My!

Posted by mikeg on
UNIX

 For those of you wondering where bsd-box.net went this weekend, here's the scoop:

A while back I stopped being a data protection douche and implemented backups.  I didn't blog about the implementation, but it was bacula writing to rsync.net over sshfs (fuse for the win).

These backups worked fine for a good while, but on Friday (my first full backup since upgrading to 8.0) the damn thing blew up and took the server down with it.  Near as I can tell without being on the console something caused the FUSE kernel module to go insane - The system goes unresponsive, starts taking forever to respond to pings and eventually falls over entirely.

Troubleshooting that mess is on my list as soon as I can reproduce the problem in a test lab, but until then bsd-box.net is running a ghetto-ass tar-then-SCP backup routine (so I'm not a data protection douche since I've still got backups, but my backups are decidedly more ghetto).

 

Those of you who sent me emails, panic not: I have a very fine secondary MX which will eventually despool whatever you sent me.  If it's urgent go ahead and resend.

Trackbacks

No Trackbacks

Comments

Display comments as Linear | Threaded

No comments

Add Comment

E-Mail addresses will not be displayed and will only be used for E-Mail notifications.
To leave a comment you must approve it via e-mail, which will be sent to your address after submission.

To prevent automated Bots from commentspamming, please enter the string you see in the image below in the appropriate input box. Your comment will only be submitted if the strings match. Please ensure that your browser supports and accepts cookies, or your comment cannot be verified correctly.
CAPTCHA

Twitter, Pavatar, Gravatar author images supported.
Form options