The Continuing Story of ... (9 comments)

The Continuing Story of ...

Tuesday, January 18, 2005 - 11:31 AM

As you may have noticed, we've had a couple of ...issues... lately. For this, I apologize. As much as I hated having the machines in my apartment, they seemed so much more stable then. I'm working on fixing downtime stuff, and it's refreshing to have an ISP that's working with me. So kudos (thus far) to voxrox. I'm going to delve, very briefly, into the tech stuff, so feel free to skip this and go mock Zamphir in the other forums, if you don't care about that stuff.

This morning's issue was caused by a routine update to MySQL. After installing a bug-fix release, it spontaneously refused to admit that three tables were there (the series table, and two holding user-options). It appeared that the InnoDB table space was corrupted in such a way that if I tried to drop the corrupted tables, it would tell me that they didn't exist, but if I tried to recreate them, it would tell me that they were already there, and I should drop them first. Somewhat frustrating. Luckily, our nightly database backup runs at 7.30 in the AM, and this occurred around a half hour later, so, I just deleted everything, and then recreated all from scratch. My hope/assumption, is that there was some latent corruption in the InnoDB files that the latest update was more sensitive to. Seeing as how these are the same files, copied from machine to machine, that were running in my apartment, and then on the crappy Interland servers, I wouldn't be surprised if they were somewhat funky.

The other, more usual, issue is with the web server, not the database. For some reason, every once in a while an apache process decides that it really, really needs more CPU time, and that pesky things like "the operating system" shouldn't be allowed to kill it. This is...odd. There's the possibility of flaky RAM in the machine, which will be subbed out sometime in the next day or so, there's also the possibility of library mismatches from an upgraded perl that was not recompiled into a newer mod_perl. There's also the possibility that I'm talking out of my ass, and have no clue what is causing this. Only time will tell.

wjblack
wjblack

Initiate

From: Sillyclone Valley, CA

Posts: 11

Registered:
Oct 2004
Re: The Continuing Story of ... (Score: 1)
posted Tuesday, January 18, 2005 - 02:26 PM (#24290)
Didja...

mysqldump(1) at some point,
drop the tables,
stop mysqld,
rm /var/lib/mysql//.*,
and mysql -u -p dumpfile.sql

???

Not to be pedantic, but that's really the only way to thoroughly restore MySQL tables without cruftiness (assuming a single db server). That said, my DBs have been running on an old Cobalt Raq 3 (in Columbus, no less) continuously for two years without issue (I mysqldump them once a week and scp that from the colo for backups--good enough for personal carp).
Locked profile
mcgrue
mcgrue

Code Monk

From: A little blastocyst and a lot of time.

Posts: 725

Registered:
Aug 2002
Re: The Continuing Story of ... (Score: 3, Insightful)
posted Tuesday, January 18, 2005 - 03:26 PM (#24292)
In Response to wjblack (#24290):

Unlike in social situations, pedantry is a blessing to programming and IT in general.
--
I like my food irradiated, just like Mother Artifice intended it to be.
Locked profile www
Lonely Goatherd
Lonely Goatherd
Re: The Continuing Story of ... (Score: 3, Super-Genius)
posted Tuesday, January 18, 2005 - 07:50 PM (#24295)
Your mother thinks you are just so talented! All those complicated ideas and you got it going in any case. Tack så
  mycket!
Lotsaluv, Mammakiwi
Locked
phillip
phillip

Chief Goatherd

Posts: 414

Registered:
Jul 2000
Re: The Continuing Story of ... (Score: 2)
posted Tuesday, January 18, 2005 - 08:28 PM (#24296)
In Response to wjblack (#24290):

...except that I couldn't drop the tables. So I deleted each database's directory, the inbdata (and their log) files, and then started MySQL back up, so it would recreate them, and then remade all the databases from scratch.
--
Work is the curse of the drinking classes.
-Oscar Wilde
Locked profile
tor
tor

Code Monk

From: Sydney

Posts: 766

Registered:
Sep 2000
Re: The Continuing Story of ... (Score: 3, Clever)
posted Tuesday, January 18, 2005 - 10:01 PM (#24297)
In Response to phillip (#24296):

Sheesh and I thought a post from you here was going to be "Mum, I told you to log in before posting"
Locked profile
phillip
phillip

Chief Goatherd

Posts: 414

Registered:
Jul 2000
Re: The Continuing Story of ... (Score: 3, Intriguing)
posted Wednesday, January 19, 2005 - 07:22 AM (#24299)
In Response to tor (#24297):

she does have an account....
--
Work is the curse of the drinking classes.
-Oscar Wilde
Locked profile
Deathalicious
Deathalicious

Code Monk

From: Charlottesville!

Posts: 871

Registered:
Oct 2003
Re: The Continuing Story of ... (Score: 3, Clever)
posted Wednesday, January 19, 2005 - 08:18 PM (#24306)
In Response to phillip (#24299):

It's eltoro, isn't it.
--
Good evening. I am the main Dish of the Day. May I interest you in the parts of my body?
Locked profile
unFalln
Code Monk

Posts: 1285

Registered:
Jul 2002
Re: The Continuing Story of ... (Score: 3, Intriguing)
posted Wednesday, January 19, 2005 - 10:24 PM (#24307)
In Response to Deathalicious (#24306):

Nah, eltoro is Tor's younger brother.
Locked profile
Deathalicious
Deathalicious

Code Monk

From: Charlottesville!

Posts: 871

Registered:
Oct 2003
Re: The Continuing Story of ... (Score: 2)
posted Thursday, January 20, 2005 - 10:42 AM (#24323)
In Response to unFalln (#24307):

ugh. incest [goats.com]
--
Good evening. I am the main Dish of the Day. May I interest you in the parts of my body?
Locked profile
Threshold:  Locked
The Fine Print: The above comments are owned by whoever posted them. We are not responsible for them in any way.
Hell, let's face it, we're not responsible for anything; including the things we say, do, or think. And if you sue us because you think we are? Well, we're not responsible for that either.