Topic: Raid Error stopping Server from Booting after Power Outage

[pwgsc1]

I had an unplanned power outage last night due to a wind storm.  ON reboot my Server gives me a Raid error and will not boot up.

Here's what is displayed on the screen when it panics.

raid5: device hda2 Operational as raid disk 0
raid5: device hdc2 Operational as raid disk 2
raid5: cannot start dirty degraded array for md2
RAID5 conf printout:
--- rd:3 wd:2 fd:1
disk 0, o:1,  dev:hda2
disk 2, o:1,  dev:hdc2
raid5: failed to run raid set md2
md: pers->run() failed....
mdadm: failed to RUN_ARRAY /dev/md2: Invalid argument
Making device-mapper control mode
Scanning logical volumes
  Reading all physical volumes. This may take a while
Activating logical volumes
  Volume group "main" not found
ERROR: /bin/lvm exited bnormally! (pid 469)
creating root device
Mounting root filesystem
mount:  error 6 mounting ext3
mount: error 2 mounting none
Switching to new root
switchroot: mount failed: 22
unmount /initrd/dev failed: 2
kernel panic - not syncing: attempted to kill init!

is there anyway to attach files in the forum? it's a bit of a pain having to type out screen shots.  But if I got to.....I will.

I did some updates a few days ago and the Server rebooted no problem.

Thanks for any help you can provide

Craig

[pwgsc1]

Making some progress...

- Booted from SME Server CD
- Went into SME Rescue mode
- was able to rebuild MD2 raid with
   mdadm --assemble -- force  /dev/md2 /dev/hda1 /dev/hdb1 /dev/hdc1
- do the cat /proc/mdstat command and everything looks ok
- On a reboot I still get the errors in the first post

My questions now are:

- How do I access the raid drives to try and recover some data?

- is there a way that I can force the raid to rebuild and save these updates so on a reboot it boots ok.


Thanks,

Craig

[mophilly]

- is there a way that I can force the raid to rebuild and save these updates so on a reboot it boots ok.

Have you seen this: http://wiki.contribs.org/Raid#Resynchronising_a_Failed_RAID

[pwgsc1]

Hi Folks,

My raid is back up and running...........I don't know how i did it but it's working.

- First I was getting the error mentioned in my first post
- I tried disconnecting each of the 3 drives to see if it would boot......it didn't. Same error
- Went into sme rescue mode and tried some things I found on the web.
- I was able to do mdadm --assembe --force   to get the raid back up.
- Tried some other things but the raid did not appear to rebuild on a reboot

- My last attempt was to try disconnecting  one hard drive at a time to see if it would boot.
- After disconnecting hdb the server booted up and did a check of the remaining hard disks
- Server is now up and running but missing a hard disk
- I said shag it!!  I reconnected hdb and when I went to look at the array from the Admin menu it said "NEW DRIVE HAS BEEN ADDED, DO YOU WANT TO ADD IT TO THE ARRAY" .  I said yes and 12 hours later the array is back up and running.

Like I said, don't know what i did but obviously something.  I did have a backup of my most important data but I'm doing to throw more directories into my AFFA job to cover all my bases.

Craig

[cactus]

I had an unplanned power outage last night due to a wind storm. 

Do you ever plan them?

Good to hear you have server back online again. I would advice you to test your disks, especially the faulty one.