3Ware Raid Array I/O Wait help
I need some advise on an issue I'm experiencing, I have my thoughts, but I'm hoping someone can give me another opinion.
Background:
Supermicro Chassis and Mainboard
Dual Xenon Quad Core Processors
8GB ECC RAM
3Ware 9650SE 4Port Raid Card
4 Seagate 500GB drives in RAID 10
1 1TB WD drive on mainboard for backup
The system has recently gotten very slow and the load is hitting 20-30 during peak time. It used to max out around 6-8 during backups.
Most of the cpu usage (approximately 25%-40%) is sitting in the io wait state.
tw_cli shows the array as optimal, however I'm seeing a number of sector repairs occurring. (log enteries below):
3w-9xxx: scsi0: AEN: WARNING (0x04:0x0023): Sector repair completed:port=0, LBA=0x190A60.
3w-9xxx: scsi0: AEN: WARNING (0x04:0x0023): Sector repair completed:port=0, LBA=0x12CEBA1.
3w-9xxx: scsi0: AEN: INFO (0x04:0x0055): Battery charging started:.
3w-9xxx: scsi0: AEN: INFO (0x04:0x0056): Battery charging completed:.
3w-9xxx: scsi0: AEN: INFO (0x04:0x0053): Battery capacity test is overdue:.
conntrack_ftp: partial 227 2785272048+13
conntrack_ftp: partial 227 2785272048+13
3w-9xxx: scsi0: AEN: WARNING (0x04:0x0023): Sector repair completed:port=0, LBA=0x17AC407.
3w-9xxx: scsi0: AEN: WARNING (0x04:0x0023): Sector repair completed:port=0, LBA=0x5DBE514.
My best guess is that its either a failing drive or failing card but I'd like a second opinion. I'm also curious if it is a failing drive why has the controller not marked it as such?
Any and all opinions will be graciously accepted.
Thanks
