[clue-tech] Failing drive [was Re: virtualization]

Maxwell Spangler maxlists at maxwellspangler.com
Sat Jul 31 20:04:41 MDT 2010


On Sat, 2010-07-31 at 06:50 -0600, Jim Ockers wrote:

> Could you please post the results of "smartctl -a /dev/hdX" for your
> hard drive?  I am interested to see the SMART information and extended
> attributes (with counters) to see what this drive failure might "look"
> like on the SMART output.
> 
> I am working on a large scale disk testing and failure analysis
> project.  (Not as large scale as google's, and specific to our usage,
> but they are similar in concept.)  Also I do SMART monitoring for my
> own hard drives and in fact it was the SMART hard drives that informed
> me that the internal fans had failed in one of my cases because the
> drives were 60C (way overheated) and claiming they were about to fail.

Hi Jim,

smartctl 5.39.1 2010-01-28 r3054 [x86_64-redhat-linux-gnu] (local build)
Copyright (C) 2002-10 by Bruce Allen,
http://smartmontools.sourceforge.net

=== START OF INFORMATION SECTION ===
Model Family:     Seagate Barracuda 7200.12 family
Device Model:     ST3750528AS
Serial Number:    9VP420DS
Firmware Version: HP34
User Capacity:    750,156,374,016 bytes
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   8
ATA Standard is:  ATA-8-ACS revision 4
Local Time is:    Sat Jul 31 19:57:21 2010 MDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x82)	Offline data collection activity
					was completed without error.
					Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0)	The previous self-test routine
completed
					without error or no self-test has ever 
					been run.
Total time to complete Offline 
data collection: 		 ( 617) seconds.
Offline data collection
capabilities: 			 (0x5b) SMART execute Offline immediate.
					Auto Offline data collection on/off support.
					Suspend Offline collection upon new
					command.
					Offline surface scan supported.
					Self-test supported.
					No Conveyance Self-test supported.
					Selective Self-test supported.
SMART capabilities:            (0x0003)	Saves SMART data before entering
					power-saving mode.
					Supports SMART auto save timer.
Error logging capability:        (0x01)	Error logging supported.
					General Purpose Logging supported.
Short self-test routine 
recommended polling time: 	 (   2) minutes.
Extended self-test routine
recommended polling time: 	 ( 149) minutes.
SCT capabilities: 	       (0x103f)	SCT Status supported.
					SCT Feature Control supported.
					SCT Data Table supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE
UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   114   099   006    Pre-fail  Always
-       76516893
  3 Spin_Up_Time            0x0023   095   095   000    Pre-fail  Always
-       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always
-       68
  5 Reallocated_Sector_Ct   0x0033   100   100   036    Pre-fail  Always
-       3
  7 Seek_Error_Rate         0x002f   069   060   030    Pre-fail  Always
-       7482307
  9 Power_On_Hours          0x0032   099   099   000    Old_age   Always
-       1700
 10 Spin_Retry_Count        0x0033   100   100   097    Pre-fail  Always
-       0
 12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always
-       45
180 Unused_Rsvd_Blk_Cnt_Tot 0x002b   100   100   000    Pre-fail  Always
-       3769
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always
-       0
184 End-to-End_Error        0x0033   100   100   097    Pre-fail  Always
-       0
187 Reported_Uncorrect      0x0032   092   092   000    Old_age   Always
-       8
188 Command_Timeout         0x0032   100   097   000    Old_age   Always
-       262150
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always
-       0
190 Airflow_Temperature_Cel 0x0022   064   057   045    Old_age   Always
-       36 (Lifetime Min/Max 23/36)
194 Temperature_Celsius     0x0022   036   043   000    Old_age   Always
-       36 (0 16 0 0)
195 Hardware_ECC_Recovered  0x003a   055   038   000    Old_age   Always
-       76516893
196 Reallocated_Event_Count 0x0032   100   100   036    Old_age   Always
-       3
197 Current_Pending_Sector  0x0032   100   100   000    Old_age   Always
-       0
198 Offline_Uncorrectable   0x0030   100   100   000    Old_age
Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always
-       0

SMART Error Log Version: 1
ATA Error Count: 101 (device log contains only the most recent five
errors)
	CR = Command Register [HEX]
	FR = Features Register [HEX]
	SC = Sector Count Register [HEX]
	SN = Sector Number Register [HEX]
	CL = Cylinder Low Register [HEX]
	CH = Cylinder High Register [HEX]
	DH = Device/Head Register [HEX]
	DC = Device Command Register [HEX]
	ER = Error register [HEX]
	ST = Status register [HEX]
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.

Error 101 occurred at disk power-on lifetime: 1668 hours (69 days + 12
hours)
  When the command that caused the error occurred, the device was active
or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 51 00 12 d9 30 09  Error: UNC at LBA = 0x0930d912 = 154196242

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  42 00 00 0b d9 30 e9 00      00:12:16.756  READ VERIFY SECTOR(S) EXT
  42 00 00 00 d8 30 e9 00      00:12:13.679  READ VERIFY SECTOR(S) EXT
  42 00 00 00 58 2c e9 00      00:12:12.369  READ VERIFY SECTOR(S) EXT
  42 00 00 00 68 1c 49 00      00:12:07.756  READ VERIFY SECTOR(S) EXT
  42 00 00 00 b0 14 e9 00      00:12:05.538  READ VERIFY SECTOR(S) EXT

Error 100 occurred at disk power-on lifetime: 1668 hours (69 days + 12
hours)
  When the command that caused the error occurred, the device was active
or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 51 00 0a d9 30 09  Error: UNC at LBA = 0x0930d90a = 154196234

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  42 00 00 00 d8 30 e9 00      00:12:13.679  READ VERIFY SECTOR(S) EXT
  42 00 00 00 58 2c e9 00      00:12:12.369  READ VERIFY SECTOR(S) EXT
  42 00 00 00 68 1c 49 00      00:12:07.756  READ VERIFY SECTOR(S) EXT
  42 00 00 00 b0 14 e9 00      00:12:05.538  READ VERIFY SECTOR(S) EXT
  42 00 00 00 c0 04 49 00      00:12:00.925  READ VERIFY SECTOR(S) EXT

Error 99 occurred at disk power-on lifetime: 1666 hours (69 days + 10
hours)
  When the command that caused the error occurred, the device was active
or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 51 00 12 d9 30 09  Error: UNC at LBA = 0x0930d912 = 154196242

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  42 00 00 0b d9 30 e9 00      04:09:02.087  READ VERIFY SECTOR(S) EXT
  42 00 00 00 d8 30 49 00      04:08:59.034  READ VERIFY SECTOR(S) EXT
  42 00 00 00 90 2f e9 00      04:08:58.669  READ VERIFY SECTOR(S) EXT
  42 00 00 00 a0 1f e9 00      04:08:54.062  READ VERIFY SECTOR(S) EXT
  42 00 00 00 b0 0f e9 00      04:08:49.458  READ VERIFY SECTOR(S) EXT

Error 98 occurred at disk power-on lifetime: 1666 hours (69 days + 10
hours)
  When the command that caused the error occurred, the device was active
or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 51 00 0a d9 30 09  Error: UNC at LBA = 0x0930d90a = 154196234

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  42 00 00 00 d8 30 49 00      04:08:59.034  READ VERIFY SECTOR(S) EXT
  42 00 00 00 90 2f e9 00      04:08:58.669  READ VERIFY SECTOR(S) EXT
  42 00 00 00 a0 1f e9 00      04:08:54.062  READ VERIFY SECTOR(S) EXT
  42 00 00 00 b0 0f e9 00      04:08:49.458  READ VERIFY SECTOR(S) EXT
  42 00 00 00 c0 ff e8 00      04:08:44.828  READ VERIFY SECTOR(S) EXT

Error 97 occurred at disk power-on lifetime: 1662 hours (69 days + 6
hours)
  When the command that caused the error occurred, the device was active
or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  04 51 00 00 00 00 00  Error: ABRT

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  b0 d4 01 81 4f c2 a0 00      00:00:51.327  SMART EXECUTE OFF-LINE
IMMEDIATE
  b0 d0 01 00 4f c2 a0 00      00:00:51.016  SMART READ DATA
  b0 d8 01 00 4f c2 a0 00      00:00:51.015  SMART ENABLE OPERATIONS
  b0 d0 01 00 4f c2 a0 00      00:00:47.592  SMART READ DATA
  b0 d8 01 00 4f c2 a0 00      00:00:47.591  SMART ENABLE OPERATIONS

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining
LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%      1678
-
# 2  Short offline       Completed without error       00%      1675
-
# 3  Short offline       Completed: read failure       90%      1675
154196234
# 4  Short captive       Completed: read failure       90%      1662
154196234
# 5  Short captive       Completed: read failure       90%      1661
154196234
# 6  Extended captive    Completed: read failure       90%      1661
154196234
# 7  Short captive       Completed: read failure       90%      1661
154196234

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute
delay.


-- 
Maxwell Spangler
========================================================================
        Linux, Unix and Database Administration
        Currently: Boulder, Colorado
        LinkedIn: http://www.linkedin.com/in/maxwellspangler

        



More information about the clue-tech mailing list