Hi All,
I owned a TS869Pro with 8 x 2TB disks populated in the box configured with RAID5 on 7 disks plus 1 hot spare. Recently, I've RMAed one of the disk due to bad sector and during which when I pulled out the faulty disk my hot spare kick in for rebuilt. But apparently when my refurbished disk is back, I plugged in the disk replacement disk with the box shutdown and when I boot up the NAS I was shocked that my array went missing. I'm definitely in panic mode....
After much reading in this forum and understand that there are other experiencing the same, I applied their approach of unplugging all disks in their order and plug it back then boot up the box. I've attempted 3 times at least finally got to see my array in one piece else kept prompting me not active.
Now I have a different situation where the rebuild kick in again on the replacement disk I plugged in earlier. Strangely, the status report for my volume remained at read only status, please see attached screenshot below and the status LED kept flipping between red and green every 0.5 second. I've read up the manual and get to understand that the LED status is showing the Array is in rebuilding stage and hence I have choose to leave it alone for the past 5 days where till date status remains the same.
Would there be any kind soul to advise me what is the actual status for the volume now ? How can I manually trigger an array rebuild ? Is this normal ? I'm starting to loose my confident on the hardware.
Thanks for the help in advance..
BR
David
Need help on my RAID Rebuilt
-
- New here
- Posts: 6
- Joined: Wed Mar 20, 2013 11:32 am
Need help on my RAID Rebuilt
You do not have the required permissions to view the files attached to this post.
- pwilson
- Guru
- Posts: 22533
- Joined: Fri Mar 06, 2009 11:20 am
- Location: Victoria, BC, Canada (UTC-08:00)
Re: Need help on my RAID Rebuilt
You can check progress from the command line. Login to your NAS via SSH, and run the following commands:xmustang74 wrote:Hi All,
I owned a TS869Pro with 8 x 2TB disks populated in the box configured with RAID5 on 7 disks plus 1 hot spare. Recently, I've RMAed one of the disk due to bad sector and during which when I pulled out the faulty disk my hot spare kick in for rebuilt. But apparently when my refurbished disk is back, I plugged in the disk replacement disk with the box shutdown and when I boot up the NAS I was shocked that my array went missing. I'm definitely in panic mode....
After much reading in this forum and understand that there are other experiencing the same, I applied their approach of unplugging all disks in their order and plug it back then boot up the box. I've attempted 3 times at least finally got to see my array in one piece else kept prompting me not active.
Now I have a different situation where the rebuild kick in again on the replacement disk I plugged in earlier. Strangely, the status report for my volume remained at read only status, please see attached screenshot below and the status LED kept flipping between red and green every 0.5 second. I've read up the manual and get to understand that the LED status is showing the Array is in rebuilding stage and hence I have choose to leave it alone for the past 5 days where till date status remains the same.
Would there be any kind soul to advise me what is the actual status for the volume now ? How can I manually trigger an array rebuild ? Is this normal ? I'm starting to loose my confident on the hardware.
Thanks for the help in advance..
BR
David
Code: Select all
echo "NAS Model: $(getsysinfo model)"
echo "Firmware: $(getcfg system version) Build $(getcfg system 'Build Number')"
echo "System Name: $(/bin/hostname)"
/sbin/hdparm -i /dev/sd[a-h] 2>/dev/null | grep Model
df -h
mount
cat /proc/mdstat
#done
Patrick M. Wilson
Victoria, BC Canada
QNAP TS-470 Pro w/ 4 * Western Digital WD30EFRX WD Reds (RAID5) - - Single 8.1TB Storage Pool FW: QTS 4.2.0 Build 20151023 - Kali Linux v1.06 (64bit)
Forums: View My Profile - Search My Posts - View My Photo - View My Location - Top Community Posters
QNAP: Turbo NAS User Manual - QNAP Wiki - QNAP Tutorials - QNAP FAQs
Please review: When you're asking a question, please include the following.
-
- New here
- Posts: 6
- Joined: Wed Mar 20, 2013 11:32 am
Re: Need help on my RAID Rebuilt
Hi Wilson,
Thanks, please let me try it out.
Thanks, please let me try it out.
-
- New here
- Posts: 6
- Joined: Wed Mar 20, 2013 11:32 am
Re: Need help on my RAID Rebuilt
Hi Wilson,
Please see below for my exported output. Do advise from where I can read the rebuild status. Thanks
[~] # echo "NAS Model: $(getsysinfo model)"
NAS Model: TS-869 Pro
[~] # echo "Firmware: $(getcfg system version) Build $(getcfg system 'Build N umber')"
Firmware: 4.1.0 Build 20131220
[~] # echo "System Name: $(/bin/hostname)"
System Name: XTQNAS
[~] # /sbin/hdparm -i /dev/sd[a-h] 2>/dev/null | grep Model
Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMC300950207
Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMC300950247
Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMC1T3386441
Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMC301239780
Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMAZA8097785
Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMAZA8609767
Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMAZA5390792
Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMC1T3133314
[~] # df -h
Filesystem Size Used Available Use% Mounted on
/dev/ram0 151.1M 138.9M 12.2M 92% /
devtmpfs 1.5G 4.0k 1.5G 0% /dev
tmpfs 64.0M 1.0M 63.0M 2% /tmp
/dev/md9 509.5M 210.3M 299.2M 41% /mnt/HDA_ROOT
/dev/md0 10.8T 3.9T 6.9T 36% /share/MD0_DATA
/dev/md13 364.2M 221.7M 142.5M 61% /mnt/ext
tmpfs 8.0M 0 8.0M 0% /var/syslog_maildir
tmpfs 32.0M 4.0k 32.0M 0% /.eaccelerator.tmp
[~] # mount
/proc on /proc type proc (rw)
devpts on /dev/pts type devpts (rw)
sysfs on /sys type sysfs (rw)
tmpfs on /tmp type tmpfs (rw,size=64M)
none on /proc/bus/usb type usbfs (rw)
/dev/md9 on /mnt/HDA_ROOT type ext3 (rw,data=ordered,user_xattr,acl)
/dev/md0 on /share/MD0_DATA type ext4 (rw,usrjquota=aquota.user,jqfmt=vfsv0,user _xattr,data=ordered,delalloc,acl)
/dev/md13 on /mnt/ext type ext3 (rw,data=ordered)
nfsd on /proc/fs/nfsd type nfsd (rw)
none on /sys/kernel/config type configfs (rw)
tmpfs on /var/syslog_maildir type tmpfs (rw,size=8M)
tmpfs on /.eaccelerator.tmp type tmpfs (rw,size=32M)
[~] # cat /proc/mdstat
Personalities : [linear] [raid0] [raid1] [raid10] [raid6] [raid5] [raid4] [multi path]
md0 : active raid5 sdh3[7](S) sdb3[8] sda3[1] sdg3[6] sde3[5] sdf3[4] sdd3[3] sd c3[2]
11711673600 blocks level 5, 64k chunk, algorithm 2 [7/6] [_UUUU UU]
bitmap: 8/15 pages [32KB], 65536KB chunk
md256 : active raid1 sdh2[7](S) sdg2[6](S) sdf2[5](S) sde2[4](S) sdd2[3](S) sdc2 [2](S) sdb2[1] sda2[0]
530112 blocks super 1.0 [2/2] [UU]
bitmap: 0/1 pages [0KB], 65536KB chunk
md13 : active raid1 sdc4[0] sdg4[6] sdf4[5] sde4[4] sdh4[2] sdd4[1]
458880 blocks [8/6] [UUU_UUU_]
bitmap: 47/57 pages [188KB], 4KB chunk
md9 : active raid1 sdc1[0] sdg1[6] sdf1[5] sde1[4] sdh1[2] sdd1[1]
530048 blocks [8/6] [UUU_UUU_]
bitmap: 60/65 pages [240KB], 4KB chunk
unused devices: <none>
[~] # #done
Please see below for my exported output. Do advise from where I can read the rebuild status. Thanks
[~] # echo "NAS Model: $(getsysinfo model)"
NAS Model: TS-869 Pro
[~] # echo "Firmware: $(getcfg system version) Build $(getcfg system 'Build N umber')"
Firmware: 4.1.0 Build 20131220
[~] # echo "System Name: $(/bin/hostname)"
System Name: XTQNAS
[~] # /sbin/hdparm -i /dev/sd[a-h] 2>/dev/null | grep Model
Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMC300950207
Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMC300950247
Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMC1T3386441
Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMC301239780
Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMAZA8097785
Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMAZA8609767
Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMAZA5390792
Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMC1T3133314
[~] # df -h
Filesystem Size Used Available Use% Mounted on
/dev/ram0 151.1M 138.9M 12.2M 92% /
devtmpfs 1.5G 4.0k 1.5G 0% /dev
tmpfs 64.0M 1.0M 63.0M 2% /tmp
/dev/md9 509.5M 210.3M 299.2M 41% /mnt/HDA_ROOT
/dev/md0 10.8T 3.9T 6.9T 36% /share/MD0_DATA
/dev/md13 364.2M 221.7M 142.5M 61% /mnt/ext
tmpfs 8.0M 0 8.0M 0% /var/syslog_maildir
tmpfs 32.0M 4.0k 32.0M 0% /.eaccelerator.tmp
[~] # mount
/proc on /proc type proc (rw)
devpts on /dev/pts type devpts (rw)
sysfs on /sys type sysfs (rw)
tmpfs on /tmp type tmpfs (rw,size=64M)
none on /proc/bus/usb type usbfs (rw)
/dev/md9 on /mnt/HDA_ROOT type ext3 (rw,data=ordered,user_xattr,acl)
/dev/md0 on /share/MD0_DATA type ext4 (rw,usrjquota=aquota.user,jqfmt=vfsv0,user _xattr,data=ordered,delalloc,acl)
/dev/md13 on /mnt/ext type ext3 (rw,data=ordered)
nfsd on /proc/fs/nfsd type nfsd (rw)
none on /sys/kernel/config type configfs (rw)
tmpfs on /var/syslog_maildir type tmpfs (rw,size=8M)
tmpfs on /.eaccelerator.tmp type tmpfs (rw,size=32M)
[~] # cat /proc/mdstat
Personalities : [linear] [raid0] [raid1] [raid10] [raid6] [raid5] [raid4] [multi path]
md0 : active raid5 sdh3[7](S) sdb3[8] sda3[1] sdg3[6] sde3[5] sdf3[4] sdd3[3] sd c3[2]
11711673600 blocks level 5, 64k chunk, algorithm 2 [7/6] [_UUUU UU]
bitmap: 8/15 pages [32KB], 65536KB chunk
md256 : active raid1 sdh2[7](S) sdg2[6](S) sdf2[5](S) sde2[4](S) sdd2[3](S) sdc2 [2](S) sdb2[1] sda2[0]
530112 blocks super 1.0 [2/2] [UU]
bitmap: 0/1 pages [0KB], 65536KB chunk
md13 : active raid1 sdc4[0] sdg4[6] sdf4[5] sde4[4] sdh4[2] sdd4[1]
458880 blocks [8/6] [UUU_UUU_]
bitmap: 47/57 pages [188KB], 4KB chunk
md9 : active raid1 sdc1[0] sdg1[6] sdf1[5] sde1[4] sdh1[2] sdd1[1]
530048 blocks [8/6] [UUU_UUU_]
bitmap: 60/65 pages [240KB], 4KB chunk
unused devices: <none>
[~] # #done
- pwilson
- Guru
- Posts: 22533
- Joined: Fri Mar 06, 2009 11:20 am
- Location: Victoria, BC, Canada (UTC-08:00)
Re: Need help on my RAID Rebuilt
Your output of those commands suggests all your arrays are all now "rw" rather than "read-only". Your main data array (md0) seems to have all 8 drvies, including the spare. md9 & md13 however both seem to be missing both HDD1 (/dev/sda) and HDD2 (/dev/sdb).xmustang74 wrote:Hi Wilson,
Please see below for my exported output. Do advise from where I can read the rebuild status. Thanks
Code: Select all
[~] # echo "NAS Model: $(getsysinfo model)" NAS Model: TS-869 Pro [~] # echo "Firmware: $(getcfg system version) Build $(getcfg system 'Build N umber')" Firmware: 4.1.0 Build 20131220 [~] # echo "System Name: $(/bin/hostname)" System Name: XTQNAS [~] # /sbin/hdparm -i /dev/sd[a-h] 2>/dev/null | grep Model Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMC300950207 Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMC300950247 Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMC1T3386441 Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMC301239780 Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMAZA8097785 Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMAZA8609767 Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMAZA5390792 Model=WDC WD20EFRX-68AX9N0 , FwRev=80.00A80, SerialNo= W D-WMC1T3133314 [~] # df -h Filesystem Size Used Available Use% Mounted on /dev/ram0 151.1M 138.9M 12.2M 92% / devtmpfs 1.5G 4.0k 1.5G 0% /dev tmpfs 64.0M 1.0M 63.0M 2% /tmp /dev/md9 509.5M 210.3M 299.2M 41% /mnt/HDA_ROOT /dev/md0 10.8T 3.9T 6.9T 36% /share/MD0_DATA /dev/md13 364.2M 221.7M 142.5M 61% /mnt/ext tmpfs 8.0M 0 8.0M 0% /var/syslog_maildir tmpfs 32.0M 4.0k 32.0M 0% /.eaccelerator.tmp [~] # mount /proc on /proc type proc (rw) devpts on /dev/pts type devpts (rw) sysfs on /sys type sysfs (rw) tmpfs on /tmp type tmpfs (rw,size=64M) none on /proc/bus/usb type usbfs (rw) /dev/md9 on /mnt/HDA_ROOT type ext3 (rw,data=ordered,user_xattr,acl) /dev/md0 on /share/MD0_DATA type ext4 (rw,usrjquota=aquota.user,jqfmt=vfsv0,user _xattr,data=ordered,delalloc,acl) /dev/md13 on /mnt/ext type ext3 (rw,data=ordered) nfsd on /proc/fs/nfsd type nfsd (rw) none on /sys/kernel/config type configfs (rw) tmpfs on /var/syslog_maildir type tmpfs (rw,size=8M) tmpfs on /.eaccelerator.tmp type tmpfs (rw,size=32M) [~] # cat /proc/mdstat Personalities : [linear] [raid0] [raid1] [raid10] [raid6] [raid5] [raid4] [multi path] md0 : active raid5 sdh3[7](S) sdb3[8] sda3[1] sdg3[6] sde3[5] sdf3[4] sdd3[3] sd c3[2] 11711673600 blocks level 5, 64k chunk, algorithm 2 [7/6] [_UUUU UU] bitmap: 8/15 pages [32KB], 65536KB chunk md256 : active raid1 sdh2[7](S) sdg2[6](S) sdf2[5](S) sde2[4](S) sdd2[3](S) sdc2 [2](S) sdb2[1] sda2[0] 530112 blocks super 1.0 [2/2] [UU] bitmap: 0/1 pages [0KB], 65536KB chunk md13 : active raid1 sdc4[0] sdg4[6] sdf4[5] sde4[4] sdh4[2] sdd4[1] 458880 blocks [8/6] [UUU_UUU_] bitmap: 47/57 pages [188KB], 4KB chunk md9 : active raid1 sdc1[0] sdg1[6] sdf1[5] sde1[4] sdh1[2] sdd1[1] 530048 blocks [8/6] [UUU_UUU_] bitmap: 60/65 pages [240KB], 4KB chunk unused devices: <none> [~] # #done
You should not have shutdown your NAS in order to change HDD's. You should have Hot-swapped the drive. I would recommend that you submit a ticket with the QNAP Helpdesk for further asistance. (They may be able to rebuild these two arrays manually for you).
I would recommend backing up /share/MD0_DATA immediately, as you may have to reinitialize all your drives to recover from this situation.
Patrick M. Wilson
Victoria, BC Canada
QNAP TS-470 Pro w/ 4 * Western Digital WD30EFRX WD Reds (RAID5) - - Single 8.1TB Storage Pool FW: QTS 4.2.0 Build 20151023 - Kali Linux v1.06 (64bit)
Forums: View My Profile - Search My Posts - View My Photo - View My Location - Top Community Posters
QNAP: Turbo NAS User Manual - QNAP Wiki - QNAP Tutorials - QNAP FAQs
Please review: When you're asking a question, please include the following.
-
- New here
- Posts: 6
- Joined: Wed Mar 20, 2013 11:32 am
Re: Need help on my RAID Rebuilt
Hi Wilson,
In fact, my first attempt was hot swapping the replacement drive instead of shutting it down but apparently the replacement drive wasn't being detected by the box and only upon reboot the box then the replacement drive got detected.
Sounds like the situation is bad and the disaster recovery feature wasn't so robust.. I think I met my nightmare...
Anyway, appreciated on your help and will submit a ticket to request for help as advised...
BR
David
In fact, my first attempt was hot swapping the replacement drive instead of shutting it down but apparently the replacement drive wasn't being detected by the box and only upon reboot the box then the replacement drive got detected.
Sounds like the situation is bad and the disaster recovery feature wasn't so robust.. I think I met my nightmare...
Anyway, appreciated on your help and will submit a ticket to request for help as advised...
BR
David