TS-412 - Single Disk to RAID5 migration problem?

[onewhite]

Hi All,

Yesterday I decided to go from single disk (1 disk 2TB WD Green) to RAID5 (3 drives - the other two are 1 Seagate 2TB and another 2TB WD Green).

I inserted the drives, all good.
I formatted the two extra drives. All good.

Began the migration process... started out fine. By the time I went to bed it had done about 28%? Took quite a few hours to get that far.
I figured by morning it would be up to at least 70%... but when I came in this morning, it appeared the screen had refreshed or something and I ended up with what you see in the images. (i.e. like NOTHING had happened?)

ScreenShot012.png

I then went into the system logs to see... and nothing in there to let me know what happened?

Code: Select all

2012-04-22   11:03:14   System   127.0.0.1   localhost   [Single Disk Volume: Drive 1] Do RAID Migration to RAID5.
2012-04-22   11:01:29   System   127.0.0.1   localhost   [Single Disk Volume: Drive 2] Formatting completed.
2012-04-22   11:00:26   System   127.0.0.1   localhost   [Single Disk Volume: Drive 3] Formatting completed.
2012-04-22   10:39:56   System   127.0.0.1   localhost   [Single Disk Volume: Drive 3] Start formatting.
2012-04-22   10:39:55   System   127.0.0.1   localhost   [Single Disk Volume: Drive 2] Start formatting.


The migration process WAS very very slow.. and looks like nothing happened?

Can anyone please help?

I should note that Disk1 has 7.75GB free (i.e. i have a lot of data on it)

EDIT: I have decided to try again... I have formatted the two drives, and begun the migration again:

ScreenShot047.png

Many thanks
Dave

[fstrange]

Hi

I'm also in the process of working with my RAID. Just for information - for me it takes approx 24 hrs to add a new 2 TB drive, so please be patient.

If you're having trouble completing through the Web Admin GUI, there are several Posts on this forum, which describe how to do it via command line (SSH, Putty).

My best advice is to stop all services before running you RAID commands i.e. by executing "/etc/init.d/services.sh stop" command.

[onewhite]

Thank you for the info. It's now done 18% after almost 4 hours.... so I'll just have to wait and see what happens.
Unfortunately I didnt stop the services (as I did it through web gui) but if it fails again, I might try doing as you suggest.

Are there any commands I can run from ssh to see how its going "behind the scenes" ?

Thanks
Dave

[onewhite]

Overnight the migration failed... again.

I really believe its the Seagate drive that is the problem.
Thinking back, that Seagate drive used to "vanish" in Windows. I would have to reboot to get it to reappear again.

I am going to get another WD drive and replace it with that one and try again.

Dave

[erwinsie]

i have been researching about NAS for few weeks now, but seeing how long the process to built/migrate/rebuilt NAS (days), sometimes im thinking, is this RAID technology is really mature? hard to believe processes to write data could take days.

[P3R]

i have been researching about NAS for few weeks now, but seeing how long the process to built/migrate/rebuilt NAS (days), sometimes im thinking, is this RAID technology is really mature?

Yes it is mature and normally it works quite well. The most common reasons for failing migration/expansion tasks are:

• One or more services or applications are in use and keeping files open, thus preventing the necessary unmount/remount that inevitably is a part of the process
• Defective hardware (most often disks)

Please note that user onewhite above in this thread uses disks that are specifically mentioned as not recommended on the Qnap disk compatibility list and in regard to the WD disks, also are discouraged from NAS/RAID-use by the manufacturer.

hard to believe processes to write data could take days.

It may take a day but normally doesn't take days. A RAID level migration does mean rewriting all data on all disks and recalculate all RAID-checksums. Also, many NAS models are very low-power (which is nice through the complete life of the product) and thereby have limited processing power to manage these extremely demanding (but very rare) tasks.

[jckruger]

Hi,

I have a 559 Pro II with a similar issue. It looked like it finished but then shows the volume is unmounted. It shows the original single disk and the new Raid 5 volume.as unmounted. I checked the /etc.storage.conf file and it shows what looks to be an error.

I would have expected that volume 1 would have disapperaed and Volume 4 to have disks 1,2,3 not 0,2,3 as the discs are loaded inlo slot 1,2,3.

Please help as I don't know if it was successful or not so don't know if I should retry it or fiddle with this file to mount the Raid 5 volume. I have a partial backup from a few months ago of the files but I hope this is recoverable

Code: Select all

[VOLUME 1]
device name = /dev/sda3
raid level = -2
raid disks = 1
spare raid disks =
status = -3
record_time = Wed Apr 25 09:59:49 2012

filesystem = 104
[VOLUME 2]
device name = /dev/sdd3
raid level = -2
raid disks = 4
spare raid disks =
status = -5
record_time = Wed Apr 25 09:59:49 2012

filesystem = 104
[VOLUME 3]
device name = /dev/sde3
raid level = -2
raid disks = 5
spare raid disks =
status = 0
record_time = Wed Apr 25 09:59:49 2012

filesystem = 104
[VOLUME 4]
device name = /dev/md4
raid level = 5
raid disks = 0,2,3
spare raid disks =
status = -3
record_time = Wed Apr 25 09:59:49 2012

filesystem = 104
[Global]
Available Disk = 4


Are there any commands to check to see if it failed or succeeded but just doesn't know how to mount the volume?.

These are the logs:

Code: Select all

 2012-04-25
161 10:00:53 System 127.0.0.1 localhost Folders(Public, Usb, Web, Multimedia, Download, Recordings) for default network shares do not exist. Restore default network shares or format your disk volume.
 2012-04-25
160 10:00:52 System 127.0.0.1 localhost Default network shares(Public, Usb, Web, Multimedia, Download, Recordings) do not exist. Restore default network shares or format your disk volume.
 2012-04-25
159 09:59:49 System 127.0.0.1 localhost [RAID 5 Disk Volume: Drive X 2 3] raid configuration is reconstructed!
 2012-04-25
158 09:59:39 System 127.0.0.1 localhost System started.
 2012-04-25
157 09:57:38 System 127.0.0.1 localhost System was shut down on Wed Apr 25 09:57:38 EST 2012.
 2012-04-25
156 09:56:36 jckruger 192.168.1.25 --- [Power Management] System will be restart now.
 2012-04-25
155 06:45:13 System 127.0.0.1 localhost Re-launch process [crond].
 2012-04-25
154 06:45:12 System 127.0.0.1 localhost Re-launch process [smbd].
 2012-04-25
153 06:45:11 System 127.0.0.1 localhost Re-launch process [apache].
 2012-04-25
152 06:45:10 System 127.0.0.1 localhost Re-launch process [nmbd].
 2012-04-25
151 06:44:38 System 127.0.0.1 localhost Re-launch process [apache].
 2012-04-24
150 00:00:31 System 127.0.0.1 localhost [Antivirus] Virus definition updated.
 2012-04-23
149 19:05:26 jckruger 192.168.1.2 --- [QPKG Center] Xeams disabled.
 2012-04-23
148 17:59:52 System 127.0.0.1 localhost [Single Disk Volume: Drive 1] Do RAID Migration to RAID5.
 2012-04-23
147 17:53:34 System 127.0.0.1 localhost [Single Disk Volume: Drive 2] Formatting completed.
 2012-04-23
146 17:53:33 System 127.0.0.1 localhost [Single Disk Volume: Drive 3] Formatting completed.
 2012-04-23
145 17:48:40 System 127.0.0.1 localhost [Single Disk Volume: Drive 3] Start formatting.
 2012-04-23
144 17:48:40 System 127.0.0.1 localhost [Single Disk Volume: Drive 2] Start formatting.


and what the RAID management shows;

Code: Select all

Current Disk Volume Configuration
Disk/ Volume Total Size Bitmap Status Description
 Single Disk: Drive 1  -- -- Unmounted  The operation(s) you can execute: - Set global spare
 Single Disk: Drive 5  922.69 GB -- Ready The operation(s) you can execute: - Migrate - Set global spare
 RAID 5 Disk Volume: Drive  -- No Unmounted  No operation can be executed for this drive configuration.


DiscVolumes.jpg

RaidManagement.jpg

Code: Select all

[/] # mdadm -D /dev/md4
/dev/md4:
        Version : 01.00.03
  Creation Time : Mon Apr 23 17:59:54 2012
     Raid Level : raid5
     Array Size : 5857395072 (5586.05 GiB 5997.97 GB)
  Used Dev Size : 2928697536 (2793.02 GiB 2998.99 GB)
   Raid Devices : 3
  Total Devices : 2
Preferred Minor : 4
    Persistence : Superblock is persistent

    Update Time : Wed Apr 25 19:21:16 2012
          State : clean, degraded
 Active Devices : 2
Working Devices : 2
 Failed Devices : 0
  Spare Devices : 0

         Layout : left-symmetric
     Chunk Size : 64K

           Name : 4
           UUID : 37b6069a:589b5e8b:7acb27d4:cb08f91a
         Events : 36124

    Number   Major   Minor   RaidDevice State
       0       0        0        0      removed
       1       8       19        1      active sync   /dev/sdb3
       2       8       35        2      active sync   /dev/sdc3
[/] #


I haven't removed any discs so why is it showing as degraded.

I can't mount the volume as it says it doesn't exist in the fstab or mtab
fstab:

Code: Select all

# /etc/fstab: static file system information.
#
# <file system> <mount pt>     <type>   <options>         <dump> <pass>
/dev/ram       /              ext2   defaults         1      1
proc      /proc          proc     defaults     0    0
none            /dev/pts        devpts  gid=5,mode=620  0       0


mtab:

Code: Select all

/proc /proc proc rw 0 0
none /dev/pts devpts rw,gid=5,mode=620 0 0
sysfs /sys sysfs rw 0 0
tmpfs /tmp tmpfs rw,size=64M 0 0
none /proc/bus/usb usbfs rw 0 0
/dev/sda4 /mnt/ext ext3 rw 0 0
/dev/md9 /mnt/HDA_ROOT ext3 rw 0 0
/dev/sde3 /share/HDE_DATA ext4 rw,usrjquota=aquota.user,jqfmt=vfsv0,user_xattr,data=ordered,delalloc,acl 0 0
tmpfs /.eaccelerator.tmp tmpfs rw,size=32M 0 0


[onewhite]

Unfortunately, replacing the drive didn't make too much difference.
It got to over 50% migrated and then.. back to showing the other two drives as unmounted.

The status light flashes between red and green constantly and there appears to be nothing to indicate why!

Nothing in the system logs.... why is there no information on this.

Even though the drives aren't on their compatibility list, I found a link showing what other people have used successfully with the NAS. While the drives aren't recommended, doesn't mean you still can't use them.....

I think I might have to raise this with QNAP support.

[P3R]

Even though the drives aren't on their compatibility list, I found a link showing what other people have used successfully with the NAS. While the drives aren't recommended, doesn't mean you still can't use them.....

Well it's actually worse, as they're specifically NOT recommended for this use because of the many problems other users have experienced with them.

This is the main thread about the Seagate disk and there must be at least a 1000 forum posts about all the problems that WD Green have given other users, search for those. It's a shame that some are still recommending them.

There is a chance the non-recommended disks aren't the cause for your current problems but they will most likely give you problems at some point. I'm sorry about that!

I think I might have to raise this with QNAP support.

Good idea, they may be able to solve the migration problem for you.

This is the way to contact Qnap support, for you and the others in this thread having migration problems.
'

[jckruger]

Please help as my wife is getting stressed that I will loose her data. It looks like the volume is there but is not able to be mounted.

Hi,

I have a 559 Pro II with a similar issue. It looked like it finished but then shows the volume is unmounted. It shows the original single disk and the new Raid 5 volume.as unmounted. I checked the /etc.storage.conf file and it shows what looks to be an error.

I would have expected that volume 1 would have disapperaed and Volume 4 to have disks 1,2,3 not 0,2,3 as the discs are loaded inlo slot 1,2,3.

Please help as I don't know if it was successful or not so don't know if I should retry it or fiddle with this file to mount the Raid 5 volume. I have a partial backup from a few months ago of the files but I hope this is recoverable

Code: Select all

[VOLUME 1]
device name = /dev/sda3
raid level = -2
raid disks = 1
spare raid disks =
status = -3
record_time = Wed Apr 25 09:59:49 2012

filesystem = 104
[VOLUME 2]
device name = /dev/sdd3
raid level = -2
raid disks = 4
spare raid disks =
status = -5
record_time = Wed Apr 25 09:59:49 2012

filesystem = 104
[VOLUME 3]
device name = /dev/sde3
raid level = -2
raid disks = 5
spare raid disks =
status = 0
record_time = Wed Apr 25 09:59:49 2012

filesystem = 104
[VOLUME 4]
device name = /dev/md4
raid level = 5
raid disks = 0,2,3
spare raid disks =
status = -3
record_time = Wed Apr 25 09:59:49 2012

filesystem = 104
[Global]
Available Disk = 4


Are there any commands to check to see if it failed or succeeded but just doesn't know how to mount the volume?.

These are the logs:

Code: Select all

 2012-04-25
161 10:00:53 System 127.0.0.1 localhost Folders(Public, Usb, Web, Multimedia, Download, Recordings) for default network shares do not exist. Restore default network shares or format your disk volume.
 2012-04-25
160 10:00:52 System 127.0.0.1 localhost Default network shares(Public, Usb, Web, Multimedia, Download, Recordings) do not exist. Restore default network shares or format your disk volume.
 2012-04-25
159 09:59:49 System 127.0.0.1 localhost [RAID 5 Disk Volume: Drive X 2 3] raid configuration is reconstructed!
 2012-04-25
158 09:59:39 System 127.0.0.1 localhost System started.
 2012-04-25
157 09:57:38 System 127.0.0.1 localhost System was shut down on Wed Apr 25 09:57:38 EST 2012.
 2012-04-25
156 09:56:36 jckruger 192.168.1.25 --- [Power Management] System will be restart now.
 2012-04-25
155 06:45:13 System 127.0.0.1 localhost Re-launch process [crond].
 2012-04-25
154 06:45:12 System 127.0.0.1 localhost Re-launch process [smbd].
 2012-04-25
153 06:45:11 System 127.0.0.1 localhost Re-launch process [apache].
 2012-04-25
152 06:45:10 System 127.0.0.1 localhost Re-launch process [nmbd].
 2012-04-25
151 06:44:38 System 127.0.0.1 localhost Re-launch process [apache].
 2012-04-24
150 00:00:31 System 127.0.0.1 localhost [Antivirus] Virus definition updated.
 2012-04-23
149 19:05:26 jckruger 192.168.1.2 --- [QPKG Center] Xeams disabled.
 2012-04-23
148 17:59:52 System 127.0.0.1 localhost [Single Disk Volume: Drive 1] Do RAID Migration to RAID5.
 2012-04-23
147 17:53:34 System 127.0.0.1 localhost [Single Disk Volume: Drive 2] Formatting completed.
 2012-04-23
146 17:53:33 System 127.0.0.1 localhost [Single Disk Volume: Drive 3] Formatting completed.
 2012-04-23
145 17:48:40 System 127.0.0.1 localhost [Single Disk Volume: Drive 3] Start formatting.
 2012-04-23
144 17:48:40 System 127.0.0.1 localhost [Single Disk Volume: Drive 2] Start formatting.


and what the RAID management shows;

Code: Select all

Current Disk Volume Configuration
Disk/ Volume Total Size Bitmap Status Description
 Single Disk: Drive 1  -- -- Unmounted  The operation(s) you can execute: - Set global spare
 Single Disk: Drive 5  922.69 GB -- Ready The operation(s) you can execute: - Migrate - Set global spare
 RAID 5 Disk Volume: Drive  -- No Unmounted  No operation can be executed for this drive configuration.


DiscVolumes.jpg

RaidManagement.jpg

Code: Select all

[/] # mdadm -D /dev/md4
/dev/md4:
        Version : 01.00.03
  Creation Time : Mon Apr 23 17:59:54 2012
     Raid Level : raid5
     Array Size : 5857395072 (5586.05 GiB 5997.97 GB)
  Used Dev Size : 2928697536 (2793.02 GiB 2998.99 GB)
   Raid Devices : 3
  Total Devices : 2
Preferred Minor : 4
    Persistence : Superblock is persistent

    Update Time : Wed Apr 25 19:21:16 2012
          State : clean, degraded
 Active Devices : 2
Working Devices : 2
 Failed Devices : 0
  Spare Devices : 0

         Layout : left-symmetric
     Chunk Size : 64K

           Name : 4
           UUID : 37b6069a:589b5e8b:7acb27d4:cb08f91a
         Events : 36124

    Number   Major   Minor   RaidDevice State
       0       0        0        0      removed
       1       8       19        1      active sync   /dev/sdb3
       2       8       35        2      active sync   /dev/sdc3
[/] #


I haven't removed any discs so why is it showing as degraded.

I can't mount the volume as it says it doesn't exist in the fstab or mtab
fstab:

Code: Select all

# /etc/fstab: static file system information.
#
# <file system> <mount pt>     <type>   <options>         <dump> <pass>
/dev/ram       /              ext2   defaults         1      1
proc      /proc          proc     defaults     0    0
none            /dev/pts        devpts  gid=5,mode=620  0       0


mtab:

Code: Select all

/proc /proc proc rw 0 0
none /dev/pts devpts rw,gid=5,mode=620 0 0
sysfs /sys sysfs rw 0 0
tmpfs /tmp tmpfs rw,size=64M 0 0
none /proc/bus/usb usbfs rw 0 0
/dev/sda4 /mnt/ext ext3 rw 0 0
/dev/md9 /mnt/HDA_ROOT ext3 rw 0 0
/dev/sde3 /share/HDE_DATA ext4 rw,usrjquota=aquota.user,jqfmt=vfsv0,user_xattr,data=ordered,delalloc,acl 0 0
tmpfs /.eaccelerator.tmp tmpfs rw,size=32M 0 0


[P3R]

Please help as my wife is getting stressed that I will loose her data. It looks like the volume is there but is not able to be mounted.

Contact Qnap support for assistance.
'

[jckruger]

I think my problem may be with the disk encryption. The single disk was encrypted before the raid migration. I haven't saved my encryption key file but I wasn't expecting to need to use it. Looking at the screenshots in my previous posts shows the locked symbol.

Every time I rebooted the NAS I didn't need to unter a key to unlock the drives so why do I now??

I just need to crack (remember) the password. I hope there is a way to find it in the config somewhere

Update: I tried 'admin' as the password All good now. Will backup all my data and reset the NAS to do a Raid 5 from scratch instead of using the migration option. If I add some discs later on to expand I'll use the ssh tools method not the web gui

[AmoLago]

Unfortunately, replacing the drive didn't make too much difference.
It got to over 50% migrated and then.. back to showing the other two drives as unmounted.

The status light flashes between red and green constantly and there appears to be nothing to indicate why!

Nothing in the system logs.... why is there no information on this.

Even though the drives aren't on their compatibility list, I found a link showing what other people have used successfully with the NAS. While the drives aren't recommended, doesn't mean you still can't use them.....

I think I might have to raise this with QNAP support.

Hi OneWhite,

There doesn't seem to be a final outcome to your dilema, so I ask if you were able to finally successfully migrate your single drive?

I ask as I find myself in a very similar situation:
* went to bed 33% of the way through
* Got up to find drives not active though maybe in the RAID 5 (from single disk)
* Status light flashing green/red as if it hasn't finished.
* No messages in the log
* Very disturbingly, no files/folders in any of the shares

I've haven't rebooted or restarted anything on the NAS just in case it looses data on the first original drive, and just in case it is still really going (i.e. the flashing light trumps the admin interface).

Did you get this resolved with QNAP support? Did you lose any data?

Mine currently looks as follows:

VolumeManagement.png

RAIDManagement.png

Thanks for any help.

[schumaku]

I ask as I find myself in a very similar situation:
* went to bed 33% of the way through

Contact QNAP support ...

I * Very disturbingly, no files/folders in any of the shares

Most likley, the effective data volume is not mounted actually.

I've haven't rebooted or restarted anything on the NAS just in case it looses data on the first original drive, and just in case it is still really going (i.e. the flashing light trumps the admin interface).

Contact QNAP support ASAP - and leave it as-is.

[AmoLago]

Hmm,

I think I'm picking up a strong hint here!

So for anyone else who comes across this post, I have gone through the Online Support Form (number 5. on the todo list before ringing them apparently), with the following:

I attempted to perform a RAID Migration from Single drive to RAID 5 (3 disks). When I left it, it was happily going along at about 33%. When I came back to check on the progress, the RAID management screen showed me:

RAID 5 Disk Volume: Drive 1 2 3
Not active
The operation(s) you can execute:
- Recover

While in the Volume Management I have:
Drive 1 XXX XXXXXX 1863.02 GB Ready GOOD
Drive 1 XXX XXXXXX 1863.02 GB Ready GOOD
Drive 1 XXX XXXXXX 1863.02 GB Ready GOOD

RAID 5 Disk Volume: Drive 1 2 3 Unknown -- -- Not active

The status light on the front of the unit is flashing red/green every 0.5 seconds. This has been the case for over a day now.

The "shares" also appear to be devoid of data.

The original 2TB drive was almost full before the migration and I had nowhere else to store all the information as the other two drives I have were going to be formatted to be put in to the RAID. I do have some of the more important stuff backed up just in case something did go wrong, but by no means all of it. As you can imagine, I'm quite concerned about having lost all my data, as I was quite careful to follow every step in the instructions in the manual in an attempt to reduce the risk.

My question is what do I do now?

I'll let you know how I get on.