Suddenly no Volume and Storage Pool

Questions about SNMP, Power, System, Logs, disk, & RAID.
Post Reply
ratsalad
New here
Posts: 2
Joined: Sun Apr 25, 2021 8:48 am

Suddenly no Volume and Storage Pool

Post by ratsalad »

Can someone help me with this.

Everything was working fine on my NAS and suddenly the volume and storage pool disappeared, can't see my folders and files at all on the NAS.

But the folders and files are still there because I can mount and access them on my windows PC via SMB

Ran df and md_checker this is what I get

Code: Select all

[~] # df
Filesystem                Size      Used Available Use% Mounted on
none                    400.0M    400.0M         0 100% /
devtmpfs                  3.8G      8.0K      3.8G   0% /dev
tmpfs                    64.0M      3.5M     60.5M   6% /tmp
tmpfs                     3.9G    156.0K      3.9G   0% /dev/shm
tmpfs                    16.0M         0     16.0M   0% /share
/dev/sdc5                 7.8M     36.0K      7.8M   0% /mnt/boot_config
tmpfs                    16.0M         0     16.0M   0% /mnt/snapshot/export
/dev/md9                499.5M    182.9M    316.6M  37% /mnt/HDA_ROOT
cgroup_root               3.9G         0      3.9G   0% /sys/fs/cgroup
/dev/mapper/cachedev1
                          7.0T      5.4T      1.6T  77% /share/CACHEDEV1_DATA
/dev/md13               417.0M    391.1M     25.9M  94% /mnt/ext
tmpfs                     1.0M      4.0K   1020.0K   0% /share/external/.nd
tmpfs                     1.0M         0      1.0M   0% /share/external/.cm
tmpfs                     1.0M         0      1.0M   0% /mnt/hm/temp_mount
cmfs                      3.5T         0      3.5T   0% /share/external/.cm/0/2115a656ef5a873085bffafb169530f91644e8e0
tmpfs                    48.0M     64.0K     47.9M   0% /share/CACHEDEV1_DATA/.samba/lock/msg.lock
tmpfs                    16.0M         0     16.0M   0% /mnt/ext/opt/samba/private/msg.sock
/dev/mapper/vg1-lv1312
                        740.9M    800.0K    740.2M   0% /mnt/pool1
/dev/mapper/vg1-snap10001
                          7.0T      5.4T      1.6T  77% /mnt/snapshot/1/10001
cmfs                      3.5T         0      3.5T   0% /share/external/.cm/0/201aa596aef1a4e6f5f554f31c8725b10af16b5f
cmfs                      3.5T         0      3.5T   0% /share/external/.cm/0/2216194bdbd84c041f8edcef0c4f3d76e950fc90
cmfs                      3.5T         0      3.5T   0% /share/external/.cm/0/221870c5f62abe967edbb02adad1c70d9d548c0f

Code: Select all

Welcome to MD superblock checker (v2.0) - have a nice day~

Scanning system...


RAID metadata found!
UUID:           cb57ff4e:bc8e9a01:3e4755b9:fc183de1
Level:          raid1
Devices:        2
Name:           md1
Chunk Size:     -
md Version:     1.0
Creation Time:  Jun 25 15:22:36 2018
Status:         ONLINE (md1) [UU]
===============================================================================================
 Enclosure | Port | Block Dev Name | # | Status |   Last Update Time   | Events | Array State
===============================================================================================
 NAS_HOST       5        /dev/sda3   0   Active   May 14 00:51:55 2021      441   AA
 NAS_HOST       6        /dev/sdb3   1   Active   May 14 00:51:55 2021      441   AA
===============================================================================================
Tried to remount and this is what I get:

Code: Select all

[~] # /etc/init.d/init_lvm.sh
Changing old config name...
mv: can't rename '/etc/config/qdrbd.conf': No such file or directory
mv: can't rename '/etc/config/raid.conf': No such file or directory
Reinitialing...
Detect disk(8, 16)...
dev_count ++ = 0Detect disk(253, 0)...
ignore non-root enclosure disk(253, 0).
Detect disk(8, 32)...
ignore non-root enclosure disk(8, 32).
Detect disk(8, 0)...
dev_count ++ = 1Detect disk(8, 16)...
Detect disk(253, 0)...
ignore non-root enclosure disk(253, 0).
Detect disk(8, 32)...
ignore non-root enclosure disk(8, 32).
Detect disk(8, 0)...
/bin/cat: /sys/bus/pci/devices/0000:00:01.0/0000:01:00.0/subsystem_vendor: No such file or directory
/bin/cat: /sys/bus/pci/devices/0000:00:01.0/0000:01:00.0/subsystem_vendor: No such file or directory
/bin/cat: /sys/bus/pci/devices/0000:00:1d.0/0000:09:00.0/subsystem_vendor: No such file or directory
/bin/cat: /sys/bus/pci/devices/0000:00:1d.0/0000:09:00.0/subsystem_vendor: No such file or directory
sys_startup_p2:got called count = -1
  WARNING: duplicate PV 9wuAh3298yYs5BLmefcAsym0Wdfk0dRo is being used from both devices /dev/drbd1 and /dev/md1
  Found duplicate PV 9wuAh3298yYs5BLmefcAsym0Wdfk0dRo: using /dev/drbd1 not /dev/md1
  Using duplicate PV /dev/drbd1 from subsystem DRBD, ignoring /dev/md1
  /etc/lvm/cache/.cache.tmp: write error failed: No space left on device
Done
Any inputs appreciated...
ratsalad
New here
Posts: 2
Joined: Sun Apr 25, 2021 8:48 am

Re: Suddenly no Volume and Storage Pool

Post by ratsalad »

Found my own solution before anyone else replied...

Rebooted the server into maintenance mode from console, nothing much could be done there and the SMB connection I had to the files were lost.

After playing around for a few min and nothing to do, I restarted the server into normal mode.

This time, SMB did not reconnect and SSH into the server, to my horror, CACHEDEV1_DATA which was there previously and contained all my files disappeared.

I'm quite sure my files are still intact (couldn't be that a restart deleted everything) so I tried again in SSH

/etc/init.d/init_lvm.sh

This time encountered many errors again:

Code: Select all

[~] # /etc/init.d/init_lvm.sh
Changing old config name...
Reinitialing...
Detect disk(8, 16)...
dev_count ++ = 0Detect disk(253, 0)...
ignore non-root enclosure disk(253, 0).
Detect disk(8, 32)...
ignore non-root enclosure disk(8, 32).
Detect disk(8, 0)...
dev_count ++ = 1Detect disk(8, 16)...
Detect disk(253, 0)...
ignore non-root enclosure disk(253, 0).
Detect disk(8, 32)...
ignore non-root enclosure disk(8, 32).
Detect disk(8, 0)...
/bin/cat: /sys/bus/pci/devices/0000:00:01.0/0000:01:00.0/subsystem_vendor: No such file or directory
/bin/cat: /sys/bus/pci/devices/0000:00:01.0/0000:01:00.0/subsystem_vendor: No such file or directory
/bin/cat: /sys/bus/pci/devices/0000:00:1d.0/0000:09:00.0/subsystem_vendor: No such file or directory
/bin/cat: /sys/bus/pci/devices/0000:00:1d.0/0000:09:00.0/subsystem_vendor: No such file or directory
sys_startup_p2:got called count = -1
  WARNING: duplicate PV 9wuAh3298yYs5BLmefcAsym0Wdfk0dRo is being used from both devices /dev/drbd1 and /dev/md1
  Found duplicate PV 9wuAh3298yYs5BLmefcAsym0Wdfk0dRo: using /dev/drbd1 not /dev/md1
  Using duplicate PV /dev/drbd1 from subsystem DRBD, ignoring /dev/md1
  LV Status              NOT available
sh: /sys/block/dm-5/dm/pool/tier/relocation_rate: Permission denied
Done
But after this the folders and files were restored (I guess volume successfully mounted). I could access the files again via SMB.

After a few min on QTS received a prompt that the file system is not clean and proceeded to check disk. Result was fine.

Gonna restart the server to see if everything functions normally now.

I have to say, after the recent QLocker fiasco (I was affected) and now out of the blue a situation like this... I have lost much faith in QNAP.

I have a Synology that is older and lower end and it never gave me any problems from day 1.
Post Reply

Return to “System & Disk Volume Management”