Page 1 of 1

[ Solved ] iSCSI LUN expansion never finishes

Posted: Thu Jul 09, 2020 10:06 am
by Beddhist
TS-431
QTS 4.3.6.1286
4 x WD 4TB Red NAS (not the SMR version)
Raid5
1 SMB share
1 iSCSI LUN

I expanded the LUN from 2.3 TB to ~7 TB (the max available):

Code: Select all

Severity Level	Date	Time	Users	Source IP	Application	Category	Content	
Information	2020/07/08	11:25:01	admin	10.0.1.140	---	---	[iSCSI] Start to expand LUN (storj1), capacity up to 7283 GB with thin provision.	
Severity Level	Date	Time	Users	Source IP	Application	Category	Content	
Information	2020/07/08	11:25:01	admin	10.0.1.140	---	---	[iSCSI] Change properties for LUN (storj1) successfully.	
All the files have been created:

Code: Select all

[/share/CACHEDEV1_DATA] # ll .@iscsi.img
drwxrwxrwx    2 admin    administ      4.0k Jul  8 13:06 ./
drwxrwxrwx   29 admin    administ      4.0k Jul  3 11:30 ../
-rw-------    1 admin    administ      1.0T Jul  3 11:30 iSCSI-storj1-5efeb468.000
-rw-------    1 admin    administ      1.0T Jul  3 11:33 iSCSI-storj1-5efeb468.001
-rw-------    1 admin    administ    452.0G Jul  3 11:35 iSCSI-storj1-5efeb468.002
-rw-------    1 admin    administ      1.0T Jul  8 11:25 iSCSI-storj1-5efeb468.003
-rw-------    1 admin    administ      1.0T Jul  8 11:28 iSCSI-storj1-5efeb468.004
-rw-------    1 admin    administ      1.0T Jul  8 11:32 iSCSI-storj1-5efeb468.005
-rw-------    1 admin    administ      1.0T Jul  8 11:36 iSCSI-storj1-5efeb468.006
-rw-------    1 admin    administ    687.0G Jul  8 13:06 iSCSI-storj1-5efeb468.007
CPU usage is 7-25% in normal use.

When I open Storage Manager and click on iSCSI two things can be seen:

1. CPU usage slowly increases to 100%, then stays between 80% and 100% with no change in file access load.
2. The display shows 2 rotating Qs and status "creating 0.00%.
Image 14.png
The client still sees 2.3TB.
I have tried disconnecting the client and logging out of QTS. Nothing changes. I'm afraid to reboot the NAS, fearing that the LUN might get damaged.

What do I do now?

Thanks,
Peter.

Re: iSCSI LUN expansion never finishes

Posted: Thu Jul 09, 2020 10:10 am
by Beddhist
In case it's useful for debugging:

Code: Select all

[~] # df
Filesystem                Size      Used Available Use% Mounted on
none                     61.0M     48.0M     13.0M  79% /
devtmpfs                233.0M     12.0k    233.0M   0% /dev
tmpfs                    64.0M    552.0k     63.5M   1% /tmp
tmpfs                   239.6M      8.0k    239.6M   0% /dev/shm
tmpfs                    16.0M      1.1M     14.9M   7% /share
/dev/md9                515.5M    299.4M    216.1M  58% /mnt/HDA_ROOT
cgroup_root             239.6M         0    239.6M   0% /sys/fs/cgroup
/dev/mapper/cachedev1    10.6T     10.6T     14.2G 100% /share/CACHEDEV1_DATA
/dev/md13               433.0M    329.5M    103.4M  76% /mnt/ext
tmpfs                    16.0M     92.0k     15.9M   1% /share/CACHEDEV1_DATA/.samba/lock/msg.lock
tmpfs                    16.0M         0     16.0M   0% /mnt/ext/opt/samba/private/msg.sock
tmpfs                     1.0M         0      1.0M   0% /mnt/rf/nd
/dev/sdd2                 7.3T      7.3T     11.5G 100% /share/external/DEV3302_2
tail of dmesg:

Code: Select all

[1080702.123349] UBIFS: mounted UBI device 2, volume 0, name "config"
[1080702.129552] UBIFS: file system size:   12316672 bytes (12028 KiB, 11 MiB, 97 LEBs)
[1080702.137405] UBIFS: journal size:       2031616 bytes (1984 KiB, 1 MiB, 16 LEBs)
[1080702.144929] UBIFS: media format:       w4/r0 (latest is w4/r0)
[1080702.150992] UBIFS: default compressor: lzo
[1080702.155301] UBIFS: reserved for root:  0 bytes (0 KiB)
[1080702.361201] UBIFS: un-mount UBI device 2, volume 0
[1080702.418955] UBI: mtd6 is detached from ubi2
[1085420.000524] wait_for_tasks: Stopping 8c235968 ITT: 0x00a19e76 i_state: 41, t_state: 6, CMD_T_STOP, transport_state: 0x236, filebasd: yes, thin: no, scsi op:0x88
[1085420.015332] wait_for_tasks: Stopped wait_for_compltion(&cmd->t_transport_stop_comp) for ITT: 0x00a19e76, i_state: 41, t_state: 6, filebasd: yes, thin:no, scsi op: 0x88
[1089506.597720] wait_for_tasks: Stopping 8a0af9a8 ITT: 0x00a39c59 i_state: 41, t_state: 6, CMD_T_STOP, transport_state: 0x236, filebasd: yes, thin: no, scsi op:0x8a
[1089506.613509] wait_for_tasks: Stopped wait_for_compltion(&cmd->t_transport_stop_comp) for ITT: 0x00a39c59, i_state: 41, t_state: 6, filebasd: yes, thin:no, scsi op: 0x8a
[1089516.948395] wait_for_tasks: Stopping 8c6d02e8 ITT: 0x00a3a0c1 i_state: 41, t_state: 6, CMD_T_STOP, transport_state: 0x236, filebasd: yes, thin: no, scsi op:0x8a
[1089516.964513] wait_for_tasks: Stopped wait_for_compltion(&cmd->t_transport_stop_comp) for ITT: 0x00a3a0c1, i_state: 41, t_state: 6, filebasd: yes, thin:no, scsi op: 0x8a
[1090281.685106] wait_for_tasks: Stopping 8a0af608 ITT: 0x00a5aae1 i_state: 41, t_state: 6, CMD_T_STOP, transport_state: 0x236, filebasd: yes, thin: no, scsi op:0x88
[1090281.701111] wait_for_tasks: Stopped wait_for_compltion(&cmd->t_transport_stop_comp) for ITT: 0x00a5aae1, i_state: 41, t_state: 6, filebasd: yes, thin:no, scsi op: 0x88
[1094977.105386] MODE SENSE: unimplemented page/subpage: 0x1c/0x00

Re: [ Solved ] iSCSI LUN expansion never finishes

Posted: Thu Jul 09, 2020 2:24 pm
by Beddhist
It looks like I resolved it myself by clearing an additional 24GB of space on the system volume.