Deleting many files from iSCSI drive hangs and blocks writes...
Posted: Mon May 06, 2019 10:24 am
Having an odd problem and I've done everything I can think to do on the WSS side:
System -
Storage: TVS1282-T3 (firmware 4.3.2.0141 B20170326), core i7-7700, 64GB with 32TB of Samsung SSD (8x4TB) storage (no cache assigned), one iSCSI LUN ~25TB.
Server: Windows Storage Server 2016 Std (HPE, Xeon Silver 4110, 32GB Ram)
Symptom - Deleting folders with about 1000 files (Tif, 15MB each) experiences frequent pauses or hangs... If I've not deleted a folder in some time then the folders will delete quickly (few seconds), but if I have just deleted one folder then often the second will get partway through the delete and then stop for some arbitrary amount of time (from 10-20 seconds up to 5 minutes). That by itself is just a bit annoying... but the problem is that while that folder delete is hung up all other write or delete operations also hang. (read operations continue normally). after the delay the delete will continue for another couple hundred files than hang again and again until finished.
While the delete is hung up, CPU utilization by the system process is locked at 7% (about one core) and the task using most of that time is IOGetIOPriorityHint.
Writing thousands of files at once doesn't seem to cause this issue... just deleting them.
I have a screen vid of the issue but your attachments are too size limited to attach (10mb).
System -
Storage: TVS1282-T3 (firmware 4.3.2.0141 B20170326), core i7-7700, 64GB with 32TB of Samsung SSD (8x4TB) storage (no cache assigned), one iSCSI LUN ~25TB.
Server: Windows Storage Server 2016 Std (HPE, Xeon Silver 4110, 32GB Ram)
Symptom - Deleting folders with about 1000 files (Tif, 15MB each) experiences frequent pauses or hangs... If I've not deleted a folder in some time then the folders will delete quickly (few seconds), but if I have just deleted one folder then often the second will get partway through the delete and then stop for some arbitrary amount of time (from 10-20 seconds up to 5 minutes). That by itself is just a bit annoying... but the problem is that while that folder delete is hung up all other write or delete operations also hang. (read operations continue normally). after the delay the delete will continue for another couple hundred files than hang again and again until finished.
While the delete is hung up, CPU utilization by the system process is locked at 7% (about one core) and the task using most of that time is IOGetIOPriorityHint.
Writing thousands of files at once doesn't seem to cause this issue... just deleting them.
I have a screen vid of the issue but your attachments are too size limited to attach (10mb).