I have connected a TS-431P2 directly on a NetBSD server (without switch between server and NAS). I have configured only one LUN (four disks in raid6 configuration). This NAS runs with firmware 4.4.3.1439.
I a first time, adapter on NetBSD side was an old Realtek adapter that randomly works with jumbo frames. iSCSI throughput doesn't exceed 10 MB/s. I though that this old adapter was responsible for these poor performances.
Thus, I have replace last week this adapter by an new Intel ethernet adapter. Now, mtu is set on link to 9000 bytes. But iSCSI throughput still does not exceed 10 MB/s !
I have checked interface throughput with iperf3 :
Code: Select all
-----------------------------------------------------------
Server listening on 5201
-----------------------------------------------------------
Accepted connection from 192.168.10.103, port 40986
[ 5] local 192.168.10.128 port 5201 connected to 192.168.10.103 port 40988
[ ID] Interval Transfer Bitrate
[ 5] 0.00-1.00 sec 110 MBytes 919 Mbits/sec
[ 5] 1.00-2.00 sec 111 MBytes 932 Mbits/sec
[ 5] 2.00-3.00 sec 110 MBytes 925 Mbits/sec
[ 5] 3.00-4.00 sec 111 MBytes 934 Mbits/sec
[ 5] 4.00-5.00 sec 112 MBytes 936 Mbits/sec
[ 5] 5.00-6.00 sec 112 MBytes 936 Mbits/sec
[ 5] 6.00-7.00 sec 111 MBytes 935 Mbits/sec
[ 5] 7.00-8.00 sec 111 MBytes 935 Mbits/sec
[ 5] 8.00-9.00 sec 111 MBytes 928 Mbits/sec
[ 5] 9.00-10.00 sec 111 MBytes 934 Mbits/sec
[ 5] 10.00-10.00 sec 33.9 KBytes 785 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.00 sec 1.08 GBytes 931 Mbits/sec receiver
hilbert:[~] > iperf3 -c 192.168.10.128
Connecting to host 192.168.10.128, port 5201
[ 6] local 192.168.10.103 port 40988 connected to 192.168.10.128 port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 6] 0.00-1.00 sec 110 MBytes 922 Mbits/sec 0 69.3 KBytes
[ 6] 1.00-2.00 sec 111 MBytes 932 Mbits/sec 0 69.3 KBytes
[ 6] 2.00-3.00 sec 110 MBytes 925 Mbits/sec 0 69.3 KBytes
[ 6] 3.00-4.00 sec 111 MBytes 934 Mbits/sec 0 69.3 KBytes
[ 6] 4.00-5.00 sec 112 MBytes 936 Mbits/sec 0 69.3 KBytes
[ 6] 5.00-6.00 sec 112 MBytes 936 Mbits/sec 0 69.3 KBytes
[ 6] 6.00-7.00 sec 111 MBytes 935 Mbits/sec 0 69.3 KBytes
[ 6] 7.00-8.00 sec 111 MBytes 935 Mbits/sec 0 69.3 KBytes
[ 6] 8.00-9.00 sec 111 MBytes 928 Mbits/sec 0 69.3 KBytes
[ 6] 9.00-10.00 sec 111 MBytes 935 Mbits/sec 0 69.3 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Retr
[ 6] 0.00-10.00 sec 1.08 GBytes 932 Mbits/sec 0 sender
[ 6] 0.00-10.00 sec 1.08 GBytes 931 Mbits/sec receiver
I have tried to write a huge file in iSCSI volume to check NAS CPU load. This load doesn't exceed 15%. Bottleneck doesn't come from CPU. Same constatation about NAS memory.
Code: Select all
[~] # qcli_storage -p
Enclosure Port Sys_Name Size Type RAID RAID_Type Pool TMeta VolType VolName
NAS_HOST 1 /dev/sda 5.46 TB data /dev/md1 RAID 6,512 1 64 GB flexible euclide_0
NAS_HOST 2 /dev/sdb 5.46 TB data /dev/md1 RAID 6,512 1 64 GB flexible euclide_0
NAS_HOST 3 /dev/sdc 5.46 TB data /dev/md1 RAID 6,512 1 64 GB flexible euclide_0
NAS_HOST 4 /dev/sdd 5.46 TB data /dev/md1 RAID 6,512 1 64 GB flexible euclide_0
[~] # qcli_storage -T
fio test command for physical disk: /sbin/fio --filename=test_device --direct=1 --rw=read --bs=1M --runtime=15 --name=test-read --ioengine=libaio --iodepth=32 &>/tmp/qcli_storage.log
fio test command for RAID: /sbin/fio --filename=test_device --direct=0 --rw=read --bs=1M --runtime=15 --name=test-read --ioengine=libaio --iodepth=32 &>/tmp/qcli_storage.log
Start testing!
Performance test is finished 100.000%...
Enclosure Port Sys_Name Throughput RAID RAID_Type RAID_Throughput Pool
NAS_HOST 1 /dev/sda 210.50 MB/s /dev/md1 RAID 6 310.78 MB/s 1
NAS_HOST 2 /dev/sdb 200.62 MB/s /dev/md1 RAID 6 310.78 MB/s 1
NAS_HOST 3 /dev/sdc 207.33 MB/s /dev/md1 RAID 6 310.78 MB/s 1
NAS_HOST 4 /dev/sdd 206.52 MB/s /dev/md1 RAID 6 310.78 MB/s 1
[~]
Help will be welcome,
JB