Qnap 40GbE Network

[zkrr01]

Has anyone got the QNAP Dual-Port 40GbE Network Expansion Card? Now that I have the Samsung 970 Pro SSD's on two workstations, I need a way to copy large files on the SSD's. I am currently using 10Gbe cards, but the Samsung SSD is about 3 times faster then the 10GbE cards are capable of.

[Don]

Are you maxing out the 10GB connection?

[zkrr01]

Yes, a 10Gbe connection will handle about 1100MB/sec. A Samsung SSD Pro will do about 3500MB/s.

[zkrr01]

I finally got a 40GbE network connection between two Windows 10 8920 Dell Workstations where I have the Samsung 970 PRO SSD's. On initial tests I am able to transfer 500 GB's of data at 2120 MB/s using the standard Microsoft drag/drop interface. Since the SSD's spec's show 3500 MB/s
read and 2700 MB/s write, the initial tests are a bit low since the overall transfer will be restricted by the write speed of 2700 MB/s.

I am using a Mellanox MCX4131A-BCAT ConnectX-4 Lx EN Network Interface Card 40GbE Single-Port QSFP28 PCIe3.0 x8 ROHS R6 NIC in each Dell 8920 Workstation. I have jumbo packets enabled.

Any recommendations on how to get the transfer speed from 2120 MB/s closer to the 2700 MB/s?

[QNAPDanielFL]

QNAP Just came out with a PCIe card that can take 4 M.2 NVMe SSDs and has a PCIe bandwidth of gen3X8. If you had 4 NVMe drives in raid 10 for example, I expect the write and read rates would be higher.

This card can go in either a QNAP NAS or a PC.
QM2-4P-384

[zkrr01]

I changed the Jumbo Packet size to 9614 and I am now able to achieve 2700MB/s writing to the Samsung Pro SSD.
I was using the following robocopy setup:
ROBOCOPY /MT:2 /MIR /R:0 /W:0 /LOG:G:\files.log /NP /NDL

[zkrr01]

I am now able to achieve 3048MB/s writing to the Samsung Pro SSD using a packet size of 9614 bytes.

I was using the following robocopy setup:
ROBOCOPY /MT:1 /MIR /R:0 /W:0 /LOG:G:\files.log /NP /NDL \\Robin\g\Exported-Systems \\Eagle\g\Exported-Systems