All,
When I xfer the same file via sftp from the source server to the source gateway I see a xfer rate of 16.7MB/s. This eliminates the possibilty of the source storage being the culprit. That gets the file directly adjacent to the source GF network box.
I have tried with the destination storage being /dev/null, so no issue there.
The destination network is a consumer grade Linksys WiFi router directly connected to the GF network box with my laptop directly connected to the same WiFi router.
I have tried with sftp and http and received identical results.
The original file is compressed. I have also noticed that a parallel ssh connection between the houses is very laggy during the xfer.
I just noticed that with the two identical NICs (82541PI Gigabit) in the source firewall,
the NIC connected to my internal switch (a Linksys LGS318) shows e1000: enp1s0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
while the one connected to the GF Network box shows e1000: enp1s2 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
<Several minutes later>
No, that is NOT the cause. They've been that way since 2019. (I checked my kernel logs)
All servers report CPU Idle between 85% to 95% during the xfer so that's also not the issue.
This change in behaviour is fairly recent. I used to see much higher transfer rates with the same HW and SW six months ago and earlier.
Still digging ... ... ...
Thanks,