Well..yeah sending entire files between two hosts with the server acting as an intermediate node will put alot of strain on the server. It could also become a bottleneck.
Setting up a separate direct connection between the two hosts for the file transfer is a good idea.