0

I have a problem to transfer files from windows dir to Linux parallelly via internet. For example, using putty, I have 8 files in my windows directory, and should send them to the Linux server parallelly, transferring single file is no problem, but I don't know to transfer multifiles parallelly.

Rui F Ribeiro
  • 55,929
  • 26
  • 146
  • 227
irina
  • 21
  • 1
  • 1
    Putty is not designed for advanced (multiple) file transfer. Use any other file transfer protocol, not a terminal client over ssh! – Ipor Sircer Nov 19 '18 at 22:08
  • Possible duplicate of [Parallelise rsync using GNU Parallel](https://unix.stackexchange.com/questions/189878/parallelise-rsync-using-gnu-parallel). *If all you have is a hammer, every problem looks like a nail:* you need to use another tool to send these files or open multiple putty sessions to send files in parallel. **;-)** – Fabby Nov 19 '18 at 22:45

1 Answers1

1

I found this:

Here's the command to be run on the remote server, involving find and parallel:

 find /data/process/ -type f | parallel scp {} user@machineB:/data/process/

See the documentation on how to control the number of jobs to be executed in parallel.

The number of concurrent jobs is given with --jobs or the equivalent -j.
By default --jobs is the same as the number of CPU cores.
--jobs 0 will run as many jobs in parallel as possible.

Found it here: Copy files in parallel from remote servers using some command on terminal?

Michael Prokopec
  • 2,202
  • 7
  • 21