Skip to main content

How to use Rsync to copy file one after another at a limited bandwidth

Copying files at the same time will ultimately consume all the bandwidth.

So, to avoid such issue it would be good to tell Rsync to copy only once the other previous Rsync has finished copying.

Copying or transferring files from one system to another location without impacting the bandwith or consuming all available bandwidth, when using Rsync.

Using Rsync in Linux to copy files and folders is a common task for Sys Admin.

When using Rsync and limiting the upper bandwith or telling Rsync the maximum bandwidth to use can be achieved using the "--limit" option.

--limit is in KBps (Kilo Bytes per second and not Kilo bits)

--partial is another good option if there is frequent disconnection this will tell Rsync to pick-up or include the files that has been transferred or copied


Here's the command on how to use Rsync in Linux to limit the bandwidth when copying:

rsync -Pz --limit=30000 <source> <destination>

-P = will show the progress

-z = tells Rsync to compress file data during transfer

Example:

rsync -Pz --limit=30000 /data/ /mnt/transfered_data/

This will copy /data/ to /mnt/transfered_data/ at maximum bandwidth of 30MBps. 

"/" <== at the end of the directory name is very important it means to copy the files inside the directory

/mnt/transfered_data/ <-- remote system mounted on a local server

If there's a remote connection of the local server and remote server it would be better to mount it, rather than doing an SSH and use rsync. Of course, whatever preferred method is always the best choice as long as it meets the end goal.

However, KISS method (Keep It Simple SysAdmin) is a good choice. Why make things complicated, it can be done using simple ways.

Copy files after Rsync has done copying the previous file.

Example:

rsync -Pz --limit=30000 /data1/  /mnt/transfered_data/data1/ ; rsync -Pz --limit=30000 /data2/  /mnt/transfered_data/data2/ ; rsync -Pz --limit=30000 /data3/  /mnt/transfered_data/data3/

Using the ";" semi-colon trick. The files will be copied in sequence or Rsync will only run the other Rsync command once the previous Rsync has done copying. Simple :) 

";" semi-colon does a wonderful task in order not to consume all the bandwidth. Rsync will copy the file one by one.



Cheers! Take care. Till next Time.

Stay safe! and Keep things up! 

Do ASAP, Always Say A Prayer...

Practice O.T.G. = Obedience To God

Make time for Prayer and Meditation.

================================

Free Android Apps:

Click  links below to find out more:

Free Android Apps:

Click  links below to find out more:

Excel Keyboard guide:

https://play.google.com/store/apps/details?id=chrisjoms.myexcelapplicationguide

Heaven's Dew Fall  Prayer app for Android :

https://play.google.com/store/apps/details?id=soulrefresh.beautiful.prayer

Catholic Rosary Guide  for Android:

Pray the Rosary every day, countless blessings will be showered upon your life if you recite the Rosary faithfully. 

https://play.google.com/store/apps/details?id=com.myrosaryapp

Divine Mercy Chaplet Guide (A Powerful prayer) BFF = Be Filled Faith:

https://play.google.com/store/apps/details?id=com.dmercyapp

Labels:

Comments

Post a Comment

Popular posts from this blog

Notepad++ convert multiple lines to a single line and vice versa

Notepad++ is an awesome text editing tool, it can accept regex to process the text data. If the data is in a “.csv” format or comma separated values which is basically just a text file that can either be opened using a text editor, excel or even word. Notepad++ can process the contents of the file using regex. Example if the data has multiple rows or lines, and what is needed is to convert the whole lines of data into a single line. Notepad++ can easily do it using regex. However, if the data is on a single line and it needs to be converted into multiple lines or rows then regex can also be used for this case. Here’s an example on how to convert multiple rows or lines into a single line. Example data: Multiple rows, just a sample data. Press Ctrl+H, and  on "Find what" type: [\r\n]+ and on "Replace with" type with: , (white space) --white space is needed if need to have a space in between the data. See image below, "Regular Expression" must be se
1 comment
Read more

WMIC get computer name

WMIC get computer model, manufacturer, computer name and  username. WMIC is a command-line tool and that can generate information about computer model, its manufacturer, its username and other informations depending on the parameters provided. Why would you need a command line tool if there’s a GUI to check? If you have 20 or 100 computers, or even more. It’s quite a big task just checking the GUI to check the computer model and username. If you have remote computers, you need to delegate someone in the remote office or location to check. Or you can just write a batch file or script to automate the task. Here’s the code below on how get computer model, manufacturer and the username. Open an elevated command prompt and type:     wmic computersystem get "Model","Manufacturer", "Name", "UserName" Just copy and paste the code above, the word “computersystem” does not need to be change to a computer name. A
Post a Comment
Read more

How to check office version from command line

The are quite a few ways to check office version it can be done via registry, PowerShell or VBScript and of course, good old command line can also do it. Checking Windows office version whether it is Office 2010, Office, 2013, Office 2016 or other version is quite important to check compatibility of documents; or just a part of software inventory. For PowerShell this simple snippet can check the office version: $ol = New-Object -ComObject Excel.Application $ol . Version The command line option will tell you where’s the path located; the result will also tell whether office is 32-bit, 64-bit and of course the version of the office as well. Here’s the command that will check the office version and which program directory the file is located which will tell whether it’s 32-bit or 64-bit. Command to search for Excel.exe: DIR C:\ /s excel.exe | find   /i "Directory of"  Above command assumes that program files is on  C: drive. Sample Outpu
Post a Comment
Read more