Skip to main content

Copying files in AWS S3 bucket


Learning to copy files to S3 bucket or from S3 bucket to local folder is a must thing to learn when administering S3 bucket.

S3 bucket is an object storage.  See details on this link: https://aws.amazon.com/s3/features/

An S3 policy called WORM (write-once read-many) policy can be enforced to S3 bucket.

WORM is ideal for log files.  Backup or write the log file once and read it many times if someone needs to read or review the logs.

Let’s get into business, how to copy files to S3 bucket?

S3 is an acronym for Simple Storage Service.

S3 accepts Linux command, so if you are running Windows be careful when typing S3 commands.

A simple mistake of running Capital letters can ruin your day since the command will not work and the error won’t be friendly to tell you that it was just a simple mistake that you just type in capital letter.

Copying is plain simple, so here’s a basic and simple example:

aws s3 cp test_bucket.txt s3://thes3bucket  

s3 – is small letter it’s not S3. If S3 is typed on the command line, then an error will occur.

s3://thes3bucket – notice that the bucket name is directly typed right after s3://

The command copies test_bucket.txt to the bucket called “thes3bucket”.

Note, the command above works in Windows or Linux system.

To verify if the file has been copied. Type:

aws s3 ls s3://thes3bucket  

If the command is successfully, then it will display the contents of the bucket with the file that was copied, the “test_bucket.txt”.

What if you need to copy a file to a sub-folder within the AWS S3 bucket?

There’s no magic on it, just type the whole folder path.

Example, if the bucket is like this:  thes3bucket is the main folder and there is a sub folder call sub_folder_s3_bucket

So, to copy files to this sub folder the command will be like this:

aws s3 cp test_bucket_2_subfolder.txt s3://thes3bucket/sub_folder_s3_bucket


Note, that “/” forward slash was used rather than back slash.

The above command will work both in Windows and Linux system.

The examples are copying a file from local folder to S3 bucket.

The syntax is something like this:

aws cp       


To copy from AWS S3 bucket to local folder, then the syntax will be like this:

aws cp  


Example:

aws s3 cp s3://thes3bucket/test_bucket.txt .

The test_bucket.txt file will be copied the current folder no need to specify the folder name since “.” or the dot specifies the current path.


If the file is in a subfolder then the command will be like this:

aws s3 cp s3://thes3bucket/sub_folder_s3_bucket/test_bucket_2_subfolder.txt .

This will copy the file test_bucket_2_subfolder.txt located on sub_folder_s3_bucket to the current directory.

Above examples just copy a single file if need to copy a lot of files then the --recursive option can be used.

AWS S3 bucket also has the “sync” option which sync all files, so both folder on the source and destination will be the same.

aws s3 cp s3://the_S3_Bucket/dir_folder localdir --recursive


Above will copy all the bucket to the local folder.

To sync:
aws s3 sync . s3://the_S3_Bucket


Above will sync the current directory to S3 bucket, so basically, it’s like uploading the current directory to AWS s3 bucket cloud.

That’s it. Till next time.


================================
Free Android Apps:

Click  links below to find out more:

Excel Keyboard guide:


Heaven's Dew Fall  Prayer app for Android :



Catholic Rosary Guide  for Android:


Divine Mercy Chaplet Guide (A Powerful prayer) BFF = Be Filled Faith:


Labels:

Comments

Post a Comment

Popular posts from this blog

WMIC get computer name

WMIC get computer model, manufacturer, computer name and  username. WMIC is a command-line tool and that can generate information about computer model, its manufacturer, its username and other informations depending on the parameters provided. Why would you need a command line tool if there’s a GUI to check? If you have 20 or 100 computers, or even more. It’s quite a big task just checking the GUI to check the computer model and username. If you have remote computers, you need to delegate someone in the remote office or location to check. Or you can just write a batch file or script to automate the task. Here’s the code below on how get computer model, manufacturer and the username. Open an elevated command prompt and type:     wmic computersystem get "Model","Manufacturer", "Name", "UserName" Just copy and paste the code above, the word “computersystem” does not need to be change to a computer name. A...
Post a Comment
Read more

Notepad++ convert multiple lines to a single line and vice versa

Notepad++ is an awesome text editing tool, it can accept regex to process the text data. If the data is in a “.csv” format or comma separated values which is basically just a text file that can either be opened using a text editor, excel or even word. Notepad++ can process the contents of the file using regex. Example if the data has multiple rows or lines, and what is needed is to convert the whole lines of data into a single line. Notepad++ can easily do it using regex. However, if the data is on a single line and it needs to be converted into multiple lines or rows then regex can also be used for this case. Here’s an example on how to convert multiple rows or lines into a single line. Example data: Multiple rows, just a sample data. Press Ctrl+H, and  on "Find what" type: [\r\n]+ and on "Replace with" type with: , (white space) --white space is needed if need to have a space in between the data. See image below, "Regular Expression" must be se...
1 comment
Read more

Print error 016-799 - Fuji Film Xerox

016-799 Fuji Xerox or Fuji Film print error code. That shows a description error as “Print instruction Fail detected in decomposer.” The error code and error description are alien languages for users and even system administrators who are not familiar with Fuji Xerox error code. The error code is quite simple and easy to fix, if the job print goes to the printer but print out doesn’t come out. So, basically the print job was received by the printer, but the printer just doesn’t know what type of paper or what size to use or which tray to utilize for the print out. In some instances, this is just a paper mismatch but the error description; if using Windows 10 to print does not exactly points to what is the issue. First thing to check, is the paper size selected by the user to print. Example, if the printer configuration is A3 and A4 sizes only. But then the person printing the file accidentally chooses “A4 Cover” then this error 016-799 will occur. ...
6 comments
Read more