Skip to main content

Use Linux Bash to query or automate listing the contents of an S3 bucket.

Below is a Bash script that will query a bucket with the current date specified on the system.

Querying or listing the contents of the S3 bucket is quite a good strategy. Let's say if you need to make sure that important backups are copied or present on S3 bucket. 

Or you need to monitor what are the contents being dumped to a specific S3 bucket.

Automating querying S3 contents in Linux using Bash scripting is a good idea. Below is a code that works fine on a Linux system.


#!/bin/bash

varDate=$(date +%Y-%m-%d)

aws s3api list-objects --bucket "name_of-the-bucket" --prefix sub_directory_bucket --query 'Contents[?LastModified>=`'${varDate}'`][].{Key: Key, Size: Size, LastModified: LastModified}' >> /tmp/s3_server_files_$varDate.txt


The script can be configured on a cron task and runs on a daily basis then the date is automatically supplied by the bash script and data is saved on /tmp/ and file will not be overwritten since filename is based on date.

The script assumes that AWS CLI has been downloaded and configured on the Linux server and access keys, password and other settings are working fine. 


 Cheers...till next time. Stay safe and keep praying that this pandemic will end.

================================

Free Android Apps:


Click  links below to find out more:

Excel Keyboard guide:

https://play.google.com/store/apps/details?id=chrisjoms.myexcelapplicationguide

Heaven's Dew Fall  Prayer app for Android :

https://play.google.com/store/apps/details?id=soulrefresh.beautiful.prayer

Catholic Rosary Guide  for Android:

Pray the Rosary every day, countless blessings will be showered upon your life if you recite the Rosary faithfully. 

https://play.google.com/store/apps/details?id=com.myrosaryapp

Divine Mercy Chaplet Guide (A Powerful prayer) BFF = Be Filled Faith:

https://play.google.com/store/apps/details?id=com.dmercyapp  

Comments

Popular posts from this blog

WMIC get computer name

WMIC get computer model, manufacturer, computer name and  username. WMIC is a command-line tool and that can generate information about computer model, its manufacturer, its username and other informations depending on the parameters provided. Why would you need a command line tool if there’s a GUI to check? If you have 20 or 100 computers, or even more. It’s quite a big task just checking the GUI to check the computer model and username. If you have remote computers, you need to delegate someone in the remote office or location to check. Or you can just write a batch file or script to automate the task. Here’s the code below on how get computer model, manufacturer and the username. Open an elevated command prompt and type:     wmic computersystem get "Model","Manufacturer", "Name", "UserName" Just copy and paste the code above, the word “computersystem” does not need to be change to a computer name. A...

Print error 016-799 - Fuji Film Xerox

016-799 Fuji Xerox or Fuji Film print error code. That shows a description error as “Print instruction Fail detected in decomposer.” The error code and error description are alien languages for users and even system administrators who are not familiar with Fuji Xerox error code. The error code is quite simple and easy to fix, if the job print goes to the printer but print out doesn’t come out. So, basically the print job was received by the printer, but the printer just doesn’t know what type of paper or what size to use or which tray to utilize for the print out. In some instances, this is just a paper mismatch but the error description; if using Windows 10 to print does not exactly points to what is the issue. First thing to check, is the paper size selected by the user to print. Example, if the printer configuration is A3 and A4 sizes only. But then the person printing the file accidentally chooses “A4 Cover” then this error 016-799 will occur. ...

PowerShell GUI with buttons, textbox and combobox

GUI makes life easier, but of course command line has a power of its own. How to add a form in PowerShell with Buttons, TextBox and ComboBox? Adding GUI forms in PowerShell must be done manually by code. It’s not that hard, you just need to love PowerShell and see what it can do to automate IT administration and makes your life easier. Anyway, code below introduces how to add GUI to PowerShell and it also illustrates how to make use of those GUI buttons and send a command to remote computers. Code to add buttons, textbox and combobox in PowerShell, and how to execute a command after the button is clicked. #initialize the main form $form = new-object Windows.forms.form $form . text = "Server Selection Form" $form . minimumSize = New-Object System.Drawing.Size ( 600 , 300 ) $form . maximumSize = New-Object System.Drawing.Size ( 600 , 300 ) #add a button to the form $button = new-object windows.forms.button $button . text...