Skip to main content

Basic AWK usage tutorial


“Awk" command illustration on how to process input strings and get desired output.

Example below shows how "Awk" manipulates the string to get the data needed.

Below shows the output normal output listing of  "ls -l" command.

Output of  "ls"  below has "9" columns separated by space in between the columns.

"d" = In Linux if the listing starts with "d" it shows that the filename listed at the "9th" column or the last column is the name of the directiry.

"-" = In Linux if the listing starts with "-" it indicates that the data is just a regular file or not a directory of course.

Those are commonly used naming convention or indicators to determine the type of data. There are some other indicators used such as for symbolic links and hard links.

[ttxers@farmx99 honey_store]$ ls -l
total 16
drwx------ 3 branchx branchx 4096 Apr 26  2015 lists
drwx------ 3 branchx branchx 4096 Jun 30  2015 mailers
drwx------ 4 branchx branchx 4096 Apr 26  2015 spammers
drwx------ 3 branchx branchx 4096 Apr 26  2015 xmsxx


"Awk" command that prints columns 6 to 9. awk '{print $6,$7,$8,$9}'

The above awk print command can be illustrated as: awl '{print $col_number, $col_number}'

$6, $7, $8, $9 represent the columns from the ls -l output.

The "," between $6 to $9 will provide a space between each column. Or you can replace it with any  character of your choice.

[ttxers@farmx99 honey_store]$ ls -l | awk '{print $6,$7,$8,$9}'

Sample output produce by above command:

Apr 26 2015 lists
Jun 30 2015 mailers
Apr 26 2015 spammers
Apr 26 2015 xmsxx

Sort the output by month using the sort -M command.

[ttxers@farmx99 honey_store]$ ls -l | awk '{print $6,$7,$8,$9}' | sort -M

Apr 26 2015 lists
Apr 26 2015 spammers
Apr 26 2015 xmsxx
Jun 30 2015 mailers

To replace the white space and used other character use the command below:

[ttxers@farmx99 honey_store]$ ls -l | awk '{print $6 "-" $7 "-" $8 "-" $9}'

---
Apr-26-2015-lists
Jun-30-2015-mailers
Apr-26-2015-spammers
Apr-26-2015-xmsxx

Search the web for some complex examples. Start with basic and simple example to grasp the fundamental usage.

An example to delete files using Awk and Grep command.

 ls -l | grep "A001*.eml" | awk '{print $9}' |  echo  $(xargs)

 ls -l | grep "A001*.eml" | awk '{print $9}' |  rm -f  $(xargs)


Before deleting the file use the echo command to check which files are filtered by the grep command.

The rm -f will perform a force deletion without any prompt.

To delete a single file:

 ls -l | grep "2013" | awk '{print $9}' | yes | rm  A0010002.eml

Please do a test with a dummy data before executing the command in a production environment or else data loss will be the consequence.

Deletion will cause more harm than good, if not planned carefully and the person pressing the "enter" key does not exactly know what he/she is doing.



Comments

Popular posts from this blog

Copy a single file using robocopy

Copy a single file using robocopy from a local folder to a shared folder on the network.
A simple rule of thumb before any disaster strike, don't interchange the source and the destination.

If source and destination is mistakenly reverse, files might get overwritten. To avoid any loss of data do a test with a dummy file to ensure things work perfectly.
Robocopy [source][destination]   [file to be copied]
robocopy c:\local_c_folder  \\PC_network\shared_folder   file_to_be_copied_xx.txt
The command will be completed successfully provided the network access right has no issues.

Robocopy works quite good on large files. A simple copy or xcopy command will also work but the speed might vary.

However, if the file (ex. an ISO file) and is more than 4GB and the filesystem  of the thumbdrive or the storage is FAT system, then robocopy or any methods of copying will not work. Since FAT has a file size limitation of less than 3GB.

Robocopy is free it can be accessed from command line. No ne…

WMIC List printers

WMIC comes handy if you are a command line junkie.

To list printers via command line type:

wmic printer get name  = = = this will list all the printers installed on a workstation

To list the printer name and the port name of the printers, type this command:

wmic printer get name, portname

Type this command below to list the printer drivers:

wmic printer get name, drivername

To get the device id:

wmic printer get name, deviceid

You can deploy a batch file startup script to check which printer is installed on the computers and redirect the output to a shared folder.

PowerShell can also be used in conjunction with WMIC command:
http://quickbytesstuff.blogspot.sg/2015/11/powershell-list-printers-of-remote.html


To see more WMIC tips, click on WMIC label below.

Cheers!!!

Linux Android App cheat sheet:
https://play.google.com/store/apps/details?id=com.LinuxMobileKit

WMIC get computer name

WMIC get computer model, manufacturer, computer name and  username.
WMIC is a command-line tool and that can generate information about computer model, its manufacturer, its username and other informations depending on the parameters provided.
Why would you need a command line tool if there’s a GUI to check?
If you have 20 or 100 computers, or even more. It’s quite a big task just checking the GUI to check the computer model and username.
If you have remote computers, you need to delegate someone in the remote office or location to check.
Or you can just write a batch file or script to automate the task.
Here’s the code below on how get computer model, manufacturer and the username.
Open an elevated command prompt and type:
wmic computersystem get "Model","Manufacturer", "Name", "UserName"
Just copy and paste the code above, the word “computersystem” does not need to be change to a computer name.
A sample output below will be generated if the co…