bash – Page 37 – Tarik Billa

Extracting data from HTML table

September 26, 2023 by Tarik

A Python solution using BeautifulSoup4 (Edit: with proper skipping. Edit3: Using class=”details” to select the table): from bs4 import BeautifulSoup html = “”” <table class=”details” border=”0″ cellpadding=”5″ cellspacing=”2″ width=”95%”> <tr valign=”top”> <th>Tests</th> <th>Failures</th> <th>Success Rate</th> <th>Average Time</th> <th>Min Time</th> <th>Max Time</th> </tr> <tr valign=”top” class=”Failure”> <td>103</td> <td>24</td> <td>76.70%</td> <td>71 ms</td> <td>0 ms</td> <td>829 ms</td> </tr> … Read more

Copying files based on modification date in Linux

September 26, 2023 by Tarik

Use the -exec option for find: find . -mtime -90 -exec cp {} targetdir \; -exec would copy every result returned by find to the specified directory (targetdir in the above example).

Append text to file using sed

September 26, 2023 by Tarik

Use $ a. sed -i “$ a some text” somefile.txt

How to get the number of files in a folder as a variable?

September 26, 2023 by Tarik

The quotes are causing the error messages. To get a count of files in the directory: shopt -s nullglob numfiles=(*) numfiles=${#numfiles[@]} which creates an array and then replaces it with the count of its elements. This will include files and directories, but not dotfiles or . or .. or other dotted directories. Use nullglob so … Read more

Skip blank lines when iterating through file line by line

September 26, 2023 by Tarik

Be more elegant: echo “\na\nb\n\nc” | grep -v “^$” cat $file | grep -v “^$” | next transformations…

CentOS directory structure as tree?

September 26, 2023 by Tarik

If tree is not installed on your Centos system (I typically recommend server setups to use minimal install disk anyhow) you should type the following at your command line: # yum install tree -y If this doesn’t install it’s because you don’t have the proper repository. I would use the Dag Wieers repository: http://dag.wieers.com/rpm/FAQ.php#B After … Read more

Calling a python function from bash script

September 26, 2023 by Tarik

python -c’import themodule; themodule.thefunction(“boo!”)’

for each dir create a tar file

September 25, 2023 by Tarik

The script that you wrote will not work if you have some spaces in a directory name, because the name will be split, and also it will tar files if they exist on this level. You can use this command to list directories not recursively: find . -maxdepth 1 -mindepth 1 -type d and this … Read more

Replace “\n” with newline in awk

September 25, 2023 by Tarik

How about this? $ cat file John\nDoe Sara\nConnor $ awk ‘{gsub(/\\n/,”\n”)}1’ file John Doe Sara Connor

Adding newline characters to unix shell variables

September 25, 2023 by Tarik

Try $’\n’: VAR=a VAR=”$VAR”$’\n’b echo “$VAR” gives me a b