Use -n in your sort command, so that it sorts numerically. Also -r allows you to reverse the result: $ sort test.txt | uniq -c | sort -n 1 ada 1 ccd 1 cd 1 nnaa 2 aaa 2 bbb 4 aa 10 naa $ sort test.txt | uniq -c | sort -nr 10 naa … Read more
Use sort and uniq: sort inputfile | uniq -u The -u option would cause uniq to print only unique lines. Quoting from man uniq: -u, –unique only print unique lines For your input, it’d produce: eagle forest Obs: Remember to sort before uniq -u because uniq operates on adjacent lines. So what uniq -u actually … Read more
Using sort -u does less I/O than sort | uniq, but the end result is the same. In particular, if the file is big enough that sort has to create intermediate files, there’s a decent chance that sort -u will use slightly fewer or slightly smaller intermediate files as it could eliminate duplicates as it … Read more
uniq has the option you need: -u, –unique only print unique lines $ cat file.txt 1 1 2 3 5 5 7 7 $ uniq -u file.txt 2 3
The UNIX Bash Scripting blog suggests: awk ‘!x[$0]++’ This command is telling awk which lines to print. The variable $0 holds the entire contents of a line and square brackets are array access. So, for each line of the file, the node of the array x is incremented and the line printed if the content … Read more
sort -u -t, -k1,1 file -u for unique -t, so comma is the delimiter -k1,1 for the key field 1 Test result: overflow@domain2.example,2009-11-27 00:58:29.793000000,xx3.net,255.255.255.0 stack2@domain.example,2009-11-27 01:05:47.893000000,xx2.net,127.0.0.1