Eliminating duplicate lines

[Jim Herrmann]

I find that running this command in my Thunderbird Mail Local Folders 
directory will give me addresses that are being used to send junk mail 
to me.

grep -i "Delivered-To" Junk | sort | uniq -c |sort -nr >spamaddresses.txt

I get tons of junk in my postmaster, catch all account, and I'm trying 
to block some of it before it gets to the postmaster inbox.  To do that, 
I need to know what addresses are being used.  This does it.

However, I think I'm going to start rejecting any addresses that are not 
defined to my domain, and thus this is not needed.  It has, however, 
served as a great learning opportunity on the use of sort and uniq.

Thanks,
Jim

Monty J. Harder wrote:

> Oh.  I've used that many times as well.   Like to make a Top Ten list 
> of the most popular things:
> */something/ | sort | uniq -c | sort -nr | head*
>
>  
> On 12/23/05, *Luke-Jr* <luke at dashjr.org <mailto:luke at dashjr.org>> wrote:
>
>     On Friday 23 December 2005 15:23, Monty J. Harder wrote:
>     > On 12/22/05, Luke-Jr < luke at dashjr.org <mailto:luke at dashjr.org>>
>     wrote:
>     > > On Friday 23 December 2005 04:35, Jim Herrmann wrote:
>     > > > Thanks to Ron also.  This may be easier to remember since it
>     uses more
>     > > > common commands.
>     > >
>     > > How is 'sort' and more common than 'uniq'? I really only use
>     the two in
>     > > combination (uniq -c | sort -n) anyway...
>     >
>     > That's backwards.  You have to put the *sort* to the left of the
>     *uniq* for
>     > it to work, because *uniq* requires that its input already be
>     sorted.  The
>     > beauty of the Unix philosophy is that *uniq* doesn't have to
>     know about
>     > sorting, because *sort* already does.
>
>     Not quite backwards, read it again-- you're right that it does
>     require
>     presorted content, though.
>
>
>------------------------------------------------------------------------
>
>_______________________________________________
>Kclug mailing list
>Kclug at kclug.org
>http://kclug.org/mailman/listinfo/kclug
>  
>