Comments on: Crazy shell scripting http://manku.thimma.org/2009/04/crazy-shell-scripting/ Hither, Thither ... Tue, 18 Oct 2011 04:54:15 +0000 hourly 1 http://wordpress.org/?v=3.3.1 By: Shashi http://manku.thimma.org/2009/04/crazy-shell-scripting/#comment-24 Shashi Wed, 15 Apr 2009 08:20:32 +0000 http://manku.thimma.org/?p=61#comment-24 Aravinda, Bang on! youre right on all the points :-) Aravinda,

Bang on! youre right on all the points :-)

]]> By: Aravinda http://manku.thimma.org/2009/04/crazy-shell-scripting/#comment-23 Aravinda Tue, 14 Apr 2009 10:48:48 +0000 http://manku.thimma.org/?p=61#comment-23 Good one :) As per my understanding, 1. dupes.txt with hundreds of records, 2. Split that file into dupes1.txt, dupes2.txt dupesN.txt 3. run above script in multiple system 4. Combine the files generated by each system and run to remove duplicates in DB. but how the dupes3.txt(or dupes.txt) populated? echo SELECT email from tblName group by email having count(email) > 1 | mysql -uroot dbName | grep -v email > dupes.txt correct me if i am wrong. Good one :)

As per my understanding,
1. dupes.txt with hundreds of records,
2. Split that file into dupes1.txt, dupes2.txt dupesN.txt
3. run above script in multiple system
4. Combine the files generated by each system and run to remove duplicates in DB.

but how the dupes3.txt(or dupes.txt) populated?
echo SELECT email from tblName group by email having count(email) > 1 | mysql -uroot dbName | grep -v email > dupes.txt

correct me if i am wrong.

]]>