Comments on: Crazy shell scripting http://manku.thimma.org/2009/04/crazy-shell-scripting/ Tech, Business and Some More ... Mon, 24 May 2010 05:01:53 +0000 hourly 1 http://wordpress.org/?v=3.0 By: shashi http://manku.thimma.org/2009/04/crazy-shell-scripting/comment-page-1/#comment-176 shashi Wed, 15 Apr 2009 02:50:57 +0000 http://manku.thimma.org/?p=80#comment-176 Aravinda, Bang on! you're right on all the points :-) Aravinda,

Bang on! you’re right on all the points :-)

]]> By: Aravinda http://manku.thimma.org/2009/04/crazy-shell-scripting/comment-page-1/#comment-175 Aravinda Tue, 14 Apr 2009 17:18:28 +0000 http://manku.thimma.org/?p=80#comment-175 Good one :) As per my understanding, 1. dupes.txt with hundreds of records, 2. Split that file into dupes1.txt, dupes2.txt... dupesN.txt 3. run above script in multiple system 4. Combine the files generated by each system and run to remove duplicates in DB. but how the dupes3.txt(or dupes.txt) populated? echo "SELECT email from tblName group by email having count(email) > 1" | mysql -uroot dbName | grep -v 'email' > dupes.txt correct me if i am wrong. Good one :)

As per my understanding,
1. dupes.txt with hundreds of records,
2. Split that file into dupes1.txt, dupes2.txt… dupesN.txt
3. run above script in multiple system
4. Combine the files generated by each system and run to remove duplicates in DB.

but how the dupes3.txt(or dupes.txt) populated?
echo “SELECT email from tblName group by email having count(email) > 1″ | mysql -uroot dbName | grep -v ‘email’ > dupes.txt

correct me if i am wrong.

]]>