Meandering Life! » mapreduce http://manku.thimma.org Hither, Thither ... Sat, 21 Jan 2012 06:07:03 +0000 en hourly 1 http://wordpress.org/?v=3.3.1 Crazy shell scripting http://manku.thimma.org/2009/04/crazy-shell-scripting/ http://manku.thimma.org/2009/04/crazy-shell-scripting/#comments Tue, 14 Apr 2009 11:37:50 +0000 shashi http://manku.thimma.org/?p=61 Continue reading →]]> Not quite a mapreduce implementation :-D , but nevertheless …

while read l; do echo "SELECT id, email FROM tblName WHERE email='$l' ORDER by id DESC LIMIT 1;"|mysql -u root dbName; done < /tmp/dupes3.txt |grep -v 'email'|cut -f1|sed 's/^\(.*\)$/DELETE FROM tblName WHERE id=\1;/g' > /tmp/deletedupes3.sql

]]> http://manku.thimma.org/2009/04/crazy-shell-scripting/feed/ 2