Not sure who reads this, or who know sof my sick little Microsoft Excel fetish. I love the program, I know liek 1% of its features and am amazed at all the complex things it can do.
Lately I have been using it one way or another for about 4-5 hours a day I will say and occasional get a “woodrow” when a new time saving feature pops up.
I have been having to prune large sets of lists and have been able to use excels remove duplicates feature, but found it lacking. After some research I did for a an easy solution / excel macro I found this excellent free / donation ware utility. It is pretty powerful stuff andI thought I would share:
It is called the duplicate master and can be found here:
http://members.iinet.net.au/~brettdj/
here are some features:
Works with cells or entire rows!
Runs over ranges, multiple sheets or the entire Workbook!
Highlight duplicate cells or rows
Delete duplicate cells or rows
Select duplicate cells or rows
Extract unique cells or rows to a master list
Extract and count the number of duplicate cells or rows to a master list
It is pretty awesome, and it is free! Just follow the install instruactions on that page and raise hell with removing duplicates or highlighting duplicates in excel, without using a macro.
Thanks BrettDj for the software!
{ 13 comments… read them below or add one }
Nice find, Werty.
Now, how do you handle data sets (i.e. keywords) that are over 65k (the max rows excel can handle is 65xxx something)?
Ewhisper, I do not deal with data sets that large any more…I am much more targeted in the way that we create large lists, so I avoid that problem. The only time I deal with large lists in excel is if I get combined performance/tracking reports. I have been working with our reporting expert though, to comine that data, so it does not take up 65,000 rows (which I think is the max)
What are you looking at that is over that limit?
IMO, you’re going to want the command line for those larger files. Something like this would clean your file:
sort duplicateKeywords.csv | uniq -u > uniqueKeywords.csv
I just run a pivot report for smaller files, but that requires working w/ two columns in Excel.
Your_store, that is SOOOO over my head.
Are you going to be in Vegas? I am thinking nickel slots with the old ladies again.
Swee-eet!
Hi werty,
Thanks very much for the wrap, I’ve had over 100 hits from your link to date
And I’m now a frequent vistor to your site as well – good stuff 🙂
Cheers
Dave
The Duplicate Master Macro Rocks ! Thanks for promoting the link Werty –
Regards, Ron
I was dyingly looking for this and i got it from you. But as i have EXCEL 2007, it HANGS the excel.
do you have any new release for 2007??
If you reply, pls send the same to my email id too.
regards
Ravi
see this site for the duplicate master http://xldynamic.com/source/xld.DupMaster.html
Thanks for promoting the link Werty
Hi to all, Is anyone have a copy of duplicate master. I cannot find the link . Can anyone please provide a copy and you can send on my email.
tnx a lot,
brut
When I go to this link ‘http://xldynamic.com/source/xld.DupMaster.html’ and click on ‘download’ and get this error 404 – File or directory not found. Any update?
I need this program badly, I have a large list in excel and it’s very slow, but your link not working.