Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

Deduping huge keyword lists - Clean software?



7:16 pm on Nov 28, 2007 (gmt 0)

10+ Year Member

Can anyone recommend some software that isn't filled with nasties, that can de-dupe keyword lists please?


7:21 pm on Nov 28, 2007 (gmt 0)

10+ Year Member

You can use a pivot chart in Excel, as long as you're not worried about filtering out permutations, ie it won't filter "blue widgets" and "widgets blue".


9:12 pm on Nov 28, 2007 (gmt 0)

10+ Year Member

oooh - that does sorta suck

anything else guys?


4:48 pm on Nov 30, 2007 (gmt 0)

5+ Year Member

google's traffic estimator will remove redundancy

but I think it has a limit on the number of phrases per use


6:35 pm on Dec 3, 2007 (gmt 0)

5+ Year Member

You can create a database with a unique key on the keyword and then insert your data, any duplicates will not be inserted.

Without sql you could write a quick php script that uses the keywords as the keys of an array, this will stop duplications and you can get the de-duplicated keywords back with array_keys. There are also more specific array functions like array_unique.

There are probably a few pieces of software about for it too, but its a very simple job with a bit of scripting.


10:49 am on Dec 4, 2007 (gmt 0)

10+ Year Member

Excel 2007 has a tool to remove duplicates. Not sure how it processes blue widgets & widgets blue. I guess you can test it & see if this suits your requirement.


4:16 pm on Jan 8, 2008 (gmt 0)

10+ Year Member

If you're a coder you can do it yourself with Perl (or PHP) by creating a hash/array, use each keyword as the key, then print out all the keys.

Featured Threads

Hot Threads This Week

Hot Threads This Month