Welcome to WebmasterWorld Guest from 54.167.83.224

Forum Moderators: open

Message Too Old, No Replies

Deduping huge keyword lists - Clean software?

     
7:16 pm on Nov 28, 2007 (gmt 0)

Junior Member

10+ Year Member

joined:June 12, 2005
posts: 45
votes: 0


Can anyone recommend some software that isn't filled with nasties, that can de-dupe keyword lists please?
7:21 pm on Nov 28, 2007 (gmt 0)

Preferred Member

10+ Year Member

joined:Oct 19, 2001
posts:455
votes: 0


You can use a pivot chart in Excel, as long as you're not worried about filtering out permutations, ie it won't filter "blue widgets" and "widgets blue".
9:12 pm on Nov 28, 2007 (gmt 0)

Junior Member

10+ Year Member

joined:June 12, 2005
posts: 45
votes: 0


oooh - that does sorta suck

anything else guys?

4:48 pm on Nov 30, 2007 (gmt 0)

Junior Member

5+ Year Member

joined:Feb 11, 2007
posts: 78
votes: 0


google's traffic estimator will remove redundancy

but I think it has a limit on the number of phrases per use

6:35 pm on Dec 3, 2007 (gmt 0)

Preferred Member

5+ Year Member

joined:July 13, 2006
posts:500
votes: 0


You can create a database with a unique key on the keyword and then insert your data, any duplicates will not be inserted.

Without sql you could write a quick php script that uses the keywords as the keys of an array, this will stop duplications and you can get the de-duplicated keywords back with array_keys. There are also more specific array functions like array_unique.

There are probably a few pieces of software about for it too, but its a very simple job with a bit of scripting.

10:49 am on Dec 4, 2007 (gmt 0)

Junior Member

10+ Year Member

joined:Aug 15, 2005
posts:85
votes: 0


Excel 2007 has a tool to remove duplicates. Not sure how it processes blue widgets & widgets blue. I guess you can test it & see if this suits your requirement.
4:16 pm on Jan 8, 2008 (gmt 0)

Junior Member

10+ Year Member

joined:Sept 12, 2005
posts:70
votes: 0


If you're a coder you can do it yourself with Perl (or PHP) by creating a hash/array, use each keyword as the key, then print out all the keys.