How can I weed out the dupes from my keyword list?

[lizzie]

I have a list of 600 keywords and many of them are duplicates.
Does anyone know of a program that will find duplicates in a list
and highlight them or remove them?
I have Textpad and Dreamweaver. It doesn't look like these will do it but I'm not sure.

[tedster]

I use a spreadsheet program like Excel to sort a list alphabetically -- then the dupes stand out for easy removal.
If the keywords are comma separated in a text file, it's easy to rename the file extentension from .txt to .csv and then open that file in a spreadsheet program.

There may be a more elegant way, but this method does do the job.

[Woz]

or, assuming you have a list of keywords only and not associated data, import them into Access (or FileMaker Pro or any other similar database program) with the keyword field set to "Indexing no duplicates". Done!

Onya
Woz

[littleman]

Perlyking, that is cool. I got something along the same lines, but it doesn't do the metatag thing. It is more for weeding out kw dupes from a raw collection.

[lizzie]

Excellent info! I knew I'd get answers here.
I don't know anything about databases and spreadsheets unfortunately, but that webpage will do the trick.

[lizzie]

That webpage is separating my keyword phrases into single words.
Maybe I'm doing something wrong, I don't know.

[theperlyking]

littleman, thanks :) - its a variation of my [url=www.tarbard.co.uk/content/internettools.shtml]other script[/url] where you supply a URL and it downloads the page and generates keywords from that.

Lizzie, sorry it separates on white space. You could try doing a find and replace on your list to replace all spaces with dashes, then run it through then find and replace to put the spaces back.

Or I might have a play and change it..

update: Theres now a "lizzie mode" that should be ok with phrases - (just one small bug..)

[msgraph]

>>I have Textpad and Dreamweaver. It doesn't look like these will do it but I'm not sure.

Hi Lizzie, If you have the latest version of Textpad (not sure if older versions have it) you can remove the duplicates from the sort window.

Open your keywords file

Click Tools on the menu bar

Then select Sort...

Then select the Delete Duplicate Lines check box

That's it! It should remove any duplicate keywords as long as they are listed like..

keyworda
keywordb
keywordc
keywordd
and so on

[lizzie]

Perfect! Thanks!