Forum Moderators: open

Message Too Old, No Replies

Building your own keyword databases

Are there any scripts available?

         

fom2001uk

10:48 am on May 2, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I'd like to collect data from the various published keyword searches (AllTheWeb, metacrawlers, etc) in order to build my own database of keyword searches.

Are there any scripts available to collect this information or if not, how easy would it be for a programmer to write a script which routinely collects this info?

I remember reading something about writing scripts for this purpose. I think it was on here, but I can't remember what it was called.

Can anyone help?

brotherhood of LAN

10:55 am on May 4, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Sure fom, I don't know the names of any either though :)

>>>I'd like to collect data from the various published keyword searches

I'm not sure what you mean by "published keyword searches".....but the bottom line is its v.easy to get/make scripts to track word popularity etc.

If you can get your data into tab delimited form you can put it into a DB and no doubt get the info you need from it.

I copied 5000 pages word for word and put it into mySQL, ended up with over a million keywords in a table. Still very fast. IMO don't go for a product, just get the raw data and play with it :)

fom2001uk

3:49 pm on May 5, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Bro of LAN, did you write your own script?

Any pointers to where I should be looking for scripts? It's not something I do often; is there a mega scripts-r-us type website?

Of course when I said "published" sources I was thinking "free" :-)

brotherhood of LAN

4:31 pm on May 5, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



>own script?

Sure, well I have one to count keywords on webpages, I guess with a little tweaking you can automate it to search Overture and the other "term suggestion tools" without picking up their templates.

>>>"published" sources I was thinking "free"

Sure ;) search for "overture term suggestion tool","wordtracker"....I believe e-spotting is quite popular also.

As for your own script to go out mining different places, check out some of the "cut and paste" hangouts like hotscripts.com and go for the scripting language you know best.

If you get keywords from the term suggestion tools, competitors, SERP's and directories I'm sure there's a good balance in there :)