homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Marketing and Biz Dev / Keyword Discussion
Forum Library, Charter, Moderator: open

Keyword Discussion Forum


 12:34 pm on May 24, 2000 (gmt 0)

testing...a long term project and testing phase. please don't abuse it. Please keep the refresh around a minute or two (the display is in secs).

My local highbandwidth loop to the net was offline for a few days so I put the above on line and tweaked it a bit....

tracks 10k words - max refresh to any engine, 19seconds (slow but accurate, steady, and sever bandwidth respectable - done right). 650(?) word stop word list used. 7 engine sources - 2 killer back doors to raw search engine search log files (highly classified - don't even think about asking for the urls or the program .

Counters reset this morning. phrases turned off for now - I need to see how much bandwidth this thing is going to pull first.

try it and you'll understand...

thanks for the thought, please don't pass around the url - I don't know if it will last due to not knowing how much bandwidth it will use...



 2:11 pm on May 24, 2000 (gmt 0)

Well, I'm hooked. Absolutely mesmerizing. I picked up 2 or 3 tips just watching a half-dozen refreshes. You say it tracks 10k words... are they in a set list of words to be polled, or do you mean that the cut-off is at 10k?

Are you planning to write the output to a file? It would be nice to accumulate a couple of hundred "snapshots" and see which words are "constants" and also to merge all the individual snapshot files to come up with a total picture.


 3:01 pm on May 24, 2000 (gmt 0)

These are all pulled straight out of the engines. The top 10k are used with spillover into another file. They are remerged by hand and the top 10k is again skimmed off the top. I'll probably do the remerging a couple times a week and keep a daily, weekly, and monthly log of the top 10k words.

btw: there is a builtin refresh to poll each engine. When you load the page it checks to see if a refresh poll is needed. So, sometimes the refresh will seem faster than others. Just depends on how many engines are due for refreshing, and how many people are using it.

It walks through each engine sequentially and different time scales (one engine is 10seconds refresh, a few 15, a few 20, and a couple slow ones are 45). That all makes for a very good cross mix of keywords. From what I've seen over the last few months of usage, it is more accurate than a couple others on the net.


 3:11 pm on May 24, 2000 (gmt 0)

Some things to watch:
10am central time right now and good old "pokemon" is setting way down at 108. We'll see what it is late this afternoon. It will rise, and rise all day long. To me, that is some of the most interesting data, to watch the infotainment words rise as the day goes along and the business words fall.

Also, don't get s-ucked in by some of the query spam words like "sitescope". It is not that popular - they are spamming the queries. Another one is "australia". Some aussie program has a builtin pull of "australia" from two engines.

Remember, this is a 100% free usage at this point. Other sites charge $10 a month for such service

"Either this man died happy, or this spoon was the murder weapon.
Look at all those smiley faces" -Phil Hartman.


 4:11 pm on May 24, 2000 (gmt 0)

I was going to ask about "sitescope" but I figured it was in some games or music category... like "winamp skins."


 5:32 pm on May 24, 2000 (gmt 0)

Your comment about tracking "pokemon" throughout the day is exactly why I was interested in the composite file, say at the end of the week. Viewing at a different time of day will give decidedly different snapshots... for instance, I'll bet you lunch that "city," "county," and "maps" spike between 6pm and 11pm CT.


 10:49 pm on May 24, 2000 (gmt 0)

That is pretty slick. Kudos.


 12:31 am on May 25, 2000 (gmt 0)

Pokemon let me down. Didn't move a lick. Part of it is that many schools here in the midwest finished up yesterday for the summer recess. Mass exodus out onto the driveways and streets instead of at the keyboard.

SiteScope - upon further investigation, one of the search engines is using the sitescope software to monitor their server. One test they do is to check a search for "sitescope test", so it shows up all the time in the metalogs. I think I will add it to the stop words list.

Thinking about a snapshot option rc.


 1:14 am on May 25, 2000 (gmt 0)

Well, "maps" went to top 5 early-on and was there the last time I checked. Geographic, quasi-travel, terms did seem to migrate up the list a bit.

The "Previous Day's Top 250" output as a static file would eliminate your bandwidth concern, and we could still page through them.

"London" has been on there every time, I expect it's being plugged, just like "Australia." "Florida," and "California" come and go and that seems about normal.


 12:59 pm on May 25, 2000 (gmt 0)

I reset the counters last night at midnight. Still have to generate a report for yesterday...


 3:07 pm on May 25, 2000 (gmt 0)

btw: if you just want a quick chart without the refresh, put "off" in the seconds field and press submit. That just generates a quick chart.


 2:38 pm on May 26, 2000 (gmt 0)

The keyword spy will be on/offline today...working on it.


 2:46 pm on May 26, 2000 (gmt 0)

I suggest setting the opening default refresh cycle to "90" or "off" --it takes a few minutes and a couple of slugs of coffee before I am ready to leave the opening screen.


 2:52 pm on May 26, 2000 (gmt 0)

Moved most of it here


 5:09 pm on May 26, 2000 (gmt 0)

Absolutely great! My first impulse was to open today's file for the "live" show, but yesterday's file really has ALL the good stuff.



 5:59 pm on May 26, 2000 (gmt 0)

Well, it is going to take a few weeks to build up the logs. My first instinct was to stock it with a slew of my own logs, but I decided I'll just let the system build them over time.

I'll be working on it some more this afternoon...


 6:50 pm on May 26, 2000 (gmt 0)

If the server is going to be naming the "daily" files when it creates them, I suggest changing the syntax to yyyy-mm-dd.htm instead of mm-dd-yyyy.htm --it will keep your archives in better order over the long haul.


 11:40 pm on Jun 1, 2000 (gmt 0)

Made a few tweaks internally to the live spy. It is about 3 to 5 times faster now. Before it was running 9-15seconds per run, now it is down to 2 to 4.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Marketing and Biz Dev / Keyword Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved