Welcome to WebmasterWorld Guest from 18.104.22.168
Forum Moderators: open
My local highbandwidth loop to the net was offline for a few days so I put the above on line and tweaked it a bit....
tracks 10k words - max refresh to any engine, 19seconds (slow but accurate, steady, and sever bandwidth respectable - done right). 650(?) word stop word list used. 7 engine sources - 2 killer back doors to raw search engine search log files (highly classified - don't even think about asking for the urls or the program .
Counters reset this morning. phrases turned off for now - I need to see how much bandwidth this thing is going to pull first.
try it and you'll understand...
thanks for the thought, please don't pass around the url - I don't know if it will last due to not knowing how much bandwidth it will use...
Are you planning to write the output to a file? It would be nice to accumulate a couple of hundred "snapshots" and see which words are "constants" and also to merge all the individual snapshot files to come up with a total picture.
btw: there is a builtin refresh to poll each engine. When you load the page it checks to see if a refresh poll is needed. So, sometimes the refresh will seem faster than others. Just depends on how many engines are due for refreshing, and how many people are using it.
It walks through each engine sequentially and different time scales (one engine is 10seconds refresh, a few 15, a few 20, and a couple slow ones are 45). That all makes for a very good cross mix of keywords. From what I've seen over the last few months of usage, it is more accurate than a couple others on the net.
Also, don't get s-ucked in by some of the query spam words like "sitescope". It is not that popular - they are spamming the queries. Another one is "australia". Some aussie program has a builtin pull of "australia" from two engines.
Remember, this is a 100% free usage at this point. Other sites charge $10 a month for such service
"Either this man died happy, or this spoon was the murder weapon.
Look at all those smiley faces" -Phil Hartman.
SiteScope - upon further investigation, one of the search engines is using the sitescope software to monitor their server. One test they do is to check a search for "sitescope test", so it shows up all the time in the metalogs. I think I will add it to the stop words list.
Thinking about a snapshot option rc.
The "Previous Day's Top 250" output as a static file would eliminate your bandwidth concern, and we could still page through them.
"London" has been on there every time, I expect it's being plugged, just like "Australia." "Florida," and "California" come and go and that seems about normal.