Welcome to WebmasterWorld Guest from 220.127.116.11
Forum Moderators: open
Just wondering, last month AV (Scooter) spidered about 35k pages of one of our sites.. Nothing's shown up yet - does anyone have any idea what their timescales for spidering->inclusion is?
There's a chance I guess that they won't include what they read but seems a little silly to gobble by bandwidth if their not going to?
I do not pay for inclusion and relying on the free crawl.
That being said, I do enjoy the traffic that it sends my way. And so, put up with the once a month pain of their crawl.
I get the [updated in the past 24/48 hours] on pages that AV've spidered that were already in the index.. about 3 pages in all I think ;) ... the 30'000 odd pages they spidered a couple of months ago are not there tho..
.. do pages of yours that are newly spidered show with the "updated.. " messsage, or just updates of pages already in the index?
3 months you recon.. I'll not cry about the bandwidth for a couple more months then ;)
Cheers guys :)
When I first uploaded my site it showed up on AltaVista immediately and showed my site title page, description etc. and people were finding my site because of the keywords I was using in my title, description etc.
Now about a month later all that is gone and if I search for my site as widgets.com the title showing is just widegets.com and the description is what showed when I had my register "coming soon" page uploaded (advertising free web address forwarding etc)...
Any ideas what changed?