Welcome to WebmasterWorld Guest from 188.8.131.52
Forum Moderators: open
Looks like it got about 75 pages out of 300 so far.
Apparently Slurp is getting much more aggressive lately in spidering. We have seen some pages from the new site show up in searching, and the site is not even live yet - only about half finished.
For ages, inktomi just regularly visited my site, checked the index page and that was it.
However, on the 3rd or 4th March it went mad and finally crawled around all my sub pages.
Does this mean they are going to include these pages too, even though I only paid for the index page?
Does anyone know how long it might take for the pages to start showing up in the SERPs?