Yahoo seems to spider my site a lot and looks to go through it.
Many spiders don't finish.
What is the best way to make it easy for them to spider the site?
Thanks
Dijkgraaf
2:39 am on Feb 8, 2006 (gmt 0)
Quite a few spiders will only index the entry page. There is not a lot you can do about those, except get external links to various pages on your site.
Others will only go a few links deep, for these a good sitemap might help.
caveman
4:20 am on Feb 8, 2006 (gmt 0)
ya, basically the more good stuff you add to the site, and the more IBL's you get, the better the chance that the SE's will start caring enough to show u a little bot love. ;-)
