Forum Moderators: open
I can see that Yahoo is visiting my site, but only my home page is getting listed.
How do I recognize that a robot crawled my entire site? I get multiple visits from multiple ip addresses with one hit per visitor, all within a close range. Is that how it should look? Or should it rather be a single visit with multiple hits?
Getting multiple hits from multiple IP addresses is normal. You will see it sometimes come from just one and others times two. The robots are not connected together, so they don't know they are spidering the same site and the time. To get Yahoo and other search engine robots to visit your web site more you should get more backlinks from web sites that they often visit.
same here, my site has been listed for keywords on the index page for about a month now but the rest of the site isn't spidered by yahoo.
Just a thought but when crosslinking on topic within the site, do hrefs with the full path url give the spider the impression that that it is an external link?
Sorry if this is being stupid but i'm reading and learning very fast...
all help appreciated :)
Thanks
G