Forum Moderators: open

Message Too Old, No Replies

spiders not spidering whole domain

(see subject)

         

kirigoe

8:20 pm on Jul 27, 2003 (gmt 0)

10+ Year Member



hi,

i've been submitting to as many free searchengines as i can find, what worries me is that in my web statistics, most robots only generate one pagehit. i'm getting a little worried that for some odd reason they're not getting past my "splash screen" and the spider stops there. google and wisenut bots especially do this.

is this a general behavior of spiders?

best regards,
daniel netz

[edited by: agerhart at 7:21 pm (utc) on July 28, 2003]
[edit reason] removed URL [/edit]

2oddSox

9:05 pm on Jul 27, 2003 (gmt 0)

10+ Year Member



Hi Kirigoe,

Welcome to WW. You may have to remove references to your website I'm afraid. I think a Mod will be along very soon... :)

I can't offer much in the way of your problem, but I just wanted to say you have some pretty good photo's on your site.

Good luck with the venture.

2odd...

kirigoe

9:08 pm on Jul 27, 2003 (gmt 0)

10+ Year Member



i was wondering if that was ok, but i really didn't post it here to get free hits. and if i don't post it, how will you know what might be wrong with it?

if a mod does come along, please give an answer for how i can get help without posting any links, if that is against policy.

thanks!

kirigoe

7:20 pm on Jul 28, 2003 (gmt 0)

10+ Year Member



i've figured out why this is. last night i installed googlestats to better see what googlebot was up to. and it seems one googlebot instance only spiders one page, and then another instance spiders the next page. that's why it only showed one pagehit per googlebot ip.

[edited by: agerhart at 7:22 pm (utc) on July 28, 2003]
[edit reason] removed URL (please read TOS) [/edit]