Googlebot acting funny/mysite making googlebot act funny ;)

[Matt Pearson]

Hi all,

I've recently started submitting a site to search engines and doing the usual link exchanges etc...

Its been spidered by the googlebot 3 times in the last week, but each time it just searched for robots.html and HTTP 1.0, it didn't even spider my index.html.

Is this normal? will googlebot be back to spider my site? or has it found something so objectionable that it doesn't want anything to do with it.

the site is in part a portfolio for my Director/Flash work, and therefore has a lot of supporting Javascript, but there's nothing really complex on the index page, just a couple of rollovers.

Thanks for any help.

Matt

[Brett_Tabke]

Welcome. It will come back for the rest of the site. It just grabs robots.txt and adds it to it's db of robots.txt's for later analysis. It's just a page grabber.

[currybet]

Brett's right, don't worry. I had a site I submitted on about Jan 3rd - within a day googlebot came and had a little look. it came back again the next day and had another little look, and the homepage started appearing in the results. its not a big site (yet), but in two weeks googlebot has now been around over 100 times and nearly the whole site is in the index.