Forum Moderators: open

Message Too Old, No Replies

Help with server logs

What does this mean?

         

le_gber

11:51 am on Mar 25, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hi I'm new with server logs and I found this amongst other logs

216.239.46.140 - - [19/Mar/2003:04:34:55 +0000] "GET /robots.txt HTTP/1.0" 404 645 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
216.239.46.140 - - [19/Mar/2003:04:34:56 +0000] "GET / HTTP/1.0" 200 17147 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

What does it mean?
It's the only two logs with googlebot in it (logs started 13/04)! should I worry for the next update?

Cheers

leo

Receptional Andy

11:58 am on Mar 25, 2003 (gmt 0)



Google went to your site and requested robots.txt (which didn't exist - 404)
And then requested you home page / (success - 200)

Looks to me like Googlebot is making one of its first visits to your site, in which case it should be back and indexing more heavily. It followed a link from another site to reach yours. If you have a low PR, this might be why it only requested the home page.

le_gber

12:02 pm on Mar 25, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I've already been indexed on google, for a couple of months now.
During the last update google only indexed 3 of my pages though. (site is html only with 20~25 pages)

Anybody knows why?
I read on another thead that during the last update some indexing may have gone wrong

Receptional Andy

12:15 pm on Mar 25, 2003 (gmt 0)



Run your pages through a search engine spider simulator (search google for one) to make sure spiders can follow links easily.

Have you checked your PR with the google toolbar?

le_gber

12:28 pm on Mar 25, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



make sure spiders can follow links easily

yep works fine

Have you checked your PR with the google toolbar?

Yes PR0 for the moment (expecting to get better one after next update 'cause site design and content changed completely after last update.

Also write a review for a PR8 site and got a link from their site to mine yesterday.(the page where the link is, is PR6)
Do u know if it's going to be indexed during the next update?

leo

Receptional Andy

12:33 pm on Mar 25, 2003 (gmt 0)



>>PR0 for the moment

Have you been higher than this at any time? This is the most likely cause of your problem.

The link you just got from the PR8 won't be indexed and added to PR counts for some time. It won't even be indexed by the main googlebot until around the beginning of April, although freshbot will follow this link before then.

le_gber

12:58 pm on Mar 25, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Have you been higher than this at any time

don't know downloaded googlebar yesterday ;)

The new site design and content hasn't yet been cached in google.

The link from PR8 will last ~3 months but I intend to write other reviews for them.

Leo