Forum Moderators: DixonJones

Message Too Old, No Replies

Google make strange things

Google is looking for pages which doesn' exist

         

Maleville

11:09 pm on Mar 15, 2004 (gmt 0)

10+ Year Member



Hello.

For several mounths, google (?) is looking for pages html inside my folder "myfolder1", and only this folder, with its proper IP :

IP: 64.68.82.33
Searching for URL: /myfolder1/64.68.82.55
User agent: Googlebot/2.1 (+http://www.googlebot.com/bot.html)
Domain: crawler11.googlebot.com

every fifteen days with:
64.68.82.142 - /myfolder1/64.68.82.137 - crawler13.googlebot.com
64.68.82.176 - /myfolder1/64.68.82.176 - crawler14.googlebot.com

...and so on.

And also:
IP: 64.68.82.79
Searching for URL: /gi, (means cgi?)
User agent: Googlebot/2.1 (+http://www.googlebot.com/bot.html)
Domain: crawler12.googlebot.com

IPs seem to be Google. But why it is searching:
/myfolder1/64.68.82.137 - instead of /myfolder1/mypage.html

What does it mean?

GlynMusica

4:37 pm on Mar 16, 2004 (gmt 0)

10+ Year Member



Not sure on your specific problem but I do know that Google will request default pages found on a server even if the page has not been linked to from the site.

For example

Let's say you have the following setup.

www.domain.com/services/computer-services.html

And there is not index,html , default.html, home.html or any default page as defined by the server. I've seen Googlebot consistently come back and try and request the page

www.domain.com/services/index.html

even though the page does not exist.

It's just a weirdness of the engine.

Hope this helps.
Glyn.

Maleville

7:06 am on Mar 17, 2004 (gmt 0)

10+ Year Member



but, I have an index.htm page : /myfolder/index.htm