Forum Moderators: DixonJones
For several mounths, google (?) is looking for pages html inside my folder "myfolder1", and only this folder, with its proper IP :
IP: 64.68.82.33
Searching for URL: /myfolder1/64.68.82.55
User agent: Googlebot/2.1 (+http://www.googlebot.com/bot.html)
Domain: crawler11.googlebot.com
every fifteen days with:
64.68.82.142 - /myfolder1/64.68.82.137 - crawler13.googlebot.com
64.68.82.176 - /myfolder1/64.68.82.176 - crawler14.googlebot.com
...and so on.
And also:
IP: 64.68.82.79
Searching for URL: /gi, (means cgi?)
User agent: Googlebot/2.1 (+http://www.googlebot.com/bot.html)
Domain: crawler12.googlebot.com
IPs seem to be Google. But why it is searching:
/myfolder1/64.68.82.137 - instead of /myfolder1/mypage.html
What does it mean?
For example
Let's say you have the following setup.
www.domain.com/services/computer-services.html
And there is not index,html , default.html, home.html or any default page as defined by the server. I've seen Googlebot consistently come back and try and request the page
www.domain.com/services/index.html
even though the page does not exist.
It's just a weirdness of the engine.
Hope this helps.
Glyn.