Google spiders

How do you know when the have crawled?

[enner100]

Is there a way of telling when the Google spiders have crawled your website?

[pmkpmk]

Hi enner, welcome to WebmasterWorld!

For a professional webmaster it is vital to have access to your sites logfiles. If you don't have it - GET IT!

In the logfiles, look for the string "googlebot" :-)

[enner100]

A web designer done my website. Although I do understand the basics of web design and HTML. I am able to FTP into my wesbite and also log into my domain host. How do I get my log files?

[pmkpmk]

Your website has to be hosted somewhere. Find out who does this for you. Contact their tech-support and tell them you need the logfiles.

[enner100]

Thank you

[caveman]

Normally we'd move a thread like this to Google News, i.e., because the question is Google-specific. However, we'll leave it here because the question really applies to all major SE's.

Reviewing your log files on at least a semi regular basis is one of the more important things a Webmaster can do IMO - it opens one's eyes to how people are actually finding a site, as opposed to how one might be thinking or assuming people are finding the site.

Not only are there often some surprises, but this process helps one find opportunities for site expansion, sometimes into unexpected channels.