Forum Moderators: open

Message Too Old, No Replies

Google crawler

google crawler

         

mohan

7:53 pm on Aug 15, 2002 (gmt 0)



Hi,

My site is a new site and I added my URL to google to index. Then after two days I saw that google crawler visited the site. It happened more than 3 or four times in two days. The host was something like crawl1.google.com or something similar...

But when I search google even with my website name, it doesn't return any results. What is the reason for this? Does this mean is there a problem with my site? I am not sure what is happening.. Can you any one help me by explaining this?

Thanks
Mohan

Knowles

8:00 pm on Aug 15, 2002 (gmt 0)

10+ Year Member



mohan, welcome to WebmasterWorld!

Google will crawl your site and if you just submitted 2 weeks ago be glad its already happening. Most people wait a couple months and have to get a few links before they finally start getting crawled by google. To address your question google updates roughly once a month. They do how ever make small updates between big updates. If they crawled you and you are not doing anything they consider spammie then you will be ok just wait for the update. Watch this board someone will announce it for sure.

mohan

8:08 pm on Aug 15, 2002 (gmt 0)



What are the practices that are considered spamming? Does anyone know if there any post which explains this?

Thanks
Mohan

Knowles

8:11 pm on Aug 15, 2002 (gmt 0)

10+ Year Member



Try here: Google Knowledge Base [webmasterworld.com] I do beleive Brett wrote this and it is very informative. The only other think I can suggest is to read throught the other 50k+ posts in the Google section.

mhildebr

1:58 am on Aug 18, 2002 (gmt 0)

10+ Year Member



Likewise, I have submitted my website in May and it is still not listed. Is there any way to see if you have been crawled by the googlebot?

Knowles

2:15 am on Aug 18, 2002 (gmt 0)

10+ Year Member



Only by checking your logs. Do you have any incoming links? Listed in Yahoo DMOZ?

mhildebr

2:27 am on Aug 18, 2002 (gmt 0)

10+ Year Member



Yes, I have a link listed on DMOZ. Where can I find the logs?

Knowles

2:36 am on Aug 18, 2002 (gmt 0)

10+ Year Member



You would have to check with your webserver to see how they are stored. Some have a way to look at them online others will make you download them and open them with a program. If you look in the Tracking Forum they have talk about the logs alot there.