robots.txt on google

how long for google to come back

[darex]

We put up a robots.txt with a disallow in it by accident.

It was deleted 2 weeks ago (but no new robots.txt was put up - do you need to put up a new one?)

There is still no sign of the site being fully back in google google - (only page urls are in google and even these are not in www2.google.com and www3.google.com)

can anyone help

[Macro]

If you have even one inward link from a page that Google does visit regularly, G WILL find you. Relax :-)

[AjiNIMC]

If you have good links to your sites, it will come back sooner, for me it just look took three days. I was lucky as I had around a 100 links

Aji

[satanclaus]

Could be days could be weeks but it'll be back. I've done that before.(never on accident though ;))

[pageoneresults]

If it were me, I'd put the robots.txt file back in place and Disallow: only those directories and/or pages that need not be spidered. It is good design to have a robots.txt file in place. It minimizes all of those 404s you'd get without one.

[superscript]

If in doubt - don't use a robots.txt!

[pageoneresults]

If in doubt - don't use a robots.txt!

Hehehe, if in doubt just allow us to assist you in setting up a correct robots.txt file. I'll reiterate, it is always good practice to have a robots.txt file in place.

The goal is to appease the bots. Google has bots that look specifically for robots.txt files. I feel that if they are not there, it may cause some delay in getting indexed. I'm just using common sense here, I have no hard facts since I've been using robots.txt for years now.

Think about it, you are providing the bot with initial instructions on how to handle spidering of the site.

[satanclaus]

don't use a robots.txt file?

[google.com...]

I think you should reconsider that statement.

[superscript]

Santa,

The syntax of robots.txt is designed to exclude rather than allow.

pageoneresults,

I'm in no doubt how to set one up.