Forum Moderators: open
I know it sounds a bit supersticious. But if it ads $1 everyday to your every Adsense website, whats the problem man! :)
Just put a blank TXT file there. That also means to crawler that it can crawl any page.
You could just as easily say that it may have a negative impact on your site because it makes the search engines work harder?!
Also, seeing as Mansi_Khan is having problems - I think it's worth taking it out (if he doesn't want to restrict the indexing of his site in any way).
Personally, you're better off hiring a designer straight off, it'll be faster, save time and mistakes that'll cost you dearly. It's not expensive and most web designers will submit you to the key engines and should do the robot thing for you as standard and as part of any fee. That's if they are good! Some designers are really naff, so you got to shop about!
I have the robot txt and last month got 30'000 pages spidered by Googlebot - no problem. So it DOES matter.
Forget all this 'build it and they will come' - it's #*$! mate. It's takes good web design, some cash, a press release and the right niche to 'make it'. Although it's never quite that straight forward as many on here want to make out hehe.
One way links are vital, but you only need about 100 of those and it's best to seek the directory ones first - as SE's love directories for some reason, and it's easier to get the one way links from them......
Don't ever pay for advertising though, until - you know if the site will work. You'll end up blowing tons of cash for something people don't want.
BTW, 'launching a site' doesn't mean putting it 'live' on the web. It means sending out a news release to the media - and that's inexpensive as well (if you know what you're doing). There's lot's of good advice on here, unfortunately it's mixed in with the bad stuff too - which doesn't help you, but it's faster than crawling the web for, so stick around here.
Get your site listed at Dmoz.org, it will appear in Google within 7 days of the Dmoz listing appearing. It will also appear in MSN, Yahoo & Ask about the same time.
I have the robot txt and last month got 30'000 pages spidered by Googlebot - no problem. So it DOES matter.
Sorry I disagree. I don't see anywhere in this thread that Mansi_Khan has said he/she wants to restrict the spiders from indexing certain parts of his/her site.
By default, search engines will "Index and follow" so why would Mansi_Khan need another file telling them the same thing (and at the same time increasing the chances of making a mistake)?
Mansi_Khan, you also have the option of adding the following within your <head></head> tags:
<META NAME="robots" CONTENT="index,follow">
Going back to your original question, just spend time creating more content and try getting a couple of inbound links per day.
While you're waiting, read through as many threads as you can at webmasterworld (best advice ever!)
