Forum Moderators: phranque

Message Too Old, No Replies

To submit or not?

         

companyone

10:01 pm on Aug 18, 2004 (gmt 0)

10+ Year Member



Hi,

I was wondering if submitting the "robots.txt" URL to my site would help get all my pages indexed faster or would this be considered spam by the serach engines and get my URL banned?

Thanks for your replys in advance.


Dan

jdMorgan

10:49 pm on Aug 18, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Dan,

Don't submit your robots.txt file -- It is not the kind of file they expect, and it won't do any good.

The best way to "submit" is simply to get links from other sites that are currently in the search engine index that point to your site. Their spider will follow those links to your site, and then follow the internal links on your site to find all of your pages, except those disallowed in robots.txt.

If you go to the search engines' "submit your site" pages and enter the URL of your home page, that *may* get the process started, but if your site lacks incoming links then the results will probably be short-lived. So the best approach is to get incoming links to your site from well-ranked and related-topic sites and from major directories, and just let the search engine spiders follow those links to find your site. "Site Submission" as practiced back in the 90's is dead, and you'll note that the Search Engine Submission forum here on WebmasterWorld is now deprecated.

Jim

companyone

1:25 am on Aug 19, 2004 (gmt 0)

10+ Year Member



Hi,

Thanks Jim,

I have links to more than one site with a PR5 or more.

I will just wait.

Dan

chrisnrae

1:28 am on Aug 19, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Try and get some links on pages frequented by google pretty often. Having your link on a page that was last cached 3 months ago won't get you into the index in a speedy manner. Get some good inbounds (and a bit of them, don't depend on a link or two) and they'll find you. Besides, without the links, you won't be able to rank on anything halfway competitive anyway. So focus on gaining inbounds - the spider will come.