Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

No indexing

Not even a single page!



11:08 am on Sep 9, 2003 (gmt 0)

10+ Year Member

My site ( 5 weeks old) has been completely indexed by google. All the pages i mean, it is dynamic , msn has about 8-10 pages indexed. however ATW has not indexed evena single page. My Pagerank is 5 ,plenty of sites (popular ones too)link to me. in fact a search for my site shows 4-5 sites having links to my site. but not a single page has been indexed.

Whats the problem , does it take this long or m i forced to go for paidlisting?


1:28 pm on Sep 9, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

How long does it take for my site to be indexed?

The period of time between you submit your site and it is indexed in our catalog will vary with a number of factors like number of pages on your site, whether the site has already been visited recently, etc. Normally your site would be indexed within a couple of weeks.

If you want to guarantee that your page gets included in AlltheWeb, visit our site submit program offered by Lycos.
Webmasters' FAQ at AlltheWeb.com [alltheweb.com]


1:04 am on Sep 10, 2003 (gmt 0)

10+ Year Member

My website has been around 3-4 months now, ranks well in Google, Ink, etc. But AllTheWeb refuses to spider my site.

It's been to my robots.txt file 4 times, July 28, Aug 5, Aug 18, and Sep 4, but has never grabbed anything else. The robots.txt is trivial: blocks a few unimportant directories, has been validated by that robots.txt validator, and hasn't changed the whole time.

I have 142 backlinks on ATW, 31 pages contain the term 'domain.com', but all I get is one 42 byte 'file':
Description: Blue widgets

What's up with that?



1:18 am on Sep 10, 2003 (gmt 0)

10+ Year Member

I also have a site that is about 4 months old. It is indexed well in google and all the web? only has my index page listed.
What is really strange to me is that my index page and 4 others are listed in the web results on lycos. I am sure these 4 other listing came from all the web and what is strange is that the 4 listings that appear in lycos have no description and date tags that say Dec 31, 1969. This website is only 4 months old and those 4 pages in question are all original content recently written.
I saw there bot come by recently though so i would guess it will get worked out soon.


5:49 am on Sep 10, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member

Give it time, use PFI or contact Fast/Ov if you feel there's a problem.


2:33 am on Sep 18, 2003 (gmt 0)

10+ Year Member

My site got the same problem.
My site's PR is 7 and only get the index page spidered.

Featured Threads

Hot Threads This Week

Hot Threads This Month