Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

No indexing

Not even a single page!

11:08 am on Sep 9, 2003 (gmt 0)

Full Member

10+ Year Member

joined:May 8, 2003
votes: 0

My site ( 5 weeks old) has been completely indexed by google. All the pages i mean, it is dynamic , msn has about 8-10 pages indexed. however ATW has not indexed evena single page. My Pagerank is 5 ,plenty of sites (popular ones too)link to me. in fact a search for my site shows 4-5 sites having links to my site. but not a single page has been indexed.

Whats the problem , does it take this long or m i forced to go for paidlisting?

1:28 pm on Sept 9, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 24, 2002
votes: 0

How long does it take for my site to be indexed?

The period of time between you submit your site and it is indexed in our catalog will vary with a number of factors like number of pages on your site, whether the site has already been visited recently, etc. Normally your site would be indexed within a couple of weeks.

If you want to guarantee that your page gets included in AlltheWeb, visit our site submit program offered by Lycos.
Webmasters' FAQ at AlltheWeb.com [alltheweb.com]
1:04 am on Sept 10, 2003 (gmt 0)

New User

10+ Year Member

joined:June 11, 2003
votes: 0

My website has been around 3-4 months now, ranks well in Google, Ink, etc. But AllTheWeb refuses to spider my site.

It's been to my robots.txt file 4 times, July 28, Aug 5, Aug 18, and Sep 4, but has never grabbed anything else. The robots.txt is trivial: blocks a few unimportant directories, has been validated by that robots.txt validator, and hasn't changed the whole time.

I have 142 backlinks on ATW, 31 pages contain the term 'domain.com', but all I get is one 42 byte 'file':
Description: Blue widgets

What's up with that?


1:18 am on Sept 10, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:July 18, 2003
votes: 0

I also have a site that is about 4 months old. It is indexed well in google and all the web? only has my index page listed.
What is really strange to me is that my index page and 4 others are listed in the web results on lycos. I am sure these 4 other listing came from all the web and what is strange is that the 4 listings that appear in lycos have no description and date tags that say Dec 31, 1969. This website is only 4 months old and those 4 pages in question are all original content recently written.
I saw there bot come by recently though so i would guess it will get worked out soon.
5:49 am on Sept 10, 2003 (gmt 0)

Moderator from DK 

WebmasterWorld Administrator 10+ Year Member

joined:Oct 23, 2000
votes: 10

Give it time, use PFI or contact Fast/Ov if you feel there's a problem.
2:33 am on Sept 18, 2003 (gmt 0)

New User

10+ Year Member

joined:Sept 18, 2003
votes: 0

My site got the same problem.
My site's PR is 7 and only get the index page spidered.