homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Yahoo / Deprecated - Altavista, Alltheweb.com
Forum Library, Charter, Moderator: open

Deprecated - Altavista, Alltheweb.com Forum

All pages spidered by FAST except main/index page. Why?

 5:40 pm on Dec 17, 2002 (gmt 0)

I got a popular site that rank number 4th with google. I expect it to rank well with alltheweb too but it didn't. I do a search on alltheweb on my site and found that most of the pages are spidered (more than 40) and is in the database EXCEPT my main page! All my pages has a link to the main page (home) and so I see no reason why the inteligent spider can't see it. And I also have lots of inbound links to my site. When I search the exact title of my site (which will definitely unique) I see my site appears in many of other sites linking to my main page, but where is my main page in alltheweb database?

Any comment on how to make it index my main page?

[edited by: Rumbas at 6:06 pm (utc) on Dec. 17, 2002]
[edit reason] No specifics please - thanks! [/edit]



 6:11 pm on Dec 17, 2002 (gmt 0)

Hi jamesyap - Welcome to WebmasterWorld. Don't forget to read paynt's excellant Welcome Thread [webmasterworld.com] :)

Now on to your question:

FAST has indexed all your pages, but you can't seem to find your index page, right?

It does sound a bit odd. Have you tried checking if the default file (index.html, home, dafault etc.) is there?
Sometimes when you just check domain.com, it doesn't show. It should be there as FAST has probably found your other pages from the index page and, as you say, you have links to the index page from all the others.


 9:55 pm on Dec 17, 2002 (gmt 0)

hi james,

i had the same problem with our site. the only thing which helped was an email to fast. i believe they reinstated the page manually.

although i did not get a reason why it was dropped, the response was very quick. they have great customer service.

btw this was for a page using insite select - so must have been some sort of computer glitch.


 2:52 am on Dec 18, 2002 (gmt 0)

My site is none comercial. Is not submited via inside select (no money, hehe). And it has been out there for a few years and is fair enough to be included with fast. I have great knowledge on Google but I really doesn't know much on Fast.

I actually check the database by typing "url.all:http://www.alwiz.com" in the search and 26 results return but none is my index file. :( Any more idea which can help me? I have resubmit the main side again yesterdat.

I was thinking on submitting my side through side select. Questions :
1. Does side select crawl only one single URL or it will crawl anything below the domain?
2. 2nd URL is cheaper, must I submit them together with the 1st or I can submit them few months later?


 8:14 am on Dec 18, 2002 (gmt 0)

>1. Does side select crawl only one single URL or it will crawl anything below the domain?

It crawls all the pages you pay for. If you pay for only the index page, then only the index page will be crawled.

>2. 2nd URL is cheaper, must I submit them together

No, you can wait and add more pages later. You will get additional pages for the cheaper rates.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Yahoo / Deprecated - Altavista, Alltheweb.com
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved