Welcome to WebmasterWorld Guest from 18.104.22.168 , register , free tools , login , search , pro membership , help , library , announcements , recent posts , open posts Become a Pro Member
All the Web dropped all my pages except index page from 27 pages indexed to 1 yowza msg:221086 8:15 pm on Dec 12, 2003 (gmt 0) How could this happen?
I have a site that has all 27 pages indexed in all the major search engines. All pages were indexed in All the Web until recently.
The site is a PR 6 in Google and All the Web finds 35 backlinks for the site.
Why would they drop all but my index page?
ronin msg:221087 3:28 pm on Jan 10, 2004 (gmt 0)
That's curious... it seems to have dropped my entire domain... (previously almost every page was indexed...)
Is FAST re-indexing?
Rumbas msg:221088 11:23 pm on Jan 10, 2004 (gmt 0)
Guys, there can be a lot of reasons that the fast bots couldn't index your site, or had some problems for a short time trying to crawl your sites (down times etc.). If everything is swell, it should be back pretty quickly a re-index.
Hard to say for sure what happend, but with all the stuff going on concerning Yahoo, I'd wait it out for a week or two and see if things dont fix themselves. If not, contact the guys at Fast. They're pretty good at responding to requests and have been know to help out..
If everything else fails, flip out your flexible friend and go pfi ;)
mars9820 msg:221089 6:33 am on Jan 16, 2004 (gmt 0)
I had the same problem.
I changed my relative URL's into hard coded URL's and the problem is solved.
I went down from 150 pages to 1 and now everything is coming back step by step as I see Fast crawling my whole site again. :)
Rumbas msg:221090 2:23 pm on Jan 16, 2004 (gmt 0)
That's good to know mars. Nice you found the problem and got it solved.
Fast should be able to crawl relative url's tho - if they're set up correcly.
mars9820 msg:221091 12:57 pm on Jan 17, 2004 (gmt 0)
I totally agree that Fast should be able to do this.
Google had no problem to index my whole page.
However I think it is better to use hardcoded URL's to avoid duplication of pages.
For example www.widget.com and widget.com
with relative URL's your whole page will be crawled 2 times and all your pages will end up with duplicates. (at least that happened to me long time ago with Googlebot)