Forum Moderators: open

Message Too Old, No Replies

domain home page disappeared (even using insite select)

why have we disappeared from the results

         

jamie

12:50 pm on Jul 24, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



hi,

i have been an avid reader of ww forums for ages, and have now taken the plunge and registered (gosh!! ;-)

our site has been ranked at #4 for our chosen keyword in alltheweb/lycos for ages, until 3 weeks ago, when it disappeared from site.

we use insite select, so i checked in to our account, and it said there had been a fetch error, whatever that is, two days later this fetch error disappeared and i expected our site to reappear again.... but no joy.

many of our subpages rank v. well in all the web, and our home page is #1 in google, #2 in teoma and altavista for the chosen keyword, but we still remain out of site in alltheweb. (i stopped counting after #200 ;-)

my question is how can a site be dropped like that after being a consistent #4 for months? the insite select respiders every 48 hours, and between the time we were at #4 and the time we were dropped, we had made no changes at all to the home page (which continues to rank v.well in other engines), so it appears we have been dropped for a reason.

i have sent 4 mails to lycos and 1 to all the web, but with no answer
we have a unique IP and no dodgy cloaking/ spamming techniques
we run a family friendly travel guide

if anyone could shed some light, we would be eternally grateful

many thanks

Dinkar

6:01 pm on Jul 24, 2002 (gmt 0)

10+ Year Member



Homepage of my site is also missing from allthewb. All other pages are in their db. I am not using paid service. I guess they have some problem with fetching [oursite.com...]

I think this problem can be solve if we submit [oursite.com...]

What do you think?

jamie

6:51 pm on Jul 24, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



glad i'm not alone!

don't know about that. our site was in there correctly for mysite.com/ and the next day disappeared.

i recently added two more pages to the insite select system and received a message that all 3 (in total i have 3 paid submits) will be live in the database as of 26.07 - maybe they had cancelled by old insite select (it hadn't run out) and are now putting all three urls in at the same time

pontifex

9:47 pm on Jul 24, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



hi jamie,

welcome to webmasterworld as an active member ;-)

I am still waiting to get listed anyhow. Abrexa_UK has some age old pages in there, too. Fast is acting strange ...

jamie

4:18 pm on Jul 25, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



yesssss!

an answer from the task team at alltheweb who have promised to investigate, as they are pretty sure the site hasn't been penalised.

THANK YOU alltheweb.

will keep you all informed

Dinkar

9:29 pm on Jul 26, 2002 (gmt 0)

10+ Year Member



Please inform us.

jdMorgan

9:42 pm on Jul 26, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Jamie,

Yes, please update this thread when the issue is settled.

A "fetch error" sound like your server was down when the spider came by to check on your site.
So, no matter how long you'd been in the index, they thought your site was gone.

Fast is pretty quick about picking up new sites, so you'll probably be re-spidered and indexed
again within two weeks.

Jim

jamie

1:07 pm on Aug 1, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



i posted about a fortnight ago that our home page had been dropped, but 100s of our subpages were still in.

i wrote to fast, who replied within 5 days saying the task team would investigate and that they didn't think i had been penalised.

10 days later we are back in! and at #3 for our keyword (we were always #4).

GREAT CUSTOMER SERVICE fast!

lovely to know there are humans behind all the machinery

heini

8:48 pm on Aug 1, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Good to hear, Jamie - any explanation from the FAST team on what had happened?

dodger

5:47 am on Aug 4, 2002 (gmt 0)

10+ Year Member



I am using Insite Select and my site doesn't appear where it should.
I am well indexed all over the world except on All The Web and Lycos.
Funny part is every now and then my site does appear then literally a few minutes later it disappears again. I tried contacting them but got nowhere.
I have now cancelled all but my main url in Insite and changed the main url to include the /default.asp extension. I hope that helps.
The fault must be with Fast as my site is doing fine elsewhere.

jamie

8:24 am on Aug 5, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



fast did think it might be a bug.

on wednesday last week we were back in (#3 for keyword). thursday back out again. friday back in (#2 for keyword - never been that high!). then saturday back out again??

since then we have stayed out. i think it is either the 'dance' - the time needed by fast to update their complete index (sort of like www2 and www3 at google), in which case we shall be back in within a few days (although it is taking a long time)... or there really is a bug, and after manually adding our site back to the index, it has for whatever reasons been dropped again.

interestingly enough, when our site was back in again for those brief periods, the top 10 was very different to when we are not in - which again leads me to speculate that it is just a matter of time (days) before fast does a big update. anyway, enough meanderings....

fingers crossed ;-) and if nothing has happened by wednesday i shall write back again.

any suggestions or thoughts anyone?

dodger

8:46 am on Aug 5, 2002 (gmt 0)

10+ Year Member



Placing the /default.asp extension to the url seems to have worked - so far. Ensure you place the appropriate extension to your own url not just the one quoted above. [added] this will only work of course if you are in the InsiteSelect program.

jamie

3:04 pm on Aug 18, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



now several weeks into the saga there is positive news to report.

1st of all i did try adding the default extension (in this case index.html) but this didn't make a difference. our site was still out of the index....hmmmpf

so we wrote back to fast, and as of yesterday (4 days later) we are in the index, and hopefully in to stay!

hats off to fast for their customer service!

Dinkar

1:50 pm on Aug 19, 2002 (gmt 0)

10+ Year Member



jamie, are you using www.mysite.com/index.html to link your homepage from other internal pages? If you are not using www.mysite.com/index.html and using only www.mysite.com then that may be the reason. I suggest you to use www.mysite.com/index.html and let us know the result.

jamie

3:12 pm on Aug 19, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



interesting point.

i actually use a relative link index.html or ../index.html and on the bottom of each page a complete url [...com....]

like i say at the moment we are in and looks like we are staying. this is the first time we have had problems like this with a proper crawler based engine, so i don't think the format of the internal links to homepage have a detrimental effect

maybe a fast bug?

Dinkar

4:27 pm on Aug 19, 2002 (gmt 0)

10+ Year Member



Here is what I thought:

If you use relative link using "/" or "../" or absolute link "http://www.mysite.com" or "http://mysite.com" then there will be 0 link to the index.html page. And hence Fast is removing it automatically. Of course, they shouldn't do this .. at least not with the paid URLs.

I guess this is some fast bug.

heini

8:54 pm on Aug 19, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I think this problem is related to something many members have reported repeatedly.
A switching of positions for the home/index page between top ranked and somewhere in the low top20, or a straight vanishing of the face of the earth of the home/index page.
I suspect it is something with the way Fast uses clustering.

Anyhow - Jamie uses both: links to index.html and links to domain, so it does not seem to fit?