Only the index & robots.txt

Forum Moderators: open

Message Too Old, No Replies

Only the index & robots.txt

won't follow links...

Chico_Loco

9:47 pm on Mar 31, 2004 (gmt 0)

Yahoo is requesting my robots.txt and / only.

The site has hundreds of inboud links so it should - page is spider friendly.

Any ideas?

MarkHutch

9:54 pm on Mar 31, 2004 (gmt 0)

Looks like you have a penalty, just like many of the rest of us.

Chico_Loco

10:02 pm on Mar 31, 2004 (gmt 0)

So you're telling me that when i get a penalty with yahoo it will request my /index & robots.txt 40 times a day yet go no further? - Interesting.

MarkHutch

10:22 pm on Mar 31, 2004 (gmt 0)

Yes, that's right.

mayor

11:42 pm on Mar 31, 2004 (gmt 0)

If slurp visits your index page I don't think you're banned. I think you're not well indexed yet. Wait a while (and maybe that's a long while, sorry).

When slurp only visits your robots.txt file is when you're probably banned.

VigoZ

12:20 am on Apr 29, 2004 (gmt 0)

yahoo visiting my index and robots too for about 25 days.. but never goo deeply.. i have more than 200 000 pages and good pr on google, 2 weeks ago i've payd for a directory submission but slurp don't go deeply to index my website..! i don't know what do.. just wait? i'm going crazy waiting!

someone have the same problem( yahoo index only robots and index? ) and someone after long long time have some good news?

jackson992

8:36 am on Apr 29, 2004 (gmt 0)

so why is it even bothering to come to the index page? Ane why were we banned?

2_much

9:25 pm on Apr 29, 2004 (gmt 0)

Tim mentioned this in one of the conferences, it's a way to know that you have a penalty.

Why they keep coming back, I don't know. The key is that it allows you to know something's going on.

What I would suggest doing, is a thorough test of your site to try and find out what might've tripped the spam filter. Then write to Yahoo and ask them to consider re-inclusion.

walkman

3:32 am on Apr 30, 2004 (gmt 0)

penalty. They keep comign back because they (probably) follow the links from other sites. Welcome to the club!

Chico_Loco

4:01 am on Apr 30, 2004 (gmt 0)

2_Much,

What email address should be used to email them about re-inclusion.

I'm not too bothered though - 20 of my pages are indexed in Yahoo, but the 800+ others aren't. Google has most of them though and I am a PR7 there.

There is no spam on my site - nothing at all. But let me have that email :)