homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
Forum Library, Charter, Moderators: martinibuster

Yahoo Search Engine and Directory Forum

Inktomi /Yahoo ignores my most important site, everything else is inde
it gets the robots.txt daily but it's not in the index

Msg#: 1714 posted 6:40 am on Feb 19, 2004 (gmt 0)

On another site it indexed the index page and another one along with a few ancient links. The most important site is not in the db at all.

The robots.txt is valid and I don't think I've done anything to spam, never had any problems. The url are apache re-written and fully indexed by Google.
I had blocked indexing (now it's back on) of the /cgi/ bin but I don't think that should matter since the URL were re-written anyway.

any advice, suggestion?
I just e-mailed to spamcrusader@inktomi.com as someone suggested...



10+ Year Member

Msg#: 1714 posted 6:42 am on Feb 19, 2004 (gmt 0)

This is just a complete guess but you might try using some absolute href's for urls that point deeper into your site. I had had trouble with ink not understainding some relative url's at one time and after I got it past that I got in.


Msg#: 1714 posted 6:45 am on Feb 19, 2004 (gmt 0)

I'll try it even though it sounds strange that with all the work and money they didn't think of that. I guess you never know.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved