Forum Moderators: open

Message Too Old, No Replies

Yahoo crawler still not fixed....

Yahoo_Mike still around overhere?

         

DoppyNL

12:29 pm on Apr 12, 2005 (gmt 0)

10+ Year Member



See this thread for `tha problem`:
[webmasterworld.com...]

Now, this bug is around for ages now and Yahoo knows about this problem.
Then why hasn't this been fixed?

Since I wanted to know what my ranking would be in Yahoo when they actually were able to crawl my site.
I added some code to my site that would allow Yahoo to crawl my site using faulty urls, while redirecting everyone else to the correct url.

The result? Yahoo appears to have a VERY LARGE appetite now it is able to crawl.
Pages don't show up in the results yet, but I guess that won't take long.

So Mike, any news on when your crawler gets fixed? then I can remove the extra code that shouldn't be there...

Greetings earthlings!

markus007

5:39 am on Apr 13, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Its really annoying, yahoo fetches my homepage 70 times an hour day after day... Fetches between 10k to 150k pages a day and i don't have more then 30k pages in the index...