Welcome to WebmasterWorld Guest from 54.166.191.159

Forum Moderators: martinibuster

Message Too Old, No Replies

slurp-bot and landing pages

slurp-bot and landing pages

     
3:29 pm on Dec 19, 2008 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



Does anyone know if the slurp bot indexes landing pages? Pages that are posted on external sites without verification?

I have seen some strange entries in the server log. Now I wouldn't pay attention as external links may be accessed by the bot but the same link appears over and over again, sparingly though in a period of 2 months. And searching for this link does not show in the yahoo's index. It's a hack attempt with some strange characters and the site is secure enough to that type of access, so none of this propagates, the server responds with a 301 redirect to the home page.

Or slurp thinks a 301 may change later on?

 

Featured Threads

Hot Threads This Week

Hot Threads This Month