Welcome to WebmasterWorld Guest from 50.16.24.12

Forum Moderators: goodroi

How to Disallow Jeeves?

   
6:27 pm on Mar 5, 2004 (gmt 0)

10+ Year Member



I saw several different information on how the user agent for ask jeeves is called.
I want to disallow it in my robots.txt but I don't know how to call it.
On my stats it calls the robot just Jeeves. So is that how I should set on the robots.txt?
I also heard people saying it is Ask Jeves, or Ask Jeeves/Teome, or teomaagent1, or directhit..........................

So, what is the correct one?

Thanks

6:38 pm on Mar 5, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Why do you want to ban a spider from one of the larger search engines which is normally well behaved.

With the current changes going on I would of thought your site needs all the FREE exposure it can get because in the future it may not be FREE

ncw164x

6:50 pm on Mar 5, 2004 (gmt 0)

10+ Year Member



Becuase Jeeves took 3GB of my bandwidth last month and I heard that most of the time the don't add your pages to their listings. I never got any traffic from them. I also asked other developers and they said that they get almost no traffic from Ask Jeeves.
Do you get?
6:53 pm on Mar 5, 2004 (gmt 0)

10+ Year Member



Considering that AskJeeves just purchased Excite and Iwon and are expected to garner about 7% of se traffic you may want to reconsider.
7:03 pm on Mar 5, 2004 (gmt 0)

10+ Year Member



Ok, I will give it a chance.

But, usually how long does it take to see your pages listed there after they are crawled?
Do you get traffic from them?

 

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month