Welcome to WebmasterWorld Guest from 54.159.19.75

Forum Moderators: goodroi

Message Too Old, No Replies

How to Disallow Jeeves?

     
6:27 pm on Mar 5, 2004 (gmt 0)

Preferred Member

10+ Year Member

joined:Oct 10, 2003
posts:439
votes: 0


I saw several different information on how the user agent for ask jeeves is called.
I want to disallow it in my robots.txt but I don't know how to call it.
On my stats it calls the robot just Jeeves. So is that how I should set on the robots.txt?
I also heard people saying it is Ask Jeves, or Ask Jeeves/Teome, or teomaagent1, or directhit..........................

So, what is the correct one?

Thanks

6:38 pm on Mar 5, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 7, 2003
posts:1179
votes: 0


Why do you want to ban a spider from one of the larger search engines which is normally well behaved.

With the current changes going on I would of thought your site needs all the FREE exposure it can get because in the future it may not be FREE

ncw164x

6:50 pm on Mar 5, 2004 (gmt 0)

Preferred Member

10+ Year Member

joined:Oct 10, 2003
posts:439
votes: 0


Becuase Jeeves took 3GB of my bandwidth last month and I heard that most of the time the don't add your pages to their listings. I never got any traffic from them. I also asked other developers and they said that they get almost no traffic from Ask Jeeves.
Do you get?
6:53 pm on Mar 5, 2004 (gmt 0)

New User

10+ Year Member

joined:Jan 12, 2004
posts:8
votes: 0


Considering that AskJeeves just purchased Excite and Iwon and are expected to garner about 7% of se traffic you may want to reconsider.
7:03 pm on Mar 5, 2004 (gmt 0)

Preferred Member

10+ Year Member

joined:Oct 10, 2003
posts:439
votes: 0


Ok, I will give it a chance.

But, usually how long does it take to see your pages listed there after they are crawled?
Do you get traffic from them?