Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

Ask Crawl Banned sites?

Not sure if I have a penalty or not.



10:38 am on Feb 16, 2006 (gmt 0)

Inactive Member
Account Expired


I used to get good results from Ask about 8-10 months ago and then I was dropped and Jeeves bot stopped visiting my site.

Anyway Jeeves bot is starting to show intrest in the site again - anyone had experience of penalties expirying? - or is it just that Ask crawls banned sites sometimes?

3:04 am on Feb 23, 2006 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month

joined:June 12, 2003
votes: 81

I am told by someone at Ask that when Ask bans a site, it does not normally send bots to index it during the banned period. Recent bot activity may suggest the site may come back into the index, but that is not always the case. Some bot activity, such as "experimental" crawls disregards black/spam lists.

So I would guess, if you see normalized bot activity over time, that may suggest that the bot is not part of an experimental crawl. Since I do not work for Ask, I cannot say for sure.


1:04 pm on Feb 24, 2006 (gmt 0)

Inactive Member
Account Expired


Thanks RustyBrick.

I am getting a fair amount of the site crawled - not just 1 or 2 pages - in the hundreds.

Fingers crossed. Not sure why banned so maybe a recrawl will sort it out.

1:07 am on Feb 26, 2006 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 31, 2004
votes: 0


I have experience of this.

Ask will keep hitting your site hard and nothing will change, it will keep taking bandwidth - for now

Then at the next update loads of your pages will feature for all sorts of keywords, a number that you wont expect.

Its something to do with related content search - i would bet any money you have secured some links from some site that ask likes thats similar to your site content and thats what triggered it.

For now let it do its thing, its a short matter of time perhaps three/four months and you will start showing in the serps.

Two sites we work on that this happened on get as much traffic from ask as MSN! - if i knew how to start it off i would do it on other sites we work on to get them ranking but i dont and its a mystery but the link comment i made is relevent im convinced.

Good luck