Welcome to WebmasterWorld Guest from 107.20.54.98

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

hostnology.in's domain scraper site

     
2:26 am on Nov 5, 2011 (gmt 0)

Administrator from US 

WebmasterWorld Administrator incredibill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Jan 25, 2005
posts:14624
votes: 88


Yup, no shortage of these domain intel scraper sites.

DOMAIN: hostnology.in

IP: 96.30.56.165 (server.avadhwebs.com)

USER AGENT:
"Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

WHOIS of IP:
network:Organization;I:avadhwebs
network:ID:NETBLK-AVADHWEB.96.30.56.165/32
network:IP-Network-Block:96.30.56.165 - 96.30.56.165

Googlebot? That is so lame! LOL!
3:46 am on Nov 5, 2011 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 5, 2005
posts: 2038
votes: 1


Bill, the above post and your domain tools OP [webmasterworld.com...] show UAs in quotes.

Are the quotes actually part of the UAs?

If not, could you please not include them? Because some bots -- like SiteIntel [webmasterworld.com...] and the (just-posted) PagePeeker [webmasterworld.com...] -- really do, erm, quote themselves. TIA
5:26 am on Nov 5, 2011 (gmt 0)

Administrator from US 

WebmasterWorld Administrator incredibill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Jan 25, 2005
posts:14624
votes: 88


sigh

I always post UAs in quotes and use escapes if the quotes are included, like \"
10:19 am on Nov 5, 2011 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:5817
votes: 64


I've had that range blocked since last year. My notes say something about a Cugillion SE bot's bad behaviour, also port probe from Cogswell.

96.30.0.0 - 96.30.63.255
96.30.0.0/18
9:45 pm on Nov 5, 2011 (gmt 0)

Senior Member from GB 

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:May 14, 2008
posts:3092
votes: 2


The note I have on this range is "wired tree".
11:55 pm on Nov 5, 2011 (gmt 0)

Administrator from US 

WebmasterWorld Administrator incredibill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Jan 25, 2005
posts:14624
votes: 88


Just realized I only poisoned the page content to catch scrapers and didn't poison the page titles which is all some of these domain intel sites display.

Off to poison my titles now...

update: DONE! checked via proxies, poison titles complete. trap set, now we wait...
9:58 pm on Nov 6, 2011 (gmt 0)

Senior Member from GB 

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:May 14, 2008
posts:3092
votes: 2


000h! You are evil. :)
11:51 pm on Nov 6, 2011 (gmt 0)

Administrator from US 

WebmasterWorld Administrator incredibill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Jan 25, 2005
posts:14624
votes: 88


killer idea moved to new thread: [webmasterworld.com...]
12:24 am on Nov 7, 2011 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:5817
votes: 64


poison = killer


I get it, I get it :)