Welcome to WebmasterWorld Guest from 54.162.227.136

Forum Moderated by: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification


PreModerated forum to id search engine spiders

 
Thread SubjectMessagesStarted byLast Message
Did I accidentally block a real googlebot visit?
21 aristotle 11:59 am Jun 26, 2014
Palo Alto Networks bot
10 slipkid 3:15 pm Jun 25, 2014
memorybot
from: archivethe.net
4 Pfui 1:08 am Jun 22, 2014
Map of the internet
some sort of weirdo search engine
4 slipkid 2:18 pm Jun 18, 2014
Odd Baidu UA
1 keyplyr 8:32 pm Jun 15, 2014
bebopbot
3 lucy24 6:43 pm Jun 12, 2014
Bot, Robot, Spider, Crawler from Brazil
6 lucy24 7:31 pm Jun 10, 2014
Icap-iod
from Internap
6 keyplyr 5:05 pm Jun 10, 2014
bare Mozilla from google range
2 lucy24 8:38 am Jun 6, 2014
Naked Googlebot?
I am stumped with this Google IP hit
5 not2easy 5:46 pm May 31, 2014
This. Is. Nasty.
14 lucy24 5:53 am May 31, 2014
Puzzled by this UA behavior
5 aristotle 8:13 pm May 26, 2014
Gimme60bot
4 lucy24 8:01 pm May 26, 2014
How to Block Bogus User Agent ") )"
17 wilderness 7:18 pm May 24, 2014
Zeek-heartbleed-notifyer user agent and IP data
3 keyplyr 6:53 pm May 22, 2014
Hit from Homeland Security
13 slipkid 4:17 pm May 20, 2014
Java/1.6.0 04 user agent
5 aristotle 7:23 pm May 19, 2014
u12Bot from Ukraine downloading sites
3 keyplyr 1:22 am May 19, 2014
Squider crawling from many IPs, may be a botnet
major hitter over the past ten days
2 dstiles 9:24 pm May 18, 2014
Riddler honors robots.txt
2 keyplyr 6:19 am May 16, 2014
Elisabot 1.0 user agent and IP information
5 keyplyr 8:28 am May 15, 2014
Inktomi vulnerability probe
WordPress probe
9 keyplyr 1:08 am May 15, 2014
Facebook scraper ? I can't figure this out.
6 kahuna 11:18 pm Apr 30, 2014
Tiscali IstellaBot
3 carson63000 9:17 pm Apr 30, 2014
MSIE 11 odd UA string
like gecko
2 dstiles 2:23 pm Apr 28, 2014

Featured Threads

Hot Threads This Week

Hot Threads This Month