|Forum: Search Engine Spider and User Agent Identification|
|Displaying Topics 41 - 80 (53 total) Sorted by: Date-Last-Post, Direction: reverse|
|41:|| HoneyNet White Paper : Know your Enemy: Web Application Threats|
"Web applications present a very high risk, and an attractive target to attackers for the following reasons: Firstly, the quality of the code is often rather poor and many vulnerabilities of commonly used code are published."
|Feb 27, 2007|
|42:|| Honeynet Project to Trap Spider Attackers and Name Names|
"The Web Honeynet Project, an independent group of Honeynet researchers from Securiteam...they plan to name not only the spider attack details, but also to divulge the IP addresses and other tracking information about the attackers themselves."
|Jan 27, 2007|
|43:|| Botnet Pandemic Threatens Core of Internet|
"Up to a quarter of computers on the net may be used by cyber criminals in so-called "botnets", according to Vint Cerf."
|Jan 26, 2007|
|44:|| The IRS Bots - Xenon Spiders Web for the Tax Man|
"A five-nation tax enforcement cartel has been quietly cracking down on suspected internet tax cheats, using a sophisticated web crawling program to monitor transactions on auction sites, and track operators of online shops, poker and porn sites."
|Jan 25, 2007|
|45:|| MSN Robot Crawlers Renamed|
WebmasterWorld Exclusive: MSNDude "These are all Microsoft bots that have been around for a while...."
|July 31, 2006|
|46:|| Updated Bot List||Oct 4, 2003|
|47:|| New Fast/Overture Robot UA||Sept 7, 2003|
What is it?
|Aug 23, 2003|
|49:|| Blocking WebPage Monitoring Services|
Most of these services are unwelcome bandwidth sponges. Lets call them out, identify them, and block them together.
|Apr 9, 2003|
|50:|| Bad Boy Bot of the Week|
Pick a bot, any bot: This weeks fun one is an affiliate bot out walking and not respecting robots.txt.
|Dec 6, 2002|
|51:|| Mysterious User Agent and 404 Random Strings|
"Altavista and DIIbot use suspicious request methods to test 404 errors."
|June 11, 2002|
|52:|| Search Engine and Spider IP Lists|
Nice resource on the major operating spiders.
|June 10, 2002|
|53:|| How important is the Robots.txt file now?|
"Am I missing out on a lot of traffic by not having a robots.txt file? Or is that a thing of the past?"
|Jan 25, 2002|