homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Library
Forum: Search Engine Spider and User Agent Identification
Displaying Topics 41 - 80 (63 total) Sorted by: Date-Last-Post, Direction: reverse
#Subjectsort orderDate
41: new post   AVG Stops Real-Time Scanning
July 7, 2008
42: new post   Another Phorm Type Ad System Discovered?
"The Kindsight service...is funded through an advertising mechanism but without the use of cookies, pop-ups or spam. "
June 20, 2008
43: new post   AVG - Valid Security Tool or Malware - Part Two
AVG anti virus latest update includes a pre-fetch link scanner tool that some are viewing as malware itself.
June 14, 2008
44: new post   AVG Toolbar Glitch May Be Causing Visitor Loss
"Web sites with tight security are turning away AVG visitors with security toolbar broadcasting malformed HTTP headers and user agent strings."
May 10, 2008
45: new post   Yahoo! Slurp 3.0 Released on New IPs
"The new Yahoo! Slurp 3.0 recognizes the same user-agent and all robots.txt directives for 'Yahoo! Slurp,' though it'll identify itself as Slurp 3.0 in your web logs."
Apr 15, 2008
46: new post   Default User Agents of Programming Libraries and Command Line Tools
Apr 13, 2008
47: new post   Identifying And Analyzing Hostile & Friendly Bot Activity
"The following items can be used to identity bots and slow down and stop most unwanted traffic if applied with proper due care."
Mar 31, 2008
48: new post   Quick primer on identifying bot activity.
Mar 29, 2008
49: new post   Secure Sites From Botnet Vulnerability Probes
"Blocking these 2 things just may buy you some time from when the vulnerability is posted to the time you or your customers get around to installing the fix without being hacked."
May 11, 2007
50: new post   Project Honey Pot files $1B+ Lawsuit Against Spammers and Spambots
"On Thursday, April 26, 2007 at 10:54am in a court in the Eastern District of Virginia, Project Honey Pot filed the largest anti-spam lawsuit ever. Seeking more than $1B in statutory damages, the suit was brought on behalf of our members. It targets a huge swath of spammers. If you've harvested email addresses or sent spam in the last two years, chances are you're on our radar screen and we're coming after you."
Apr 28, 2007
51: new post   HoneyNet White Paper : Know your Enemy: Web Application Threats
"Web applications present a very high risk, and an attractive target to attackers for the following reasons: Firstly, the quality of the code is often rather poor and many vulnerabilities of commonly used code are published."
Feb 27, 2007
52: new post   Honeynet Project to Trap Spider Attackers and Name Names
"The Web Honeynet Project, an independent group of Honeynet researchers from Securiteam...they plan to name not only the spider attack details, but also to divulge the IP addresses and other tracking information about the attackers themselves."
Jan 27, 2007
53: new post   Botnet Pandemic Threatens Core of Internet
"Up to a quarter of computers on the net may be used by cyber criminals in so-called "botnets", according to Vint Cerf."
Jan 26, 2007
54: new post   The IRS Bots - Xenon Spiders Web for the Tax Man
"A five-nation tax enforcement cartel has been quietly cracking down on suspected internet tax cheats, using a sophisticated web crawling program to monitor transactions on auction sites, and track operators of online shops, poker and porn sites."
Jan 25, 2007
55: new post   MSN Robot Crawlers Renamed
WebmasterWorld Exclusive: MSNDude "These are all Microsoft bots that have been around for a while...."
July 31, 2006
56: new post   Updated Bot List
Oct 4, 2003
57: new post   New Fast/Overture Robot UA
Sept 7, 2003
58: new post   YahooSeeker/1.0
What is it?
Aug 23, 2003
59: new post   Blocking WebPage Monitoring Services
Most of these services are unwelcome bandwidth sponges. Lets call them out, identify them, and block them together.
Apr 9, 2003
60: new post   Bad Boy Bot of the Week
Pick a bot, any bot: This weeks fun one is an affiliate bot out walking and not respecting robots.txt.
Dec 6, 2002
61: new post   Mysterious User Agent and 404 Random Strings
"Altavista and DIIbot use suspicious request methods to test 404 errors."
June 11, 2002
62: new post   Search Engine and Spider IP Lists
Nice resource on the major operating spiders.
June 10, 2002
63: new post   How important is the Robots.txt file now?
"Am I missing out on a lot of traffic by not having a robots.txt file? Or is that a thing of the past?"
Jan 25, 2002
#Subjectsort orderDate
open in new window=open in new window

<< Back 1 2 Next >>
Home / Forums Index / Library
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved