|
|
|
| Forum: Search Engine Spider and User Agent Identification | ||||
| Displaying Topics 41 - 80 (47 total) Sorted by: Date-Last-Post, Direction: reverse | ||||
| # | Subject |  Date | ||
| 41: |  New Fast/Overture Robot UA | Sept 7, 2003 | ||
| 42: | YahooSeeker/1.0 What is it? | Aug 23, 2003 | ||
| 43: | Blocking WebPage Monitoring Services Most of these services are unwelcome bandwidth sponges. Lets call them out, identify them, and block them together. | Apr 9, 2003 | ||
| 44: | Bad Boy Bot of the Week Pick a bot, any bot: This weeks fun one is an affiliate bot out walking and not respecting robots.txt. | Dec 6, 2002 | ||
| 45: | Mysterious User Agent and 404 Random Strings "Altavista and DIIbot use suspicious request methods to test 404 errors." | June 11, 2002 | ||
| 46: | Search Engine and Spider IP Lists Nice resource on the major operating spiders. | June 10, 2002 | ||
| 47: | How important is the Robots.txt file now? "Am I missing out on a lot of traffic by not having a robots.txt file? Or is that a thing of the past?" | Jan 25, 2002 | ||
| # | Subject | Date | ||
|
|
