Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Can your data base effect the deapth of the search PHP site with links to HTML pages |
3 | Travel_man | 11:34 am Mar 4, 2003 | ||||
| Mouse-House Spider Anyone know anything about this spider? |
3 | react | 8:46 pm Mar 3, 2003 | ||||
| Heavily Armed Browser okay... what/who is this, and should I be worried? |
2 | Mad_Max | 10:35 am Mar 3, 2003 | ||||
| FlickBot 2.0 RPT-HTTPClient/0.3-3 |
3 | frontpage | 9:28 pm Mar 2, 2003 | ||||
| are these ips websense? |
9 | leoo24 | 4:57 pm Mar 2, 2003 | ||||
| Beijing Email DTS Agent Dig EXT DTS Agent |
9 | Elgoog | 2:45 pm Mar 1, 2003 | ||||
| Robot. that's my name. |
2 | ga_ga | 1:29 pm Mar 1, 2003 | ||||
| anyone ever see this bot before? |
4 | AcesHigh | 7:18 am Mar 1, 2003 | ||||
| Help, I'm having problems blocking Teleport Pro What am I doing wrong? |
5 | Mad_Max | 7:16 am Mar 1, 2003 | ||||
| Fetch API Request Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) Fetch API Request |
5 | jamesyap | 4:27 am Feb 28, 2003 | ||||
| Who is this? I have never seen thi s one |
2 | Laurel | 1:08 am Feb 28, 2003 | ||||
| WebcraftBoot Anyone shed some light on this lil' critter? |
3 | ritch_b | 4:07 pm Feb 27, 2003 | ||||
| Please help with .htaccess ban 163.179.0.0 to 163.179.255.255 range |
10 | nativenewyorker | 5:53 am Feb 27, 2003 | ||||
| Under protecting in IP ranges being tolerant and safe NEVER Pays |
6 | wilderness | 2:58 am Feb 27, 2003 | ||||
| 212.20.147.34 -> Whois? |
2 | akvario | 8:42 pm Feb 26, 2003 | ||||
| 66.207.121.61, P-P-C Cancel, {World Online}, pide-09-00 Violated robots.txt, changed U-A four times in two minutes |
4 | jazzguy | 6:08 pm Feb 26, 2003 | ||||
| Microsoft+URL+Control+-+6.00.8862 What is this fella up to...? |
4 | ukgimp | 3:25 pm Feb 26, 2003 | ||||
| page rank and google crawler |
8 | Louise | 11:05 am Feb 26, 2003 | ||||
| FAST-WebCrawler/3.2 test and Fast Crawler v 3.3 (beta) What's the difference? |
2 | pendanticist | 4:39 am Feb 26, 2003 | ||||
| Topaktuelle Nachrichten Anyone Know Who/What This Is? |
4 | pendanticist | 4:39 am Feb 26, 2003 | ||||
| Yell Spider Is this coming from yell.com? |
2 | IanTurner | 10:38 pm Feb 25, 2003 | ||||
| The use of Includes is it recommended |
2 | fashezee | 3:21 pm Feb 25, 2003 | ||||
| Confuzzledbot/2.0 (+BETA http://bot.confuzzled.lu/) What is it? |
2 | GaryK | 1:09 am Feb 25, 2003 | ||||
| Heavy traffic from IP, ... ... does anyone know? |
6 | Guenni | 8:56 pm Feb 24, 2003 | ||||
| lobo.yahoo.com |
3 | leoo24 | 8:03 pm Feb 24, 2003 |
