Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Epsilon Softworks' MailMunky on my endangered species list |
12 | idiotgirl | 5:45 am Aug 27, 2002 | ||||
| NetX HPe Thin Client |
6 | wilderness | 3:23 am Aug 26, 2002 | ||||
| User Agent = btiv6download |
4 | Woz | 3:07 am Aug 26, 2002 | ||||
| gsa-crawler Google for hire? |
5 | wilderness | 10:49 am Aug 22, 2002 | ||||
| Up to date search engine spider IP lists. anyone? |
4 | caine | 11:35 pm Aug 21, 2002 | ||||
| spider4.picsearch ? new ? |
2 | Birdman | 4:35 am Aug 21, 2002 | ||||
| Microsoft Data Access Internet Publishing Provider What is it? |
2 | Pushycat | 3:26 am Aug 21, 2002 | ||||
| \xf8\xb0}\b New Useragent or Just Browser |
2 | frontpage | 4:34 pm Aug 20, 2002 | ||||
| .htaccess syntax |
3 | deltakits | 5:06 pm Aug 19, 2002 | ||||
| FuffyGerbil/1.0 ? "cute isn't it ?"....not |
5 | Big_Balou | 5:30 am Aug 19, 2002 | ||||
| Robot from ddsg.dillards.com |
2 | Key_Master | 4:36 pm Aug 17, 2002 | ||||
| TurnitinBot/1.4 Not really a search engine, but... |
2 | mdharrold | 10:51 pm Aug 16, 2002 | ||||
| stream://1/ views images, then changes idenitities |
5 | idiotgirl | 5:01 pm Aug 15, 2002 | ||||
| LightningDownload/1.0.1 Should this be labeled a good bot or a bad bot? |
2 | Pushycat | 3:37 pm Aug 15, 2002 | ||||
| Mirago robot has it changed name? |
9 | allybongo | 12:31 pm Aug 14, 2002 | ||||
| Ideas on Banning This Scanning Attemp |
11 | frontpage | 7:49 am Aug 14, 2002 | ||||
| Hits From Novell Border Manager Why exactly would it hit? |
4 | Grumpus | 10:45 pm Aug 13, 2002 | ||||
| Unknown spider with unsavoury name f*****bot larbin2.5.0@unspecified.mail |
3 | shelleycat | 11:02 am Aug 13, 2002 | ||||
| InfoSeek Japan's UAs and IPs? |
6 | littleman | 3:56 am Aug 12, 2002 | ||||
| SetEnvIf User-Agent How to Ban Bots with this Tool |
30 | frontpage | 1:14 pm Aug 11, 2002 | ||||
| Open Invitation making webbots/spiders id-ing easier |
7 | transistor | 2:34 pm Aug 10, 2002 | ||||
| Orangebot Who's this cheeky little fella then? |
12 | Nick_W | 2:17 pm Aug 10, 2002 | ||||
| 211.154.211.209, again. |
8 | Key_Master | 4:00 am Aug 10, 2002 | ||||
| DigExt Is this a spider? |
5 | allybongo | 6:11 pm Aug 9, 2002 | ||||
| Vobsub anyone else seen this? |
3 | Crazy_Fool | 4:09 pm Aug 9, 2002 |
