Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Alexa IP's |
2 | toolman | 7:05 pm Jun 4, 2001 | ||||
| excite spider? |
3 | Ove | 8:40 pm May 30, 2001 | ||||
| webcraft by cybercity.fr |
3 | berno | 8:16 pm May 30, 2001 | ||||
| teoma_agent1 ? host06.teo.ewr.qwest.net |
2 | skirril | 3:21 pm May 30, 2001 | ||||
| Goo? |
4 | Brett_Tabke | 9:17 am May 30, 2001 | ||||
| Hit Hard 876 reqs in 42 min ip176.danville3.va.pub-ip.psi.net |
3 | Son_House | 2:18 am May 30, 2001 | ||||
| larbin spider@dunnserver.com Sqworm? |
5 | balsamic | 9:23 am May 29, 2001 | ||||
| sodoit.com |
2 | Vishal | 8:13 am May 29, 2001 | ||||
| Bogus referrer? |
2 | skirril | 2:56 pm May 27, 2001 | ||||
| polybot 1.0 |
8 | Froggyman | 7:28 am May 27, 2001 | ||||
| unknown POST action can anyone tell me what this all about? |
11 | sedir | 11:39 am May 26, 2001 | ||||
| Anyone ever seen this... |
3 | toolman | 9:31 pm May 24, 2001 | ||||
| magick.texcpe.cableone.net Googlebot UA |
3 | sugarkane | 1:24 pm May 24, 2001 | ||||
| qestion to refuse approch |
4 | mimmo5 | 12:29 pm May 24, 2001 | ||||
| Need a spider tracking script ...In Cold Fusion or VBScript |
7 | Travoli | 2:14 pm May 23, 2001 | ||||
| Defense contractor can't set User_Agent |
3 | littleman | 10:40 pm May 21, 2001 | ||||
| Why block a Spider? |
3 | Bobby79 | 12:50 pm May 21, 2001 | ||||
| perlone perlone |
2 | bot_watcher | 6:44 pm May 18, 2001 | ||||
| I Can't ID this one 209.15.170.xxx |
5 | bobriggs | 6:09 pm May 18, 2001 | ||||
| Translators - know any IPs? Babelfish, Go Translator etc |
6 | Machiavelli | 6:47 am May 17, 2001 | ||||
| Vspider |
5 | designfreak | 9:03 am May 16, 2001 | ||||
| Is Google cloak-checking me? Or am I getting paranoid? |
2 | Doofus | 8:34 pm May 15, 2001 | ||||
| We're being attacked update no referrer, no agent ??? |
3 | joshie76 | 8:09 pm May 15, 2001 | ||||
| Knowledgebase : Spider Identification |
2 | Brett_Tabke | 3:29 pm May 15, 2001 | ||||
| A dumb question |
7 | NFFC | 7:21 am May 15, 2001 |
