Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Amanda_Spider/[email protected] Rapid fire, but apparently legit seach engine bot |
2 | LeBain | 7:33 pm Oct 24, 2001 | ||||
| ! New Slurp ! |
7 | toolman | 8:50 pm Oct 23, 2001 | ||||
| MsFrontpage |
5 | toolman | 9:55 pm Oct 22, 2001 | ||||
| Spider databases? Downloadable databases with spider info? |
4 | aetjansen | 5:49 pm Oct 22, 2001 | ||||
| Anybody care to add any bots to this? |
17 | BoneHeadicus | 2:27 pm Oct 22, 2001 | ||||
| http://169.207.41.120/login.asp |
4 | jeremy_goodrich | 10:11 pm Oct 21, 2001 | ||||
| Anyone familiar with Searchhippo.com? Fluffy the Spider!?? |
6 | Travoli | 8:21 pm Oct 17, 2001 | ||||
| Browser=Hunter/3.0 OS=undefined Requesting totally unrelated URLs.... |
5 | mivox | 7:32 pm Oct 17, 2001 | ||||
| Tool for Checking spider to index my web I want tool for checking spiders index my website |
3 | maimax | 5:49 pm Oct 17, 2001 | ||||
| Oliver Perry and w3matter paid a visit |
18 | Marcia | 8:44 pm Oct 16, 2001 | ||||
| User agent "-" (null) Are there any legitimate agents that use "-" (null) only? |
5 | seifried | 8:28 pm Oct 15, 2001 | ||||
| anyone seen this one 217.27.131.25 |
4 | dolphin | 1:39 pm Oct 15, 2001 | ||||
| Incy Wincy? Looking for some information on this one... |
10 | Eric_Lander | 9:47 am Oct 15, 2001 | ||||
| Lycos Spider? Traces to Korea |
4 | Will | 3:39 pm Oct 11, 2001 | ||||
| Indy Library |
6 | Marcia | 3:27 pm Oct 11, 2001 | ||||
| ScoreBot/5 |
6 | Son_House | 11:03 pm Oct 10, 2001 | ||||
| New NorthernLight bot |
2 | littleman | 1:44 am Oct 10, 2001 | ||||
| Slurp/2.0-Kiteweekly? Kiteweekly? |
6 | grnidone | 6:19 pm Oct 9, 2001 | ||||
| Mozilla/3.Mozilla/2.01 (Win95; I) from nucleus.com |
6 | idiotgirl | 9:18 am Oct 9, 2001 | ||||
| Mozilla/3.0 NAVIO (dtv0) Verio - Best.com - and Ravenous |
2 | bobriggs | 6:16 am Oct 6, 2001 | ||||
| Sources of SE IP numbers Anyone know of a frequently updated list of SE IP numbers? |
2 | Wallace | 9:25 pm Oct 5, 2001 | ||||
| compatible;+Indy+Library 211.101.236.93 |
3 | dolphin | 11:33 pm Oct 4, 2001 | ||||
| knowledge/0.5 Anyone heard of bot called "knowledge/0.5"? |
4 | LeBain | 9:10 pm Oct 3, 2001 | ||||
| InfoNaviRobot(F107) InfoNaviRobot(F107) |
4 | bot_watcher | 5:05 pm Oct 3, 2001 | ||||
| larbin2.1.1 - 137.203.128.34 137.203.128.34 |
15 | dolphin | 5:26 pm Oct 2, 2001 |