Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Msn new to this |
2 | wayne | 6:02 pm Mar 8, 2001 | ||||
| Sneaky |
2 | BoneHeadicus | 5:22 pm Mar 8, 2001 | ||||
| Very annoying robot |
18 | msgraph | 4:16 pm Mar 7, 2001 | ||||
| Whatsup wit 24/7 |
3 | BoneHeadicus | 9:00 pm Mar 4, 2001 | ||||
| Didn't get stung by the Jellyfish1 |
2 | BoneHeadicus | 2:48 am Mar 4, 2001 | ||||
| dumb spider: asterias/2.0 coho.singingfish.com: asterias/2.0 |
8 | skirril | 8:32 pm Mar 2, 2001 | ||||
| New Altavista-spider? testing new scooter and mercator or what else? |
7 | oLeon | 4:05 pm Mar 2, 2001 | ||||
| New GoogleBot |
13 | BoneHeadicus | 2:33 pm Mar 2, 2001 | ||||
| Great lookup tool Great program |
6 | tcmalaska | 7:14 pm Mar 1, 2001 | ||||
| Concentric Network Corporation |
4 | msgraph | 2:15 pm Mar 1, 2001 | ||||
| SnoopRob Where does SnoopRob come from? |
3 | pikaia | 7:41 am Mar 1, 2001 | ||||
| User-Agent: MyLycos Please, this is all over my stuff |
16 | han solo | 7:25 pm Feb 28, 2001 | ||||
| Ip:199.245.188.74 UA: libwww-perl/5.50 |
4 | roscoepico | 6:43 pm Feb 28, 2001 | ||||
| who is this? |
5 | hohmaster | 5:30 pm Feb 28, 2001 | ||||
| Newbie - Do Spiders eat JPG files? I could not identify this IP |
8 | Macguru | 12:34 pm Feb 28, 2001 | ||||
| Who/What is this? |
2 | jk321 | 8:09 am Feb 27, 2001 | ||||
| Crawler6.bos2.fast-search.net FAST / Alltheweb crawler? |
5 | Rumbas | 5:28 am Feb 25, 2001 | ||||
| Make them stop! any luck? |
8 | luckynh | 1:46 pm Feb 21, 2001 | ||||
| 211.117.61.68 |
4 | Froggyman | 8:45 pm Feb 20, 2001 | ||||
| Sidewinder What is it doing? |
3 | Hope | 6:50 pm Feb 20, 2001 | ||||
| JennyBot/0.1? 64.97.116.103; JennyBot/0.1 |
5 | skirril | 2:27 am Feb 20, 2001 | ||||
| Netcraft.. ariston.netcraft.com ; Mozilla 4.0 Compat.. |
3 | skirril | 10:23 pm Feb 17, 2001 | ||||
| Where can I optain Spider List? Where can I optain Spider List? |
9 | clienttell | 12:51 pm Feb 16, 2001 | ||||
| Why are non search engines robots hitting our site? |
2 | Acternaweb | 4:27 pm Feb 15, 2001 | ||||
| Spoofed Mozilla/4.72 Acts like a robot, doesn't send a Host header |
2 | Kimihia | 3:09 am Feb 14, 2001 |
