Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Almaden |
4 | Bluestreak | 1:44 pm Dec 10, 2002 | ||||
| Ugly looking User-agent |
6 | Bluestreak | 6:16 am Dec 10, 2002 | ||||
| CONNECT xxx.xxx.xxx.xxx? |
4 | skirril | 10:04 pm Dec 9, 2002 | ||||
| MFHttpScan |
3 | Duckula | 12:27 pm Dec 9, 2002 | ||||
| Spider deliberately looking for Disallow: content Bad bot 199.231.148.148 (URL_Spider_SQL/1.0) |
5 | Romeo | 3:48 am Dec 9, 2002 | ||||
| Schmozilla? |
7 | Spearmaster | 9:18 pm Dec 8, 2002 | ||||
| AlkalineBOT/1.8 Anyone seen it? Know anything? |
3 | jec2002 | 1:42 pm Dec 8, 2002 | ||||
| Csice-Agent Anyone ever seen this one? |
6 | pendanticist | 11:43 am Dec 8, 2002 | ||||
| Search referrals Ceaser+Rodney |
6 | wilderness | 4:57 am Dec 8, 2002 | ||||
| JoBo/1.3 "offline browser" |
4 | bull | 4:39 pm Dec 6, 2002 | ||||
| AOL spider identification |
4 | Tonearm | 3:43 am Dec 6, 2002 | ||||
| What's the deal on MFC_Tear_Sample WebmasterWorld Site Search shows nothing. |
8 | pendanticist | 2:16 am Dec 6, 2002 | ||||
| Mozilla/69.0H.... http://www.infoslash.org? |
2 | bull | 7:54 pm Dec 5, 2002 | ||||
| Scooter/3.2.SF0 using Cookies & Referrer? Is this something new or am I just showing my age... |
3 | Dreamquick | 1:03 pm Dec 5, 2002 | ||||
| Cis Te/1.0 Little beast |
4 | carfac | 6:04 pm Dec 4, 2002 | ||||
| Googlebot 64.68.86.xxx |
2 | wilderness | 4:44 am Dec 3, 2002 | ||||
| Anyone know what this is? |
4 | Adam_C | 9:07 pm Dec 2, 2002 | ||||
| Dirty bot grabs from multiple IPs & UAs 65.102.17.* |
7 | Justanotherseotype | 8:59 am Dec 2, 2002 | ||||
| Mercator taking tar files? took two huge gzipped tar files |
2 | Finder | 4:22 am Dec 2, 2002 | ||||
| crawler named Xanamu can anyone id it |
12 | jec2002 | 9:12 am Dec 1, 2002 | ||||
| CooperativeCrawler |
2 | wolfy | 9:39 pm Nov 29, 2002 | ||||
| Rabaz of Gigabaz et.al.:Anybody know these? |
8 | troels_nybo_nielsen | 8:17 pm Nov 29, 2002 | ||||
| Two more slow spiders |
8 | Spearmaster | 2:21 am Nov 29, 2002 | ||||
| TurnitinBot - 4000 pages a day? |
14 | Catnip | 1:57 am Nov 28, 2002 | ||||
| Mistake with user agent |
14 | fatpeter | 2:23 pm Nov 27, 2002 |
