Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| spokespider looks like a business directory/networking bot |
3 | idiotgirl | 2:22 am Aug 14, 2008 | ||||
| User-Agent: Mozilla Invalid UA - is it valid? |
16 | dstiles | 10:44 pm Aug 12, 2008 | ||||
| UA - EmailSearch |
8 | phred | 7:37 am Aug 12, 2008 | ||||
| Name Intelligence spoofing Yahoo Slurp from a Google-esque IP address range |
6 | jdMorgan | 11:32 pm Aug 11, 2008 | ||||
| Lightspeed Systems sneaky creepy greedy crawler |
4 | idiotgirl | 9:31 am Aug 11, 2008 | ||||
| TMUFE and TMASE |
2 | keyplyr | 9:22 am Aug 11, 2008 | ||||
| Does Google use a FrontPage UA? |
3 | mayest | 12:42 am Aug 10, 2008 | ||||
| Hex String requested file |
8 | wilderness | 10:04 pm Aug 9, 2008 | ||||
| Google Tools |
16 | wilderness | 9:22 pm Aug 9, 2008 | ||||
| Bot with no ID? from verisign range |
4 | Megaclinium | 4:45 pm Aug 8, 2008 | ||||
| Bots, spiders, harvesters - IPV6 |
6 | phred | 1:45 pm Aug 7, 2008 | ||||
| Ask/Teoma on Verizon Biz? |
5 | keyplyr | 12:17 am Aug 7, 2008 | ||||
| Radian6 CommentReader reads robots.txt - but does it obey it? |
3 | caribguy | 1:09 pm Aug 5, 2008 | ||||
| Yahoo |
16 | wilderness | 12:32 pm Aug 5, 2008 | ||||
| MSN with new bot? New one on me |
25 | tangor | 11:37 am Aug 5, 2008 | ||||
| MSR-ISRCCrawler Looking for music royalty violations? |
15 | keyplyr | 1:53 pm Aug 2, 2008 | ||||
| 3gse high activity scrape |
2 | dstiles | 1:08 pm Aug 2, 2008 | ||||
| Mozbot-fetcher |
2 | keyplyr | 3:19 am Aug 1, 2008 | ||||
| Yahoo Slurp - no hostname |
17 | phred | 3:13 am Aug 1, 2008 | ||||
| myvzw.com aka vzw.msn.com |
3 | phred | 9:15 pm Jul 31, 2008 | ||||
| Need help with software ID |
2 | incrediBILL | 7:29 pm Jul 29, 2008 | ||||
| Click-thru abuse or log spammer? |
6 | wilderness | 8:41 pm Jul 28, 2008 | ||||
| Snoop |
2 | wilderness | 11:45 am Jul 26, 2008 | ||||
| ODP/dmoz.org link checker pmoz bot does not read robots.txt |
17 | Umbra | 8:50 pm Jul 25, 2008 | ||||
| No IP IP of bot just a dot |
8 | farflappin | 3:21 pm Jul 24, 2008 |
