Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| wwwster wwwster/1.2 (Beta, mailto:gue[at]cis.uni-muenchen.de) |
22 | bull | 6:11 pm Aug 13, 2004 | ||||
| archive.org running amock |
21 | jackson | 1:55 am Aug 13, 2004 | ||||
| Yahoo-MMCrawler what is this? |
3 | jackson | 6:41 pm Aug 12, 2004 | ||||
| Surf |
2 | zomega42 | 6:26 pm Aug 12, 2004 | ||||
| New Googlebot UA |
3 | jcoronella | 2:08 pm Aug 12, 2004 | ||||
| Possible New AV spider? |
2 | surfin2u | 1:42 pm Aug 4, 2004 | ||||
| Three UA's in five seconds |
6 | wilderness | 6:56 pm July 31, 2004 | ||||
| Anyone know what spider uses this IP? it has visited thousands of times this month |
3 | Code_Sentinel | 11:17 pm July 30, 2004 | ||||
| New spider to me.... K2-Summit |
3 | Daily_Sparring | 1:13 am July 30, 2004 | ||||
| New tradmark, IP Protection bot, surveillance, etc markmonitor.com |
11 | mrjeff | 5:29 am July 29, 2004 | ||||
| New Yahoo Bot |
2 | Josk | 3:57 pm July 28, 2004 | ||||
| Gigabot gets an upgrade |
3 | balam | 9:37 am July 28, 2004 | ||||
| Name the Mystery Robot... Why is Yahoo not indexing my subpages? |
13 | Rollo | 12:53 am July 27, 2004 | ||||
| deepak-USC/ISI-1.0 2nd or 3rd visit |
8 | wilderness | 5:08 pm July 26, 2004 | ||||
| SpaceBison |
8 | volatilegx | 12:35 pm July 26, 2004 | ||||
| Undesirable spiders that obey robots.txt Undesirable spiders that obey robots.txt bad bots |
17 | David_1cog | 12:30 am July 26, 2004 | ||||
| New Google UA |
4 | volatilegx | 10:10 pm July 25, 2004 | ||||
| Axmo 'Pear-2-Pear' bot |
2 | directrix | 8:04 pm July 25, 2004 | ||||
| Secret ADSL Crawlers |
5 | papamaku | 4:46 pm July 23, 2004 | ||||
| MMCrawler Formerly vscooter |
3 | fiestagirl | 11:59 am July 20, 2004 | ||||
| Googlebot user-agent string changed sometime in the past day |
8 | jdMorgan | 10:00 pm July 19, 2004 | ||||
| New spider? Kinda funny in a way |
23 | Goober | 7:18 pm July 19, 2004 | ||||
| What is sygol Had this spider today |
2 | ogletree | 12:23 am July 16, 2004 | ||||
| Microsoft-WebDAV-MiniRedir/5.1.2600 |
3 | xcomm | 8:56 pm July 12, 2004 | ||||
| Not getting images = Spider? Not getting anything |
2 | blaze | 2:20 am July 12, 2004 |
