Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| About absolute/relative URLs |
3 | Fabrizio | 7:21 am Jan 29, 2000 | ||||
| New Babelfish Spider Detected |
3 | fantomaster | 3:25 am Jan 26, 2000 | ||||
| Anyone have an answer for this one? |
3 | RealSpices | 7:01 pm Jan 17, 2000 | ||||
| Looking for recent Robots.txt info. |
2 | CentricTAG | 11:47 am Jan 11, 2000 | ||||
| PJspider |
2 | BigMike | 1:37 am Dec 30, 1999 | ||||
| New Alta ips |
2 | Brett_Tabke | 2:08 am Dec 15, 1999 | ||||
| Inktomi Fakers |
2 | Brett_Tabke | 4:25 am Nov 20, 1999 | ||||
| New Google IP's |
3 | Brett_Tabke | 1:20 am Nov 14, 1999 | ||||
| New Inktomi IP |
5 | ulstrup | 8:36 pm Nov 5, 1999 | ||||
| What is Teleport Pro/1.29 |
2 | censor | 7:17 pm Oct 11, 1999 | ||||
| New SE IP's |
4 | ulstrup | 12:17 pm Oct 8, 1999 | ||||
| Mercator spider |
6 | \Lizard! | 8:08 pm Sep 27, 1999 |
