Sanenet
msg:1529543 | 2:08 pm on Jan 20, 2004 (gmt 0) |
Not 100% sure, but I believe it's Advanced Information Technology Research Centre at the Korean Advanced Institute of Science and Technology (KAIST AITrc). Involved, among other things, in the development of advanced databases and query mechanisms for applications involving terabytes of infomation (search engines?).
|
stapel
msg:1529544 | 2:59 pm on Jan 20, 2004 (gmt 0) |
But they're not advanced enough to understand a "robots.txt" file? Hmm.... Thank you. Eliz.
|
admin amoroustoys
msg:1529545 | 12:01 pm on Feb 3, 2004 (gmt 0) |
I found out that you can find some info on the crwaler by copy pasting the Ip into you Browser.
|
|
