Welcome to WebmasterWorld Guest from 54.226.62.251

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

sv-fw.looksmart.com

     

addvisors

5:31 pm on Oct 31, 2003 (gmt 0)

10+ Year Member



What is this.sv-fw.looksmart.com

I appeared today, but does looksmart use a spider?

Best regards

addvisors

6:53 pm on Oct 31, 2003 (gmt 0)

10+ Year Member



Btw. Hello everybody, this is my first post in here.

Look forward to spending more time in here.

Kim

pendanticist

7:23 pm on Oct 31, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Welcome to WebmasterWorld addvisors. :)

Actually, Looksmart has two of them:

(http://www.WISEnutbot.com is a search engine.)

Their newest Dead Link Checker.

216.88.158.142 - - [29/Oct/2003:15:58:55 -0800] "GET /robots.txt HTTP/1.1" 200 1524 "-" "Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker Beta-d01 (wn.zyborg@looksmart.net; http*//www.WISEnutbot.com)"

and

64.241.242.18 - - [17/Oct/2003:23:20:59 -0700] "GET /robots.txt HTTP/1.1" 200 1524 "-" "Mozilla/4.0 compatible ZyBorg/1.0 (wn.zyborg@looksmart.net; http*//www.WISEnutbot.com)"

Sorry you had to bump your own 'first post' :(

Normally, answers are lots faster in coming.

Pendanticist.

addvisors

7:32 pm on Oct 31, 2003 (gmt 0)

10+ Year Member



Thanks a lot for the answer,

Does that mean that the wisenutbot will eventually crawl my site when it has visited my index.htm now?

Best regards,

Kim

pendanticist

7:54 pm on Oct 31, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It has been my experience that once a (legitimate) bot visits my robots.txt file (even if only one visit has been made as you mentioned), eventually that bot will return and begin the indexing process.

You might find this thread [webmasterworld.com] interesting reading as it has links to specific posts where various bots (good/bad and evil) are pretty much all mentioned. The most current is at the bottom of that page.

Pendanticist.

 

Featured Threads

Hot Threads This Week

Hot Threads This Month