homepage Welcome to WebmasterWorld Guest from 54.227.41.242
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
What is a web crawler?
2:
seedyplayer




msg:4085325
 5:00 am on Feb 23, 2010 (gmt 0)


System: The following 2 messages were cut out of thread at: http://www.webmasterworld.com/search_engine_spiders/4083253.htm [webmasterworld.com] by incredibill - 12:43 am on Feb 23, 2010 (PST -8)


What is a web crawler or a robot? Is it some software? Sorry for my complete ignorance but , I have never got a real answer to this ever.

 

Pfui




msg:4085348
 5:34 am on Feb 23, 2010 (gmt 0)

You'll find the answers right under your fingertips. For starters, read the first few paragraphs of:

Wikipedia: Web crawler [en.wikipedia.org]

See also:

Wikipedia: Internet bot [en.wikipedia.org]

Want more info? Pick your choice of major search engine and go for it!

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved