homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

regd search engine submission

 6:34 am on Feb 22, 2000 (gmt 0)

hi there,
this is my first enquiry on this forum
i have been doing some work on search engine indexing when i came across this
two methods of gateway pages registration
IP delivery (where u reg the IP address instead of URL- i hope i am right if not please correct me)
Agent Delivery ( i could not understand this method)
they seem to be methods of hiding data from the browser so they cannot actually find out how the website was designed.
could someone give me a more clearer information on this.

thanks in advance



 3:27 am on Feb 23, 2000 (gmt 0)

I suspect that what you read about was discussing cloaking, a method of serving a page designed to rank well on search engines to spiders that come a-calling, and serving your normal human page to human visitors.

The discussion was likely about different methods to determine whether the visitor is a spider or a human, and hence which page to serve.

Each browser visit includes numerous headers. Using the user_agent header to choose which page to serve is commonly referred to as agent delivery, using the IP address header is called IP delivery.

An very simplified intro to cloaking is at [cloakmaster.com...] and more detail is at [cloakmaster.com...]


 2:16 pm on Feb 23, 2000 (gmt 0)

thanks for all the info i think i will be able to go ahead with my work

thanks again

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved