homepage Welcome to WebmasterWorld Guest from 54.234.141.47
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
I wanna stop the spiders...
... am I crazy?
Digital Guerrilla

10+ Year Member



 
Msg#: 509 posted 12:06 pm on Mar 30, 2001 (gmt 0)

Hi dears...
sorry for the question I'm gonna ask you in a second but i really don't remember how to do it...
actually I'm working for a site and I've already my domain and my webspace...
since I've to check many technical functions of it, I've toput it online before it is finished... wath was the metatag that stopped the spiders? Does it stop any spider? and also it influence the ranking in a second moment? I mean if a spider see that metatag will delete me from his list or something?
Just to know more...
thanls in advanced...
BYezbyEZ

 

JuniorHarris

10+ Year Member



 
Msg#: 509 posted 3:14 pm on Mar 30, 2001 (gmt 0)

Robots Meta tag [info.webcrawler.com] though not all spiders [info.webcrawler.com] will obey.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved