homepage Welcome to WebmasterWorld Guest from 54.167.10.244
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Sitemaps to Google, Yahoo and Bing, am I missing another one?
silverbytes




msg:3945269
 2:03 am on Jul 3, 2009 (gmt 0)

I take care to send sitemaps to Google and Yahoo and now, why not, to Bing, am I missing another one?

Is there other serach engine allowing a control panel to send sitemaps?

 

tedster




msg:3945368
 5:42 am on Jul 3, 2009 (gmt 0)

Ask.com will use an XML Sitemap, too - you need to use the robots.txt autodiscovery method.

[about.ask.com...]

silverbytes




msg:3945992
 12:27 am on Jul 4, 2009 (gmt 0)

So just adding my sitemap to robots is enough. But HOW in first place Ask.com will find my robots.txt? I mean how do I submit either my robots.txt or sitemap.xml or home page. Couldn't find that info on Ask.

phranque




msg:3955502
 2:07 am on Jul 20, 2009 (gmt 0)

any "well-behaved" robot will request and respect robots.txt before crawling your site.
some bots will check robots.txt before each page request and others will do it once per "session".

eeek




msg:3976744
 8:38 am on Aug 22, 2009 (gmt 0)

Ask.com will use an XML Sitemap, too - you need to use the robots.txt autodiscovery method.

The sitemap ping URL:

[submissions.ask.com...]

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved