homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

Index Page Removal, Serious Problem Please Help
robots.txt or whats the issue? non-technical person here

 2:11 pm on May 25, 2011 (gmt 0)

There is a web site whose index/home page is removed from google only. Other pages are intact and there is no issue of penalty or panda effect. How can it regain its position? <snip>

[edited by: goodroi at 5:18 pm (utc) on May 25, 2011]
[edit reason] Please no urls [/edit]



 5:20 pm on May 25, 2011 (gmt 0)

Have you tried logging into Google Webmaster Central? See if there are any messages waiting for you. Also see what happens when you use the "fetch as googlebot" to see what Google sees when they visit your home page.


 7:16 am on May 26, 2011 (gmt 0)

i would also look at the status code and all the response headers for that url request.


 10:05 am on May 26, 2011 (gmt 0)

site has been back at this time. i asked the technical guys and they assured there is no issue with the google webmaster tools.

@phranque: what do mean by status code and response headers...


 2:16 pm on May 26, 2011 (gmt 0)

HTTP/1.1 Status Code Definitions:
http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html [w3.org]
HTTP/1.1 Header Field Definitions:
http://www.w3.org/Protocols/rfc2616/rfc2616-sec14.html [w3.org]

although i would probably be most concerned with the Link: rel="canonical" header and the "X-Meta-" response headers (which aren't listed in the above reference and are typically defined in the document <head>), especially the meta robots header.
or the X-Robots-Tag header.

use the Live HTTP Headers plugin for FF or your favorite "status code/server header checker tool".


 10:25 am on May 29, 2011 (gmt 0)

What did u changed in robots.txt or .htaccess?

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved