Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Site title and description missing in search results

I had made some changes in robots.txt file



1:03 am on Nov 27, 2007 (gmt 0)

5+ Year Member

I made some changes in my robots.txt file since I wanted to block two search engines but since then I am seeing that many pages on my website are now showing just the title (it is also not the actual title - for some pages it is simply the URL or a snippet from the page) and the URL with no description.

Could it be that I made a mistake in my file and that caused the problem? How can I rectify it?

I just reverted it to the old file just now and this is how it looks. Please tell me if it is OK.

User-agent: *
Disallow: /*/feed/$
Disallow: /*/feed/rss/$
Disallow: /*/wp-


2:12 pm on Nov 27, 2007 (gmt 0)

5+ Year Member

Update: I checked the Google Webmaster Tools and realized that I did block search engines (I have no idea how). That was causing the problem. With the new file, I see that some pages are now being updated. It happened within a few hours of changing the file.

My advice to anyone who needs to change the robots.txt file is to be careful.


Featured Threads

Hot Threads This Week

Hot Threads This Month