Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Looking for good wordpress robots.txt

4:52 am on Jan 30, 2010 (gmt 0)

Junior Member

5+ Year Member

joined:Mar 10, 2008
votes: 0

I have a hobby blog that gets some traffic, but does terrible in search results in Google. I'd like to change that. In looking at my top keywoards in google webaster tools, it's telling me that my top five keywords are december, january, june, july and blog. That's awful because the site is about public lands, not months or a calendar. There's lots of long, wordy content too. For whatever reason I only have 3 pages of this 20,000 page blog in the non-supps. That is awful. Of hundreds of images, three are in Google images. I have no idea what could be wrong but it's very annoying. Thanks for any pointers on a proper robots.txt that deals with wordpress issues.
4:51 pm on Feb 1, 2010 (gmt 0)

Administrator from US 

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:June 21, 2004
votes: 85

Most people use robots.txt to deal with duplicate content issues in wordpress. What you describe sounds more like an issue with your wordpress template. Your template code should ideally be a smaller percentage when compared to the unique content on each page of your blog.

You might find these early threads helpful