Welcome to WebmasterWorld Guest from 54.144.124.152

Forum Moderated by: goodroi

Sitemaps, Meta Data, and robots.txt


Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
Thread SubjectMessagesStarted byLast Message
Website Disallowed through robots.txt, will google re index
Website Disallowed through robots.txt, will google re index
3 jackgordon 9:41 am Feb 28, 2009
Trying to find a sitemap generator for vista home Prem / .net 3.5 sp1
3 cmendla 1:41 am Feb 28, 2009
Will Google Index Page not in Sitemap?
3 CWebguy 6:25 pm Feb 27, 2009
Sitemaps Generator on Large Site
Could this cause problems?
5 CWebguy 6:23 pm Feb 27, 2009
vspider not adhereing to robots.txt
6 tonynoriega 11:07 pm Feb 26, 2009
block dynamic urls with product options using robots.txt?
How do I?
2 circusboy 3:53 pm Feb 24, 2009
why use a robots.txt
17 tonynoriega 3:49 pm Feb 23, 2009
Can't succeed in blocking directories in robots txt
The paths are already in robots txt but google still crawles those pages.
6 stephang 6:27 am Feb 18, 2009
Disallowing Any Link with a Question Mark in it?
What is the correct way to do this. Is this the best approach?
11 bouncybunny 9:28 am Feb 16, 2009
Permanent 301 redirect to new domain name
Permanent 301 redirect to new domain name
16 Farhan 1:13 am Feb 16, 2009
robots and link page
1 bode 4:46 pm Feb 15, 2009
XML Sitemap for Blog
How to create it?
2 vicky 11:57 pm Feb 12, 2009
GSite Crawler
Soft Plus GsiteCrawler compile the correct format for xml
2 Gemini23 12:16 pm Feb 9, 2009
Correct way to exclude all dynamic pages under one url?
3 jackgordon 8:55 pm Feb 7, 2009
Duplicate content and NO INDEX
duplicate web content
3 Dezblanco 4:05 pm Feb 6, 2009
Did I invent these meta tags or are they official?
Odd that many sites now use these tags...
2 Ducki 10:45 am Feb 6, 2009
Wordpress sitemap widget
wordpress, widgets,seo
5 Manfred 1:49 pm Feb 4, 2009
Automatic 301 redirect generator for htaccess?
site directory changes - many files need moving
3 pgp566 3:36 pm Feb 2, 2009
Meta Keywords
How to write it?
3 vicky 12:29 pm Jan 28, 2009
Index page text not being indexed
7 millsy007 11:44 am Jan 20, 2009
Help with robots.txt
2 rbecking 12:07 am Jan 20, 2009
Sitemap and Robots File
If both have same entry
5 vicky 6:32 am Jan 19, 2009
Keywords in URL
The best way to write URL's to include keywords
3 calummacd 3:22 pm Jan 16, 2009
Global "no follow" and discretionary "follow"
2 dummiped 2:34 pm Jan 15, 2009
static mod rewritten URLS Vs. Physical Path in robots.txt
Robots.txt static and dynamic urls
2 frogz 9:52 am Jan 14, 2009

Featured Threads

Hot Threads This Week

Hot Threads This Month