Welcome to WebmasterWorld Guest from 54.162.141.212

Forum Moderated by: goodroi

Sitemaps, Meta Data, and robots.txt


Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
Thread SubjectMessagesStarted byLast Message
Sitemaps Generator on Large Site
Could this cause problems?
5 CWebguy 6:23 pm Feb 27, 2009
vspider not adhereing to robots.txt
6 tonynoriega 11:07 pm Feb 26, 2009
block dynamic urls with product options using robots.txt?
How do I?
2 circusboy 3:53 pm Feb 24, 2009
why use a robots.txt
17 tonynoriega 3:49 pm Feb 23, 2009
Can't succeed in blocking directories in robots txt
The paths are already in robots txt but google still crawles those pages.
6 stephang 6:27 am Feb 18, 2009
Disallowing Any Link with a Question Mark in it?
What is the correct way to do this. Is this the best approach?
11 bouncybunny 9:28 am Feb 16, 2009
Permanent 301 redirect to new domain name
Permanent 301 redirect to new domain name
16 Farhan 1:13 am Feb 16, 2009
robots and link page
1 bode 4:46 pm Feb 15, 2009
XML Sitemap for Blog
How to create it?
2 vicky 11:57 pm Feb 12, 2009
GSite Crawler
Soft Plus GsiteCrawler compile the correct format for xml
2 Gemini23 12:16 pm Feb 9, 2009
Correct way to exclude all dynamic pages under one url?
3 jackgordon 8:55 pm Feb 7, 2009
Duplicate content and NO INDEX
duplicate web content
3 Dezblanco 4:05 pm Feb 6, 2009
Did I invent these meta tags or are they official?
Odd that many sites now use these tags...
2 Ducki 10:45 am Feb 6, 2009
Wordpress sitemap widget
wordpress, widgets,seo
5 Manfred 1:49 pm Feb 4, 2009
Automatic 301 redirect generator for htaccess?
site directory changes - many files need moving
3 pgp566 3:36 pm Feb 2, 2009
Meta Keywords
How to write it?
3 vicky 12:29 pm Jan 28, 2009
Index page text not being indexed
7 millsy007 11:44 am Jan 20, 2009
Help with robots.txt
2 rbecking 12:07 am Jan 20, 2009
Sitemap and Robots File
If both have same entry
5 vicky 6:32 am Jan 19, 2009
Keywords in URL
The best way to write URL's to include keywords
3 calummacd 3:22 pm Jan 16, 2009
Global "no follow" and discretionary "follow"
2 dummiped 2:34 pm Jan 15, 2009
static mod rewritten URLS Vs. Physical Path in robots.txt
Robots.txt static and dynamic urls
2 frogz 9:52 am Jan 14, 2009
sitemap entry in other domain's robots.txt?
4 vicky 2:24 pm Jan 13, 2009
site maps
2 Mr_Cat 3:10 pm Jan 12, 2009
I need information on XML and Html sitemaps
I do have question regards site map
2 mick_simon 2:51 pm Jan 12, 2009

Featured Threads

Hot Threads This Week

Hot Threads This Month