Welcome to WebmasterWorld Guest from 54.92.148.165

Forum Moderated by: goodroi

Sitemaps, Meta Data, and robots.txt


Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
Thread SubjectMessagesStarted byLast Message
Google No Longer Supports Noindex, Nofollow and Crawl-Delay in Robots.txt
10 engine 9:58 am Jul 8, 2019
Google Submits Formal Robots Exclusion Protocol to IETF
5 engine 10:20 pm Jul 2, 2019
Domain redirect & robots Disallow
8 BlaxEye 6:17 pm Jun 5, 2019
One Site One Schema?
What is the appropriate Schema for a website when the website has multiple
3 tzgordon 4:55 pm Apr 12, 2019
Google search console & sitemaps
1 shadowlight 6:46 pm Mar 13, 2019
Topmenu in JS or html
Is JS an option at all
11 dennisjensen 7:00 am Jan 10, 2019
Canonical for HTTPS site pointing toward HTTP
Is this a problem?
5 TomSnow 1:11 am Jan 9, 2019
Which is loaded first, robots.txt or htaccess?
Hiding a test site from bots, can both be deployed?
13 dennisjensen 9:18 am Nov 20, 2018
Canonical of Site Root
Lighthouse Error?
6 IanTurner 8:49 am Nov 10, 2018
Robots.txt code format.
13 born2run 7:24 pm Oct 10, 2018
User-agent: Mediapartners-Google Disallow
4 Tom1961 9:07 am Sep 21, 2018
robots.txt now deletes archive.org wayback machine
18 tangor 5:59 pm Sep 19, 2018
robots.txt using host: and config for cdn
10 Milchan 7:25 pm Aug 29, 2018
Disallowing a specific Bot using Robots.txt
10 lucy24 7:21 pm May 16, 2018
mobile friendly checker finding phantom robots.txt
3 kvetina 4:23 pm May 3, 2018
What Makes a Good robots.txt File?
14 Broaster 9:20 pm Apr 23, 2018
Meta Tags in SERPs
7 John134 10:30 am Apr 11, 2018
Google News indexing issues
Google News indexing issues
3 Robbo55 2:26 pm Mar 26, 2018
Regarding question on sitemaps and http to https
3 Boulos 2:51 am Mar 22, 2018
Structured Data Mark Up
Need to know which mark up data for the website
7 Irfan_Ansari 1:14 pm Feb 20, 2018
Robots.txt Guidance
Need to Correct Answer or Solution for My Query
11 Irfan_Ansari 7:24 am Feb 20, 2018
Deleted old articles so now have to update sitemap?
3 born2run 4:01 am Feb 18, 2018
move to https and sitemaps
10 fatpeter 11:18 am Jan 23, 2018
“google sent me”
5 lucy24 7:27 pm Jan 12, 2018
New "Well-Known Uniform Resource Identifiers"
Well-Known Uniform Resource Identifiers are defined in RFC-5785
5 Andova_Begarin 6:19 pm Dec 8, 2017