Forum Moderated by: goodroi
Using a robots.txt is all part of being a good SEO.
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Sitemaps for large websites and SEO - add everything or just some? Sitemaps for large websites. What is the optimum solution? |
15 | jmccormac | 6:01 pm Apr 13, 2026 | ||||
| my first website, technical issues i cannot solve seo technical issue in a new website |
8 | nnrodrigag | 2:35 pm Oct 1, 2025 | ||||
| Sitemap Hreflang Not In Source Code But In Dev Tools Inspect |
5 | JinKazama | 2:14 pm Jul 15, 2025 | ||||
| Urgent Help Needed |
7 | admk80 | 6:35 pm Jul 2, 2025 | ||||
| Can multiple canonical tags on a page cause SEO issues? |
6 | marcustaylor | 11:26 am Apr 29, 2025 | ||||
| Can you specify multiple user-agents before a single Disallow? |
1 | stephen22 | 9:54 pm Oct 24, 2024 | ||||
| Is it possible to no-index supplemental pages? |
5 | Gemini23 | 3:56 pm Jul 1, 2024 | ||||
| Do I need a HTML Sitemap Is html sitemap important and how it will help in seo rankings. |
4 | King_of_Snakes | 11:53 am Jun 5, 2024 | ||||
| Do I Need an Image Sitemap? |
7 | Hary_Singh | 7:02 am May 8, 2024 | ||||
| Google Search Console news sitemap issue. |
2 | Jullia_Jhon | 12:27 pm Oct 9, 2023 | ||||
| GPTBot and ChatGPT-User Blocking and Control Using robots.txt |
2 | engine | 1:14 pm Sep 29, 2023 | ||||
| Google Crawler Control in Robots.txt For Bard Training |
1 | engine | 11:02 am Sep 29, 2023 | ||||
| Site map for Large website |
7 | Sanjaya87 | 11:19 am Sep 5, 2023 | ||||
| Google Search Console news sitemap error Error parsing news sitemap |
13 | Francesc_Invernon | 9:50 pm Mar 17, 2023 | ||||
| Search Console: Trying to find out number of pages of a domain . |
16 | Pepper82 | 5:29 pm Jan 22, 2023 | ||||
| sitemap.xml vs sitemaps.xml vs sitemap.txt vs sitemap index.xml why is bingbot asking for all of those? |
10 | SumGuy | 10:20 am Jan 9, 2023 | ||||
| A tool that tells me how many levels deep the links are on my site ? is there a software tool that scans how deep my site is? |
2 | Ben_Sunde | 3:09 am Nov 27, 2022 | ||||
| Reindexing problem |
10 | chainazo | 6:18 pm Oct 7, 2022 | ||||
| Re-Crawling stopped. Before daily basis |
6 | Treud | 7:41 am Oct 5, 2022 | ||||
| What is the consequence of blocking a website through robots.txt ? |
6 | guyaftab001 | 9:01 pm Sep 15, 2022 | ||||
| Does sitemap.xml format require spaces be replaced with %20 ? Bing Webmaster Tools sitemap processing |
9 | SumGuy | 4:54 pm Aug 20, 2022 | ||||
| Not Seeing Optimized Meta Tags in Shopify or Google SERPs Meta Tags Not Being Shown (for any page) |
2 | westcoaster | 4:24 am Aug 14, 2022 | ||||
| Never will show stars on serp? |
6 | chainazo | 4:57 am Aug 3, 2022 | ||||
| Robots.txt is set up correctly but GSC not crawling? |
10 | wickles | 10:30 pm Jul 20, 2022 | ||||
| Symbols in Robots.txt Meaning of the symbols in robots.txt |
12 | elvang | 7:45 am Apr 13, 2022 |
