Forum Moderated by: goodroi
Using a robots.txt is all part of being a good SEO.
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| The sitemap is readable, but has errors |
2 | akincikurye | 10:04 pm Apr 1, 2022 | ||||
| Podcast discussion: past, present, and future of robots.txt |
1 | engine | 11:31 am Dec 29, 2021 | ||||
| Coverage: Submitted URL marked ‘noindex’ |
6 | seemasharma | 3:41 am Dec 24, 2021 | ||||
| More of an experiment but here it goes.. |
9 | blend27 | 4:12 pm Dec 9, 2021 | ||||
| Robots.txt Protocol Directive Order |
5 | WebOpz | 2:34 am Jun 15, 2021 | ||||
| Updates to Google's Work on Advanced Robots.txt |
5 | engine | 8:28 pm May 2, 2021 | ||||
| Getting images indexed Using Highslide gets thumbs indexed instead of main images |
9 | JWJonline | 9:50 am Apr 25, 2021 | ||||
| Sitemap index.xml or Sitemap.xml? |
2 | Pooja | 1:43 pm Mar 24, 2021 | ||||
| Domain rebrand dilemma - please advise |
4 | Unknown_Man | 1:54 am Feb 3, 2021 | ||||
| Google Sitemap Generator Not Working With Python 3 And is a sitemap really needed these days? |
3 | Frank_Rizzo | 1:24 pm Feb 2, 2021 | ||||
| Block crawling of parameterized duplicate content Help with setting up properly block crawl of specific URL Parameters |
9 | Nosuchthing | 9:15 pm Jan 7, 2021 | ||||
| Remove unwanted and already indexed pages from google search result |
11 | anthonyinit | 2:09 am Dec 20, 2020 | ||||
| I want to disallow languages in my robot.txt disallow languages in robot.txt |
5 | anthonyinit | 4:12 am Dec 11, 2020 | ||||
| Has Google changed their approach to robots.txt? Aside from the recent indexing change. |
8 | dennisjensen | 4:50 pm Oct 26, 2020 | ||||
| Snippet still showing on search! Cached snippet |
14 | sulainis98 | 7:46 am Jun 9, 2020 | ||||
| sitemap and broken pages. |
11 | jediviper | 7:49 pm Apr 24, 2020 | ||||
| 2 different language domains. Google indexing |
3 | sulainis98 | 7:21 pm Apr 22, 2020 | ||||
| Search Console coverage shows only 'not submitted' |
3 | 1script | 2:58 am Apr 21, 2020 | ||||
| Google Search Console - Coverage errors |
5 | maverick27 | 5:11 am Apr 9, 2020 | ||||
| Thousands of New Pages Daily Dynamic website crawling |
7 | placedigit | 5:13 am Dec 5, 2019 | ||||
| meta tags <head></head> |
12 | testalba | 8:22 am Oct 15, 2019 | ||||
| Mistake in robots.txt during a site merge, caused a big drop |
4 | Christian_Evensen | 11:10 pm Sep 24, 2019 | ||||
| Sitemap in different languages |
2 | testalba | 2:12 pm Sep 16, 2019 | ||||
| Sitemap Creation |
9 | new_seo | 7:08 am Sep 16, 2019 | ||||
| Block Only Yandex Bot Know the command of how block only yandex bot on robots,txt file |
5 | nehasurya | 5:15 am Aug 29, 2019 |
