I can only generate .XML sitemap through plugins?

[mintu]

I want to generate an XML sitemap for my website. Since my website's CMS is custom PHP and the blog's CMS is Wordpress. Here is my website provided below:

<snip>

My problem is that I am not able to generate an XML sitemap for my blog through the xml-sitemaps tools. I do not understand what's the reason behind that. Since my website blog's CMS is WordPress, I have installed Yoast plugin where I can generate the sitemap for the blog.

I do not want to generate sitemap through Yoast or manually especially blog pages. There are more than 250 blogs have published on my website. I would like to generate sitemap through xml-sitemaps tools. Will it be possible to generate any other online tools? Why I am not able to generate blog's sitemap? Any Idea?

One more thing when I run the audit on SEMRUSH, SEO Powersuit, SF. There are almost 400 pages and blogs on my website. But Semrush bot has only crawled 54 pages as well as SF and Powersuit.

I did not do nofollow, noindex on meta, robots or any other areas and there are no broken links present on the website.

Can anybody please tell me, what is the problem? why my website crawls only 54 pages instead of 400 pages and how can I fix those issues?

[edited by: not2easy at 4:13 pm (utc) on Feb 3, 2020]
[edit reason] Please no specific urls [/edit]

[not2easy]

If your CMS is WordPress you should rely on Yoast's plugin or another such plugin for your sitemap because it is built around the URL syntax of WordPress. There may easily be 400 URLs on a WordPress site but only 54 actual "pages". WordPress creates many ways to see the same content and the use of Tags can multiply URLs exponentially. Yoast's sitemaps understand the taxonomy of WordPress and can list only one version to help you avoid duplicate content problems. The plugin can also add canonical metadata to help bots understand which is your preferred version (whether they agree or not).

There are more than 250 blogs have published on my website.

I am not sure what is meant by this statement. Are you referring to posts as 'blogs'? If your posts are not showing on your sitemaps you just need to select that option within Yoast's settings. Non-WP sitemap generation software may not recognize posts as sitemap entities.

[mintu]

Yes, I am talking about POSTS in my blog.
<snip>
<snip>

I have installed Yoast plugin on my blog and yoast itself generates a sitemap for 400 pages and blog posts. My Problem is why can't I generate xml sitemap through xml-sitemaps.com or other third-party tools? One more thing when I run an audit on SEO Power suit, SF, SEMRUSH, all the blog's posts are treating as ORPHAN PAGES on SERP. I do not understand why have the issues been occurred? I have done interlinking one blog's post to another, added categories, tags, etc. but I am unable to fix this problem. Can anybody please help me to solve this problem?

[edited by: not2easy at 1:12 pm (utc) on Feb 3, 2020]
[edit reason] Please see ToS [webmasterworld.com] [/edit]

[not2easy]

WordPress pages do not exist as physically crawled pages the same way that static html pages can be crawled. They exist only as parts of .sql tables and many of the URLs used in WordPress do not exist until they are generated by search terms. If you are using WordPress to display your content, you need tools that are made to do the job on a WordPress site.

It is because you may see an URL such as http://www.example.com/category/page-about-something/ on a WordPress site but there is no directory on that site called /category/ where the /page-about-something is found/ if you try to find it. A plugin like Yoast has access to your .sql tables and can find the information because it was built to do that.

[mintu]

Thank you for sharing your feedback. Yes, I want to display my content and which tools will work to make the job? How can I fix ORPHAN PAGES on my website? Any Idea?

[not2easy]

You probably have no orphan pages if you are getting that information from tools not made for WordPress. Those are pages that only exist when generated by search terms. You do not want all those versions of the same content to show up in your sitemaps, they are only optional ways to find your content. Google understands that WP sites have these "pages" but they do not index the same content under multiple URLs. Yoast lets you decide which way you want them indexed and lists only one version on your sitemaps.