It was not very helpful to me because it included urls that were 301 redirected to other pages.
If I go to "Health" -> "Index Status" -> "Advanced", I can see "Total Indexed", "Ever Crawled", "Blocked by robots.txt", and "Removed". For me the "not selected" appears to be the difference between the "Ever Crawled" and "Total Indexed".
I'd still like to see separate lines on the graph for redirects and crawl errors.
The not indexed pages now appears as once crawled.
However this is very strange as I had an issue with pages that didn´t exist, and the other day I had about 54.000 not selected pages, and not sure but maybe 3000 crawled pages sometimes, and now I have 55.000 pages that been crawled sometime.....
|For me the "not selected" appears to be the difference between the "Ever Crawled" and "Total Indexed". |
You would think so but it isn't. If you've got access to any of your old graphs, do the arithmetic. Just recently I noted a hiccup where Not Selected changed by one number and Total Indexed changed by a different number (don't remember the details, but I mentioned it in another thread) with no corresponding change in Ever Crawled-- so I'm left with a statistically meaningful number of pages that simply disappeared.
I have to agree with @lucy24; for our largest site the "Ever Crawled" total is 3 times the actual number of in-site pages and must include ANY and ALL URLs crawled including 404 bunk links created by competitors. "Not Selected" pages added with "Total Indexed" is about 7000 pages short compared to the last "Ever Crawled" recorded.
Currently, less than 30 are listed under "Blocked by robots" and none under "Removed".
|The not indexed pages now appears as once crawled. |
This is certainly not true in my case. Both very distinct values.
I dont qet it,
I dont have any ever crawled, I have indexed, crawled sometimes, blocked by robot and eliminated pages.
"Crawled sometimes"? In English? What you call "eliminated" is called "removed" on my version of the page.
If g### is calling things by different names in different places-- you're in Spain, right? --I think we would all like to hear about it.
I just took another quick look on the way to checking something else in wmt. Detour to non-canonical form of site name reveals fascinatingly that Total Indexed is the same number both ways-- but "blocked by robots.txt" is zero on the non-canonical side.
What will they think of next.
Yes I am in spain, and this is what I have in spanish for advanced :
Rastreadas alguna vez
Páginas bloqueadas por robots
Wich I translate as,
Pages bloqued by robots
The strange is that I had as you know a lot of excluded pages, however crawled sometime was not a high number, now I have the amount of excluded pages and even higer in crawled sometime.
I have 85.447 crawled sometime and excluded pages does not exist anymore.
:: whew ::
It's the same thing, we're just translating differently.
"alguna vez" = at some time or other = ever (crawled)
eliminadas = gosh, it is hard not to translate that as "eliminated" isn't it ;)
I had to go consult the dictionary on rastrear. It sure sounds more emphatic than the English word "crawl".
|eliminadas = gosh, it is hard not to translate that as "eliminated" isn't it ;) |
Sort of unnatural :)