tedster
msg:4333745 | 5:47 pm on Jul 1, 2011 (gmt 0) |
| the reason old urls with noindex meta tags (when the pages were live) would have been crawled and reported as missing. Do they figure in pagerank calculation anyway? |
|
Yes - noindex pages still circulate PageRank unless the robots meta is also "nofollow". And since the meta tags are on the page itself, the URLs do need to be spidered even thought they are not added to the public index - it's the only way the meat tags can be read and confirmed over time.
|
spadilla
msg:4334333 | 2:47 am on Jul 3, 2011 (gmt 0) |
| it's the only way the meat tags can be read and confirmed over time |
|
Is this a new syntax? Can these tags be found on the deli isle? har har
|
spadilla
msg:4334334 | 2:48 am on Jul 3, 2011 (gmt 0) |
[deleted duplicate post]
Figures I would duplicate post while poking fun lol
|
Hoople
msg:4334494 | 6:37 pm on Jul 3, 2011 (gmt 0) |
Expanded the 404 listings in WMT and see if the referring page is listed. Change/remove the links.
If that link can't be removed 301 it to a page that needs more 'link love' (aka backlinks) so to speak.
|
Sgt_Kickaxe
msg:4334605 | 11:05 pm on Jul 3, 2011 (gmt 0) |
I checked, it says not available across the board. No links to remove.
I'll leave them as 404 as well since that's the correct code for these pages, they don't exist anymore.
I noticed a spike in crawl activity around the same time so I investigated and Google didn't just pull up every page on my site, they tried to fetch all old urls and a bunch of urls that nobody would ever want indexed. ie: core files for wordpress and drupal even though the site isn't likely to be both.
xmlrpc.php was fetched repeatedly but I don't use remote publishing, perhaps a standard security test?
|
|
