Forum Moderators: open
Googlebot/2.1 has visited my domain a couple of times and accessed ~100 pages in total. (The domain is a USED one I picked up 2 weeks ago because of the good incoming links it has) The earliest Googlebot/2.1 visits are more than a week ago but still if I look to see if Google has any pages cashed nothing shows up (site:mydomain.com - did not match any documents.)
- Could it be that the domain has a penalty of some kind.
- IF there is a penalty > Doesn’t it mean that Googlebot/2.1 wouldn't come to the domain at all
- What could be causing Google to have NO INDEXED PAGES of my site even after I see in the logs that the GoogleBot got the pages that he asked for HTTP/1.0” 200?
Being included in the index isn't instantaneous when she crawls. And now even when sites are first indexed they're taking a while to rank for keywords.
It it was an expired domain the slate gets wiped clean; for all practical purposes, this is a new site - just give it time.
If you want to see if there's a history behind the site look up the Wayback Machine.
Just think of the additional programming required.
if ($domain-has-ever-expired)
{
foreach $backlink @backlinks
{
&find-time-link-was-put-on-page;
if ($link-creation-time "is after" $expiry-date)
{
&count-link;
}
}
}
------
Doesn't seem like much, but think of all the additional data that would need to be stored for each and every link on the internet in order for this done. They would essentially need parse every single page ever at multiple points in time - which automatically bumps up their database size by about 300 times.
Doesn't seem like the time that would be required to execute this type of function would have the kind of benefits worth the time.
Just storing the last expiry date alone for each domain would take hundreds of gigabytes of data that would need to be parsed.
Googlebot/2.1 visits on regular bases:
(hits+hits-on-robots.txt) 224+32 7.14 MB (Lasts visit 30 May 2004 - 09:08)
At the same time looking for cashed pages at Google produces - did not match any documents. NO cashed pages.
I have a couple of domains that have a Google penalty. On these domains I NEVER see Googlebot/2.1 and the same NO cashed pages, but I have never before seen regular visists from Google and no cashed....
What could be causing this.