Welcome to WebmasterWorld Guest from 18.104.22.168
Forum Moderators: open
I run multiple websites, and all of them are listed in my "companies" portfolio. This portfolio get's spidered almost daily, so each new link I add will be visited by googlebot almost instantly. Then, after a few days, Googlebot will actually start indexing the subpages on this new domain as well.
However, I have one domain where this does not work for some reason. I have added it to my portfolio, waited for a while, but googlebot didn't even visit the new domain, eventhough it did visit my portfolio. Then I added a few links from other sites to this domain, but still a no-go.
Finally, I manually submitted the domain to google. And yes! Googlebot visited! However, it only hit 4 pages (where there are a lot more), and doesn't seem to be coming back... It has been quite a while now, so I am getting frustrated.
The only difference between this site/domain and the others I have launched, is the fact that this domain used to belong to another owner. It has been offline for quite a while as well. Then I took over and built a new site, which is not indexed like I wrote.
Any ideas on how this is caused? Any ideas on what I can do?
Have you checked archive.org to see if the old site was somehow dodgy? It may still have a penalty.
I looked at a couple of things for the site that isn't doing anything. It is about 6 months old and as far as I know, I'm not doing anything ungooglelike.
I took a closer look at the august and sept logs and it appears that their is only one googlebot entry. (when I look at the logs from a site hosted elsewhere, I see hundreds of googlebot hits)
If I do a site:www.mysite.com -aasdasdas I see that only some of the listings are cached. The cache date is Aug 24. If I look at the log file, I would expect to have seen the googlebot in the august logs but it isn't there. If I look at July, I don't see googlebot there either (i do see the msnbot and a few others.)
I ran some robots.txt validators and robots.txt seems ok.
I tried the poodle predictor and that looks OK also.
I have a robots all,follow, index tag in all of the pages.
I did some google searches with my hostname to see if anyone else was complaining but didn't find anything.
Anyway, I'm a bit of a google novice. Here are a couple of questions
1. I'm assuming that not seeing the googlebot is really bad. Is this correct?
2. I tried a couple of sites where you could fake out the agent to see how the site reacts to the googlebot and I don't see any problems. Any suggests for sites to check my site out?
3. I'm not sure if it's within the TOS of this board to post a question about a specific host. I'd appreciate any thoughts on this.
I'd appreciate any ideas
This could indeed explain it. If it was dupe content it got neglected in favor for the higher PR site. If it was a 301, does Googlebot stop visiting them at all? Or just look every while?
How long have you been waiting?