Welcome to WebmasterWorld Guest from 188.8.131.52 , register , free tools , login , search , pro membership , help , library , announcements , recent posts , open posts Become a Pro Member
Crawled But Not Listed? Google crawls my site, often, but no pages are listed. rydlar
Am having a bit of a problem understanding what's going on here. I have a site which has been crawled heavily by all of the 3 major Search Engines. Yahoo & MSN show all of my pages when I do a site:www.mydomain.com in the search box. However, Google shows no pages. Now, I know they've done heavy crawling as I see googlebot in my logs for a great deal of time. Any ideas of why nothing's been indexed yet?
Site is about 3 months old and Googlebot visited pretty early in it's life (and often thereafter).
Thanks in advance,
Was it G's Mozilla bot or regular bot? mcavill
was it a deleted domain - does archive.org show anything? rydlar
It shows a couple of 'This Domain is Parked' pages in the Way Back Machine from March 25, 2004 and April 11, 2004 but nothing else. I've had the domain since about May 2005.
The Google crawl was:
as listed in my stats. Was on the site 59+ minutes over the past week and several times well before that for about the same time length. I also have a Google Sitemap done up as well.
Thanks for the insight in advance!
Oh one other thing.. and I'm not sure if this is part of the reason.. but the site is hosted at a very large domain hosting company that everyone knows.
I've read somewhere before (I think) that maybe some of this hosting companies IPs get blocked by Google?
are you sure that's not an AdSense bot, and you're not actually getting spidered by the main indexing bot (fresh/deep) rydlar
I don't have Adsense running on this site.. so I assume it's not an Adsense bot?
kinda perplexing.. course I've never been able to rank well on G.. but at least my pages on my other sites are listed when I do a site:www.mydomain.com
then again.. maybe it's too early in the game (3 months)?
It is still a new site. Wait a couple more months. Google is slow at adding new sites to the index. flex55
Also, verify that it's G's regular bot that crawls your site and not G's Mozilla bot. Mozilla bot is know not to get pages into the index.