homepage Welcome to WebmasterWorld Guest from 54.161.191.254
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

    
Crawled But Not Listed?
Google crawls my site, often, but no pages are listed.
rydlar




msg:750760
 2:06 am on Aug 13, 2005 (gmt 0)

Hi all,

Am having a bit of a problem understanding what's going on here. I have a site which has been crawled heavily by all of the 3 major Search Engines. Yahoo & MSN show all of my pages when I do a site:www.mydomain.com in the search box. However, Google shows no pages. Now, I know they've done heavy crawling as I see googlebot in my logs for a great deal of time. Any ideas of why nothing's been indexed yet?

Site is about 3 months old and Googlebot visited pretty early in it's life (and often thereafter).

Thanks in advance,

Darryl

 

flex55




msg:750761
 3:16 pm on Aug 15, 2005 (gmt 0)

Was it G's Mozilla bot or regular bot?

mcavill




msg:750762
 3:36 pm on Aug 15, 2005 (gmt 0)

was it a deleted domain - does archive.org show anything?

rydlar




msg:750763
 4:12 pm on Aug 15, 2005 (gmt 0)

Hi,

It shows a couple of 'This Domain is Parked' pages in the Way Back Machine from March 25, 2004 and April 11, 2004 but nothing else. I've had the domain since about May 2005.

The Google crawl was:

crawl-66-249-66-101.googlebot.com

as listed in my stats. Was on the site 59+ minutes over the past week and several times well before that for about the same time length. I also have a Google Sitemap done up as well.

Thanks for the insight in advance!

Darryl

rydlar




msg:750764
 4:15 pm on Aug 15, 2005 (gmt 0)

Oh one other thing.. and I'm not sure if this is part of the reason.. but the site is hosted at a very large domain hosting company that everyone knows.

I've read somewhere before (I think) that maybe some of this hosting companies IPs get blocked by Google?

bradley phil




msg:750765
 4:59 pm on Aug 15, 2005 (gmt 0)

are you sure that's not an AdSense bot, and you're not actually getting spidered by the main indexing bot (fresh/deep)

rydlar




msg:750766
 5:20 pm on Aug 15, 2005 (gmt 0)

I don't have Adsense running on this site.. so I assume it's not an Adsense bot?

kinda perplexing.. course I've never been able to rank well on G.. but at least my pages on my other sites are listed when I do a site:www.mydomain.com

then again.. maybe it's too early in the game (3 months)?

BigDave




msg:750767
 5:29 pm on Aug 15, 2005 (gmt 0)

It is still a new site. Wait a couple more months. Google is slow at adding new sites to the index.

flex55




msg:750768
 11:51 am on Aug 16, 2005 (gmt 0)

Also, verify that it's G's regular bot that crawls your site and not G's Mozilla bot. Mozilla bot is know not to get pages into the index.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved