Forum Moderators: open
In fact when I first published the site it was with an image of "coming soon" just so I could get a head start. (In retrospect after reading brett's step-by-step guide I shouldn't have done this until the site was complete I know). This page was originally picked up by google, since I've released the completed site, the changes to the base listing have been updated too.
Unfortunately, nothing else is happening.
link:www.widgets.com reveals that no sites are yet linking it
site:www.widgets.com -fssggsfsgdsds shows that only the widgets.com/ is indexed.
I was worried at first that perhaps the domain that I purchased was banned at some point in the past. Normally google picks up my new sites very quickly. Looking at the way back machine there is no record of this site at all.
Is anyone else experiencing long delays? Is this normal? Most importantly is there anything I can do? (I haven't been able to submit to dmoz in the last 3 weeks either)
Thanks,
Chris
From there you can make determinations about timing.
If its not coming at all... The suppossed worst case scenario for google's freshdeepbot to do a deep crawl is 12 wks.
If its coming often but not leaving the homepage.... I'd do a highlight block on your homepage to see if that triggers the frequently visiting bot to dig a little deeper....
As for indexing, I don't have anywhere near 3,500 links from other sites. I went out and got one deep link from a related site that was a PR7. That same day Googlebot came by and grabbed my robots.txt, homepage, and that page. Then he came back with all his relatives a couple days later and indexed the whole thing. Then the pages showed up in the index a couple more days later. I've been slowly growing links but not that many.
If you have PR6 and PR7 sites linked to you, I don't know why he's not jumping over to yours since they're probably getting indexed almost every day. Wild guess. Could it be Google is looking at the number of links you have as being unnatural?
As for your 3500 pages linking to your site.... Are that automatically generated links? All from the same site? Somewhere in the footer or navigation bar?
Be careful...
Thanks for all the responses, I am going to try each of them.
Sorry I should have also been more clear in my post. I should have said "3500 pages" instead of saying 3500 sites. The links are coming from 4 different sites, but the majority of incoming links are from one site (~2500).
As for your 3500 pages linking to your site.... Are that automatically generated links? All from the same site? Somewhere in the footer or navigation bar?
Be careful...
oh oh, is there something I didn't know about that I should have known? No the links are not automatically generated. Most of them are from the same site, but not all of them. Each page on my site I have included 1 text link in the footer of the site. Can you suggest some threads on this wired_suzanne? I wasn't aware that this would be a problem. Am I being investigated as a link farm or something?
I've downloaded my raw access files and google first hit my site on around the 12th, then like bluesky, came back again and did some deep searching. A quick look it would appear that all the pages were hit by googlebot without problems. Very very cool stuff.
Sept 12 - Google first visits and grabs robots.txt & index.php
Sept 13 - Google returns and grabs first link, all associated images, css files, and not much else.
Sept 14-21st - Google crawls the site and picks up various pages.
Sept 22-Currnt - Google just returns and checks robots.txt & newly added content? How it's doing this is beyond me and there are some quirky things that I didn't expect. It's looking at recent searches that were done on my site which I find fantastic! :D.
Very neat looking at the raw log, I'd never done this before. I had no idea how smart these bots were. Googlebot came for a number of visits looking at various pages in an organized manner (right down the order of my navigational links). I guess being a bot is tiring work because googlebot only visited a certain number of pages each day before leaving until the next day where he/she would return and start going from where he/she had left off.
At any rate, I'm going to give it a few days now and see what happens. I'm guessing the indexing of the site is out of googlebots hands and now has to do with how the information gets propogated and stored at google central.
