homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

How quickly is Google indexing new sites?
Is it quicker since Dominic?

 6:09 pm on Jun 26, 2003 (gmt 0)

Has anyone had a new site indexed by Google since the major changes have taken place? I just went live with a brand new site on Monday. By Monday evening it had five PR5 sites linking to it. I plan to use this as sort of a "test" to see how quickly Google finds and ranks it. As of today it's still showing an all-white PR on the toolbar. Does anyone have any insight to share?



 8:15 pm on Jun 26, 2003 (gmt 0)


I released a new site a few weeks back. Google crawled the site very quickly, and I began to get referrals from Google within about 2-3 days! (albeit not many). This is a pleasant suprise compared with some previous efforts that have taken much longer

However the initial PR seemed to take longer. Despite having a few good inbound links (PR6 et al), it seems to have only picked up one of the links. Nearly 3 weeks have passed and the PR still remains a lowly 2.

So don't hold your breath.


 8:40 pm on Jun 26, 2003 (gmt 0)


I released a new project at Sunday and got some back links (PR4-5) since than. Googlebot visited the homepage today (Thursday) the first time. I expect the site to appear in the SERPs within the next few days. The PR on the Toolbar will probably remain white for a few weeks.



 11:04 pm on Jun 26, 2003 (gmt 0)

I have been having problems with getting spidered. I released a couple new sites. One nearly a month ago (which actually already has a DMOZ listing) that got hit by gbot once, and not since. I have it linked from my homepage which used to be enough to get the spider to index new sites. This site got one page (the homepage) indexed, but no others. Is "index, follow" a necessity? I have never used it on other sites.

The second site was linked from my mainpage about three weeks ago, and has not seen gbot once yet.

I'm startin' to worry a little.....and thinking I picked a bad time to release my pages. I even went as far as to do the "add url" today at g which I've never had to do before. I'll let ya know how it turns out. Anyone else having any trouble?


 2:52 am on Jun 27, 2003 (gmt 0)

Dont worry, your not the only one. My new site, 2 weeks old, has had 3 hits from Gbot, only took the robots.txt file and index page.

There is another thread on this subject here -



 5:57 am on Jun 27, 2003 (gmt 0)

Let us know how it works out, birdstuff..


 7:01 am on Jun 27, 2003 (gmt 0)


I just want to update my earlier post here. My site is now in the Google index. It took one day since the first Googlebot visit. Everything seems alright with Google. No unusual behavior so far.

I keep my fingers crossed for you, birdstuff :)



 7:17 am on Jun 27, 2003 (gmt 0)

Ugh .. I have had no success on getting two of my sites indexed ... came out about 3 weeks ago, and have decent PR5 and PR6 links [dmoz, yahoo, mine own].

Not even a SINGLE sniff!

While my other sites continue to get thousands of visits in this same time [and which a couple link to these two sites too].


 10:46 am on Jun 27, 2003 (gmt 0)

<Let us know how it works out, birdstuff.. GoogleGuy

I think Google are using Webmasterworld members as Guinea Pigs just like Gates does. Release something new and let everyone else tell you what needs fixing.


 11:02 am on Jun 27, 2003 (gmt 0)

...and if we were all really evil we could through a few spanners in the works:)


 12:43 pm on Jun 27, 2003 (gmt 0)

Well, Google still hasn't indexed the new site, but All The Web and Alta Vista have. Interesting.


 3:53 pm on Jun 27, 2003 (gmt 0)

>I think Google are using Webmasterworld members as Guinea Pigs

Ever wonder why Googleguy has such easy access to spam reports?

Food for thought.


 3:57 pm on Jun 27, 2003 (gmt 0)


Regular users don't search on www-XX.

Just a hint for the clueless. To the experienced ones this may be old knowledge.


 4:19 pm on Jun 27, 2003 (gmt 0)


i started my site about 3 weeks ago and i still had no visit by gbot, neither other bots checked it yet.

did i do something wrong? i dont know why im still not in the index. i made the /addurl at google about two times already. and still no visit.

anyone know whats wrong?
my site is at <snip>

maybe someone finds something in the sourcecode.

thx for help


[edited by: Woz at 1:33 am (utc) on June 28, 2003]
[edit reason] no Self URLs please, TOS#13 [/edit]


 4:47 pm on Jun 27, 2003 (gmt 0)


Try using the web site to determine your problems:



 5:16 pm on Jun 27, 2003 (gmt 0)

Warning: long post ahead (But I think it’s worth it.)

I recently created a new site for a local political party. I did all of the usual stuff: got good backlinks from sites with PR ranging from PR5 to PR8, got listed in DMOZ, even got listed with Yahoo (!) (that's another thread in itself...) Put in a site map. Was promptly spidered by Alta Vista.

But zip from Google.

Finally, I tried "submit URL". Eventually, I got the briefest "peck on the cheek" from the googlebots. I discovered that the only file they requested was "robots.txt" and they got an error--- because I didn't have one.

I read through everything that I could find about robots.txt on the Google webmaster info area, did some research and wrote one. [Now I have one on all of my sites- a very interesting exercise. I’ll see if it makes a difference or not. ]Then I sent a query to Google support asking if I was on the right track.

Whereupon, I promptly got a visit from the bot that has been discussed here several times: "216-239-45-4.google.com." Then I got back a note from Google support about the robots.txt file. [That response is another thread in itself,- but I digress.]

Since then, we've gotten "shallow" visits from the crawl10 and crawl11 Googlebots. Our index page is listed... sort of.. .sometimes... depending on which data center I try and what time it is. Still "white bar" on toolbar. Still no backlinks showing.

It doesn’t appear as if any other pages have been crawled or (obviously) added to the index.

Four discoveries:

1. My two best backlinks don’t count because they are in “jump menus” instead of straight HTML links. Drat! Very high PR legitimate non-SPAM state and national organizations, but Google doesn’t count their links toward PR. This also happens to the Widgets for Humanity site that I do.

2. The Google toolbar does, in fact, report what URLs we visit. I believe that those reports have become a new “secret ingredient” in Google’s ranking system. Go back and look at exactly what the Google people have said about that issue. It’s a “non-denial denial.”

3. Google picked up the “description” meta tag and made it the first line of our entry.

4. Gotta have content. Right now I'm only looking for the search term "local+county+goodguys+party." Building a new site is a process, not an event.

So in response to the original question posed by this thread:

In my case, creating a non-commercial site, I think that it was (and is) MUCH harder and more time consuming to get listed. My one word description of Google: erratic.

[edited by: Fearless at 5:23 pm (utc) on June 27, 2003]


 5:21 pm on Jun 27, 2003 (gmt 0)

I'm assuming the "goodguys" party is Republican. ;)



 6:04 pm on Jun 27, 2003 (gmt 0)


You list your point about Google using the toolbar info. in ranking as a discovery. Don't you mean theory?


 6:52 pm on Jun 27, 2003 (gmt 0)

FYI and a little frustrations venting......

(abstract; site added to index in 4 days and then old index is brought back with no new pages)

Just relaunched a site last week with a nice clean new directory structure.

I was doing some related research on G when low and behold, the site pops up at #3 under a keyphrase with the new pages 4 days after launch.

I'm happy, pleased, doing the joy dance around my computer.

I tell my contact at the client. She sees it, does her version of the Joy dance (not nearly as graceful as mine of course) She tells her boss, the boss sees it and does the joy dance.

She then sends out an email to the whole company and what happens?

Google reverts to the old, pre launch index and we're all trying to explain to non webbys about the Google dance.

I should know better by now.....


 6:57 pm on Jun 27, 2003 (gmt 0)

A week ago I created a very small non-commercial personal site for someone. Soon as the DNS kicked in (its own domain name), I uploaded the pages. Put up a few links to it from other sites the guy has. Three days later it's standing tall in Google. Works.


 7:07 pm on Jun 27, 2003 (gmt 0)

Well, FWIW, last Saturday - 6/21/03 I went live with a one page wonder. By Tuesday, 6/24, it brought in its first sale and was well ranked (#12) on Google for its top keywords. Today, its ranked #10.

Love that Freshie!


 7:28 pm on Jun 27, 2003 (gmt 0)

A new site I think I moved online around mid-June has been dropping in and out of the index for the last week. It has been mostly in the index the last couple of days and has started making sales this week.

It has links from 9 other sites, ranging from PR5s (a couple were PR6s until recently) to PR3s.

It is showing PR0 and no backlinks, but the general rankings seem pretty good in Google, for now anyway.

It will be interesting to see when the backlinks will start showing, since normally that would have been after the monthly update.


 7:53 pm on Jun 27, 2003 (gmt 0)

I have had the same problems as Fearless [except for the non-followed link]

Yahoo, Dmoz, and all the hubs have linked to it ... even the game's official site! [its a non-commercial site]. Not even a SINGLE request :/


 8:37 pm on Jun 27, 2003 (gmt 0)

I'm assuming the "goodguys" party is Republican. ;)

Sure..... if by that you mean Gerry Adams and Sinn Fein.


 11:52 pm on Jun 27, 2003 (gmt 0)

I've had a site online for 6 weeks now and google has only spidered the index page. This new freshdeep bot isn't very deep. Many new sites are just not being included.


 7:11 am on Jun 28, 2003 (gmt 0)

Not too sure what to think of this one:
Started working on my first ever php site (slow and painful). After two weeks i linked it from 1(one) PR4 site, gbot hit almost immediately cruising 40 pages. Now two weeks later I've got 6 pages of SERPs indexed. I haven't lifted a finger to promote, because it's not ready...ah well guess it is now!
Considering it took 3-1/2 months to get that fist one indexed, I'd say it WAY faster!


 10:13 am on Jun 29, 2003 (gmt 0)

Oh well fresh is doing it job, uplifted a site Thursday just checked (Sunday) and it's already ranking in the top 3 for my main keywords :)


 1:58 pm on Jun 29, 2003 (gmt 0)

I was really lucky with regards to Google Listing me.

I have been on this forum on and off mainly reading the topics only. I have not experience at all on SEO and was on the midst of even hiring one to optimise my site. Once in a while I would get this email about the Google Dance. My site is not ready, and I submitted. I was not expecting to be listed. But then in 2 weeks, I was all over the place. The problem that I am facing now is that eventhough I am all over the place, I am not getting as many hits as one should be getting if one has 2-3 pages in the top 10.

On the other hand my competitors has got 40 people on his site at any given point in time. Would somebody help me with regards to the keywords that are attracting my visitors to my competitor's site. I have checked all the keywords, with Wordtracker, but is there something else that I am missing here?

Thank you.


 2:13 pm on Jun 29, 2003 (gmt 0)

Things are definately speeding up. Launched a new website last Tuesday. Added some good links, lucked out on a feature on about.com. Fully indexed by Google (only four pages) and no 1 for keyword. Good stuff Google.


 2:30 pm on Jun 29, 2003 (gmt 0)

>Fully indexed by Google (only four pages) and no 1 for keyword. Good stuff Google.

Keep reporting these things to Google soon they'll find a way to stop it....

It's like fishing - you don't catch the big ones yelling everytime fish bite.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved