Getting freshbot to see my new pages

Doesn't want to find them and I've done all I can do!

[askjoe]

I've added several new pages to my site, updated the content on my homepage, and added new links - all about a week + ago. How do I get freshbot to come to my site and spider these pages - as far as I know I've done everything I can do - unless you guys have anymore tips.

I always here in this forum of guys who add new pages to their sites and 2-3 days later they're found within google -what are you guys doing to make this happen!?

Thanks for the replies,

Askjoe

[netguy]

AskJoe... you didn't mention the PR value of your home page, but on our PR5s and PR6s, we generally see Freshbot visit us every day to update whatever links are coming from our home page. (Google just follows the links and adds the new pages to their index).

Except for a few 'burps' during the month, new pages are typically grabbed overnight, and the new pages can be found in Google by the next afternoon.

The key question is whether you have log info to determine if 'Freshie' is visiting your homepage now - and if so, I haven't a clue why it wouldn't follow through to your new information.

Steve

[decaff]

askjoe,

I think that netguy has definitely got this hard wired, for the most part. I will say, however, that even if you don't have page rank currently calculated because your site is relatively new and Google has completed it's complete inclusion cycle:
* you build the site, hopefully get some quality incoming links from sites that are already indexed by Google and showing up in the SERPs or if you are lucky and all lines up you get listed in DMOZ and Google finds you that way
* then you will typically see freshbot briefly and you may see some very short term rankings with no stability
* then you site seems to disappear for at least one update cycle (30 - 40 days), then deep bot comes through and crawls your site and your pages actually make it into the index...check with allinurl:www.yourdomain.com...
* now you have to wait at least one more up date cycle for Google to calulate your PR and once this happens and if you happen to hit PR5 or above then freshbot is more inclined to visit you site on a daily basis..

However, on the flip side...if you site made it in and was found from a high-value link relationship and you happen to show stable SERPs from the get go (as was the case with one of our sites)...then all you have to do is continue to solicit incomings and continue update you sites content on "almost" a daily basis (AND I mean real content update...remember...Google is working to create the best value for "THEIR" user audience and they want "REAL" fresh content that adds real value to the process..don't get caught up in the game of just adding lines to you pages and then deleting them just to show time stamp changes...this will backfire)...

NOTE: Google favors dynamic, adjusted content so you may need to work this every day until you see freshbot...
(in you logs look for this initial IP number 64.68....and deep crawl is 216.239...)

Keep at it...things will happen for you...and make sure you are abiding by Google's TOS...this is always a good idea..

decaff

[askjoe]

Thanks for the imput - the particular site in question is about 2 months old. I have a link in dmoz and all that good stuff - I still try to trade links on a daily basis - however, I do not know what my pr is. I would assume it's fairly good because I'm comming in really well for a lot of powerful keywords.

I'll take your tips and apply them to my site - thanks.

Askjoe