After Googlebot visits my new pages, what does it do then?

Googlebot visit question

[xerxes]

Hi, I am also out of the lurking stage. Been lurking and learning for many months. Your advice has helped immensely. We hang on page 7 for our keywords. My question is, please: Googlebot visited our 2 new pages a little over 24 hours ago. The html titles have our keywords. What will Googlebot do with this new information? We are only a PR4, we are brand new to the net. Getting recip theme links like crazy. Have not seen Freshbot for awhile (64.68.xx.xx) Googlebot only stopped on the two new pages. Yesterday, I made 9 new pages. Did not see Googlebot yet for those new 9. Total only 49 pages. What is Googlebot doing with the new page info? Google has stale info from over a month ago for our index page html title. Does Googlebot wait until the deep crawl and then update all the pages even though it saw the new pages day before yesterday? Does it hold off or what, please? I know that when Freshbot does arrive, it throws us to page 1 of Google using the html titles of all our pages, old and new. But we only get a RARE visit from Freshbot. I was trying to attract Freshbot and Googlebot by creating the new pages. Please give advice! Thank you.

[DerekT]

From what I have seen Freshbot likes pages that are updated at least on a daily basis.

Also, you may try including a date stamp on your pages.

Example: Last Update: Feburary 9, 2003
Dates called via SSI is a great way to do that automatically.

Display Last Updated:
[code<!--#echo var="LAST_MODIFIED"-->[/code]

[edited by: DerekT at 1:10 am (utc) on Feb. 10, 2003]

[xerxes]

Hi, I do update the index page every day, changing the top two paragraphs and here and there throughout the index page. Also have the date updated every day. Don't know, maybe the low PR4 is the problem. Any ideas? Thank you for your kind input.

[DerekT]

I posted the incorrect code intially to display the current date. The code to display the date the page was last updated can be viewed in my previous post.

I dont believe the PR to be the issue. I have had PR4 sites being indexed as fresh before. That page updated many times( over 100 ) a day and also had the "Last Updated: <DATE>" at the top of the page.

[Powdork]

Another good idea is to make sure your server is configured correctly to handle IF-MODIFIED-SINCE header. If you are with a hosting company they probably are. The pages that I get visits regularly (PR 5) from FreshBot are rarely changed but she comes anyway. The pages that are changed regularly (PR 5) that she won't touch are on a newer, less established site. These are the things I've picked up on that can help bring FreshBot
1. Proper server configuration.
2. Older, established site.
3. High PR (at least 5).
4. Fresh content.
5. Fertilizer (The same kind you would grow mint with).

What does FreshBot usually do with the new page. It will enter the index @ 18 hours after the visit. Everything will be indexed and your new position will be reflective of this. Links are not indexed for pagerank purposes but (I believe) they are for other purposes such as anchor text. Changing your titles can produce huge (or catastrophic) results with FreshBot and is an excellent way to test a new title if FreshBot is a regular.
Hope this helps

<added>I don't know if anchor text helps other sites with FreshBot index changes, but I think it helps yours</added>

[xerxes]

Thank you, derekt and Powdork! Yes the hosting company says the server is configured correctly. We pay more and get more. That I made sure of at the start. Cheaper is not better. I convinced the client before the site was launched. Every day I change the index.html page at least two new paragraphs and as many new pages as I can, all linked from the home page. Here is a hint to others that may want to do this: I use a paragraph near the end of the page so I don't bore the daylights out of the visitors with the new minty fresh fertilizer pages. There I add all the hyperlinks to the new pages, one after the other. We are very young. About 2 and 1/2 months. The reason we are a PR4 is I LISTENED to all of you and got the links by seducing the link partners with the beauty of our site. Here are my secrets: I used everything, dynamic animation, (found free on DynamicDrive- FORGET FP dynamicanimation it over-rides its OWN codes!) NO flash, colored text, free backgrounds, animated rotating images of the client's product, classical music free midis, everything! That is how I got the initial recips. They liked the look of the site and thought we had potential and the recips TOOK A CHANCE ON US WHEN WE WERE A PR GRAY BAR. If this helps somebody, Good! We had 41 Recips when Google deepcrawled last month, but Google only credited us with 12! One of which was a PR grey bar, but I liked the theme. I have to check in the search function of the forum to see exactly what "anchor text" is that Powdork is referring to. Whatever that is, I will find out and work on that TODAY! I change the date by hand every day on the index page. The other pages when I get to them. I'd give a million to be able to attract Freshbot. The client freaks hanging on page 7 or 8 for keywords. I tell him (I only have 1 client at this time, I am a newbie at this, but love it!) I tell him take it easy, it will take a year to build the PR even if I am working 14 hours a day on his site. Who even WANTS more clients? Who has TIME for more clients? I will try to help other members of the forum when I get on my feet here. Ha, a law degree and I am flailing about in the waters here trying to get head above the wild flood which is Google. THANKS GUYS and GALS!