Forum Moderators: open

Message Too Old, No Replies

how long does it take for index updates to be seen

new pages, new titles etc

         

bluecorr

8:00 pm on Jan 5, 2003 (gmt 0)

10+ Year Member



I have new pages since two weeks ago that haven't been picked up by freshbot because....because I don't know, maybe freshbot was extremely selective as to how deep to crawl? Anyway all those pages have been crawled by 216.239.* as seen in my logs. However they're not in the index, not under keywords, not under exact title, not even under page_url.html searches. Will they be included in the index this month or are they out of the game till next deep crawl?

Also, other pages have been crawled during the Dec crawl and have been crawled again this time. However, in between crawls I have changed the titles (more exactly on the 2nd of Jan) and they have been deepcrawled on the 3rd as appears in my logs. In SERPs however, the title remains the old one instead of the fresh one.

Can someone explain how and when google updates its index cause I'm not seeing it.

VictorE

11:02 pm on Jan 5, 2003 (gmt 0)

10+ Year Member



I am a newbie, but here is my experience:

The deep crawl that occured in early December was indexed in the December update (Jan 1). The changes you made after the December deep crawl probably won't appear until the January update, unless you are visited by Freshy in the mean time.

Hope this helps.

Vic

jamesyap

4:48 am on Jan 6, 2003 (gmt 0)

10+ Year Member



216 are deep crawl bots. what they get will be send out to the January Update (dance).

Freshbots is picky. It usually only pick up 1 page (the root page). It is normal it likes to take holiday sometimes. If you new page is deep inside your site, then forget about freshbot as she won't come. If you are lucky, sometimes freshbot will pick up your main page and all pages that is link from main page. If you want better luck, your new page must be linked from the main page.

However, pages that is not in the index when crawl by freshbot wil only remain for 1 day. Except the bot come again next day. Hope this help you. (fresh bot are 64.x.x.x)