Forum Moderators: open

Message Too Old, No Replies

google not liking new IPs?

         

SubZeroGTS

3:46 pm on Feb 8, 2003 (gmt 0)

10+ Year Member



i switched my domains over to a new IP address yesterday. no sign of googlebot since...i had a bunch of hits from Freshbot prior to that, and only a few from the Deepcrawl bot.

SubZeroGTS

6:21 pm on Feb 10, 2003 (gmt 0)

10+ Year Member



all they need is a few dedicated machines to update their DNS cache without affecting the bots, no?

hell i think one dinky little machine could do it.

BTW, google has been crawling my old IP. the reason i didn't like this is because my old IP/server is very slow and sometimes doesn't respond. that's why i moved to a new IP. but now that i've moved the site over, Google (mostly) has the old IP to itself so the server should stay up and let it crawl. good thing both IPs are using a 3rd MySQL server, the content stays updated and is the same.

NickCoons

8:12 pm on Feb 10, 2003 (gmt 0)

10+ Year Member



SubZeroGTS,

<all they need is a few dedicated machines to update their DNS cache without affecting the bots, no?
hell i think one dinky little machine could do it.>

According to an interview we did with Google about a month ago, all they have are little dinky machines, about 10,000 of them :-). But yes, I think they could add a few more dinky machines dedicated to gathering DNS information more frequently, and Googlebot could make its request from that cache.

kyr01

10:51 pm on Feb 10, 2003 (gmt 0)

10+ Year Member



Well, I don't know... I have a site with abot 200 pages that was moved to a new server and a new IP ten days ago. Googlebot crawled the new IP during the last two days (165 pages the first time, and 170 the second), so I guess they update the DNS quite often.
As for the old IP, I am keeping the old site still available, but I uploaded a new robots.txt to keep bots (all of them) away (hoping that would have been a way to force a DNS update, which seems to be what actually happened...).

Nick_W

10:53 pm on Feb 10, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



They updated tuesday last week. And no, they don't update too often. There have been times when it's gone on for months...

If G has your new IP's you're safe to take the old sites down now btw... unless other bots are still in there...

Nick

NickCoons

12:26 am on Feb 11, 2003 (gmt 0)

10+ Year Member



Nick_W,

<And no, they don't update too often.>

Any possibility that Google has updated the frequency in which they update their DNS information?

Nick_W

7:18 am on Feb 11, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



No idea, guess we'll have to wait for the next one to tell for sure..

Nick

kyr01

9:28 pm on Feb 11, 2003 (gmt 0)

10+ Year Member



I would definitely say that googlebot somehow identified the new IP. Today my site was crawled again (199 pages out of a total of 204). It seems that Inktomi is following (84 pages today) together with Altavista (38 pages yesterday) and Fast (8 pages yesterday). Everything considered, either I should feel very lucky or the change of IP is not big business dealing with modern search engines...

Nick_W

9:32 pm on Feb 11, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



They updated tuesday last week.

[webmasterworld.com...]

Nick

This 38 message thread spans 2 pages: 38