Forum Moderators: Robert Charlton & goodroi
One of my long term projects is to build a small home brew CDN (Content Delivery Network).
The main component is a Geo-aware DNS server which replies to a dns query with a different IP based on the requesters IP.
Now say I have 2 nodes. 1 in US and one in UK. It would be much more efficient to have European visitors to go directly to UK node.
AFAIK, most Google IPs would show up as American, then Googlebot sees only my US server and ignore the UK node completely.
1) Should I show Google IPs all servers in the CDN? would this be considered DNS cloaking?
2) Does google have crawlers in UK which perform DNS requests from UK?
Would like to hear more from anyone who has tried something similar, or crawling behaviour of Googlebot to existing CDN hosted sites.
I know this would make the local smaller search engines think im situated in their region, but its Googlebot im concerned about.
It seems clear to me that Google has a way of crawling from different countries, although I'm not clear on exactly what that is.
in my case the content is gonna be the exact at each node... no variation at all.
When you use the big name CDN, did you notice any noticable shifts in rankings? would you happen to know which node Googlebot accesses to fetch the content?
It's a newly launched site, and the one bugaboo they've run into is with the secure certs on SSL pages. Browsers see the CDN cert and then declare a security problem because of the domain mismatch. Just stumbled on this yesterday and we assume that Brand Name CDN will have an easy fix.
