Forum Moderators: open
Have over 30 URL's registered that forward to "primary".com domain. So, example, if you type cows.com in your browser, it autoforwards to the main site farmer.com.
On the farmer.com site, I've got over 40K static pages, that are accessible by a index, each page has links back to the 30 URL's with the specific page as the link.. Example: on the milk.htm page, it has links: farmer.com/index/milk.htm, cow.com/index/milk.htm, etc. These all go to the same milk page on farmer.com... Got the idea?
OK, now I've submitted all 30 URL's in google.com... The farmer.com site is currently being crawled at over 4,000 sessions per hour. It's been steadly doing this for 5 days. My guess is each URL is being spidered.
I wonder if all 30 URL's will show up in google? If you search on milk, you'll get farmer.com/index/milk.htm and cow.com/index/milk.htm, etc.,etc.
Has anyone ever tried this? At the current crawl rate, it'll take over 40 days to finish the crawl?
I'm extremely curious as to what happens to your site ;)
You can find out if you're banned using the Google toolbar - if your pages show up when you search for your URL on Google, but you toolbar is greyed out, you are banned. Some people would disagree and say a white (0) toolbar is banned, but in my experience the white toolbar can be caused my many harmless scenarios, including being a new site, or after major changes.