Welcome to WebmasterWorld Guest from 188.8.131.52
I am honored that Google is so excited to index my site and quickly spider my pages, but Google doesn’t rank the pages well and the PR on the site dropped to a PR1. Could this be a sandbox issue? If Google likes that site enough to spider every new page, sentence, or word added daily will time and good SEO eventually increase my rank?
The other option is to ban the Googlebot so MSN Bot and my customers have better access to my site. What should I do? Will time and good SEO bring traffic from Google?
joined:July 19, 2002
I would however never do that to Google. Couldn't you just lock out Google from certain pages using your robots.txt file?
Put this in your robots.txt file
This will limit googlebot to 10seconds between each call. You may change the delay to a number more comfortable to your server load. I find that googlebot is very obedient to this command, unlike yahoo or jeeves or msn bots.
I had a similar problem with googlebot rampaging through a site. One "behave or be banned" email later, and I had a (seemingly) non-canned response and apology. Googlebot been well-behaved ever since.
I would hate to block Google from any of my content. I still wonder why Google likes the site enough to spider it daily, but not enough to rank it very well.
Is it a good sign that Google is spidering my site daily? Should I try to optimize the site for Google and if so could it cost me rank at MSN.
I dont think banning is the best solution. If google starts sending lots of visitors your site will start to run slow anyway.
Google doesn’t rank the pages well and the PR on the site dropped to a PR1. Could this be a sandbox issue?
If your home page is PR 1, and you aren't ranking well in Google - the simple answer is that you need a lot more quality inbound links to your site.
It also sounds like you need to upgrade your server.
During this last 3-4 months i add ~near 20-30mb content in my database (php-mysql site) and after this start my problems. [just now db size is ~near 60mb]
every time google visit my site, my apache was overloaded and as result site "in down". at that time i was on VPS hosting (256mb ram).
at first i didn't understand what's the problem, (didn't see any connection between google's visits and server overloading).
it's continued 3 month, after i decide to move my host to other hoster and upgrade my hosting account to 512mb. (it was 30-40 days ago)
btw, server moving wasn't clear and as result site was in down 2-3 days/
as result of this:
1. i loss google's traffic, if before google have 15-25k indexed pages from my site, now there are 500-700 pages.
2. all my KW-s aren't work
3. if 3-5 months ago google make 2-3gb during his site visits, now maximum 300-340mb
during this last month google visit my site 5-7 times and 4 times of this he make server overloading.
i don't know , what do?
1. wrote Google and tell that his visits make site overloading?
now when he don't do deep crawls?
The "overloading" form states sending the form would lead to Google coming less to my site.
That's not what I want at all!
i think that after this he will visit less , in which i'm not interested.
2. upgrade my server or move to dedicated with minimum 1 gb ram?
hmm ... now , durign this 40 days my business was worst (i mean site incoming), so it's a little terrible to pay for dedicated server and don't be sure, that we can earn enough.
the problem is, that when my problems starts, at first i think that it may be google's ban or penalty (for duplicate content).
still now i don't sure that the only problem is in server overloading.
pls, help me,
suggest, what's the best solution in this case?
Check site:yoursite in google how much pages are cached is there an end in site?
Lots of variables to consider here.
Also, you can use mySql syntax directly. It should be in your manual under 'CREATE INDEX'. If you don't have a manual, then it's available online at their site.
Only index fields that are key fields or are important fields that you query on. Too many indexes seems to be worse than no indexes at all, so think about what you're doing before you do it.