Forum Moderators: phranque
I want to know what i can do, in the last days my site is been crawl for a bots, google spend 12 hours in a row, but the problem is a spanish one, see 25 pages in the same time! All my clients stay a few seconds and go away, because they spend 30 seconds to see one page and before were 3 sc!
My site is a ecommerce php site, and i did rewrite command to html, i think because of that my site get the attention of search engines. But happens every day, different bots, i dont know what to do, go to my hosting account and make a upgrading account?
I have a:
5 Gb account - i only use 500 mb
bandwith of 250Gb - i only use 5Gb
Thanks for all the help!
You should ask two important questions:
- How many users are on each physical server
- Does the virtulization system hard-limit the % of CPU resources used by each virtual server?
You want the answer to the first question to be small (<10) and the second question to be "yes". If yes, then this solves the problem of other users on the same machine hogging it - they can't.
You just need a host that doesn't over-load it's servers with too many users.
A virtual dedicated server, with a known number of users per machine, and a hard CPU% usage limit, guarantees that. Just make sure you pay attention to how many users per server, and whether they limit CPU use to your share of the server or not.
If there are 10 users per server, you are getting 1/10 of a server. That's probably more than enough for most small web sites.
As for your robots problems, there are various ways of controlling that. Use robots.txt to exclude robots you don't want. Use IP filtering to eliminate those robots that you don't want that don't pay attention to robots.txt. (Not possible with a shared account, but usually possible with a virtual server or dedicated server.) Use robot-specific meta tags or other means provided (Google Webmaster Central) to limit the speed with which specific robots crawl your site.
As for your
Last week i contact a spanish company to put my products in their network of shopping centers, probabily it`s them doing this, allready email them asking.
My problem now is if have more of 25 real customers my site crash?
I think my host is over-load in is servers with too many users.
I optimize all my sql tables, i dont know what to do more, may be changing hosting account to another company?
Put a blank html page on your site with just "hello world" on it, no graphics, no thing else. Ho long does it take to load that page?
If you're convinced it's not your site or pages, keep in mind the "average" cost of an ecommerce domain still hovers around $20 per month. The addage still applies: you get what you pay for. It may very well be your bandwidth is being throttled back for higher-paying clients, who knows.
If the "virtual dedicated" involves no major moving of files, I'd give it a week. If not, find a new server.
It is like rocknbil: ...ecommerce domain still hovers around $20 per month... you get what you pay for.
Alternatively if you are sure it was the html thing, why not undo that if it's killing your site?
But yes a robot text file should solve most of your problems, just do a search for example files.
P