Forum Moderators: open

Message Too Old, No Replies

WordPress For a Large Scale Website

WordPress For a Large Scale Website

         

SeoGolfer

11:23 pm on Feb 25, 2008 (gmt 0)

10+ Year Member



I would like to know if anyone has had problems moving or creating a large scale (30,000+ pages) website to WordPress. Any and all comments would be greatly appreciated.
Thanks,

ergophobe

4:12 pm on Feb 26, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I've moved some smaller sites to WP. Perhaps you have too, so my observations are not relevant, but FWIW here are a few comments to get things started. Hopefully someone who can answer more directly to your question will chime in.

Depending on the content, once converted, this might only be 40-50MB of zipped content as a database dump, which as far as MySQL is a fairly small data set (a site that I have that has 10,000 pages is about 12MB as a zipped MySQL dump, but it has very simple structure).

Wordpress.com runs on WordpressMU which is essentially a multi-user wrapper for WP, and it hosts 1.7 million blogs and gets 60,000 posts per day.

The key question that determines how hard this is remains the same regardless of scale (except when the scale is very small): what format is the data in currently? Obviously, you'll want to write some sort of conversion script and the more regular the data, the easier that is. If it's not uniform enough to use regular expressions to extract the core data (title, H1, article body, meta data, etc), then it's going to be a lot of work.

Most of your time will be spent up front getting the MySQL INSERT queries built and getting all the little glitches out of your data (escaping all apostrophes and so on an so forth). Regular expressions are your dearest friend.

Then once it's up and running, 30,000 records is a small number if you are doing searches on indexes, but can take some time on non-indexed columns. So make sure that most obvious searches use indexed columns or multi-column indexes that match the search. The rule of thumb is that indexes speed up fetches and slow down writes.

At that point, the question is less a matter of the size of your DB than the amount of traffic you're getting, what plug-ins you have running, and so forth. For those issues, search Google on

"Wordpress scalability"
"High traffic wordpress"

And you'll get some useful results.

SeoGolfer

4:35 pm on Feb 26, 2008 (gmt 0)

10+ Year Member



Thanks for the info. Our site, it is currently PHP, ASP classic and ASP.Net among a few others I am not aware of. We are mainly an ASP.Net shop and will be running a SQL Server back end. Have you or anyone heard of a way to integrate WP with Sql Server?

[edited by: jatar_k at 6:59 pm (utc) on Feb. 26, 2008]
[edit reason] no urls thanks [/edit]

SeoGolfer

5:52 pm on Feb 26, 2008 (gmt 0)

10+ Year Member



ergophobe, I have not converted a site to WordPress. What would I have to do to convert a site this size to WP? What other issues should I look to expect?

ergophobe

6:56 pm on Feb 26, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



The size is pretty much irrelevant (unless you only have a dozen pages and just do it by hand). Always the same

1. figure out what "chunks" you need. If you'll be using any plugins that allow for custom meta data (title, description), and so forth, install those first. Then figure out what you're going to need to parse out: <title>, meta description, h1, etc.

2. figure out how to parse your existing data into those pieces. Test on a few pages.

3. figure out what INSERTs you need get that data into MySQL. Test on a few queries.

4. parse your data out into INSERTs and insert into a database. You'll likely get some errors and you'll get the text just before the error. Hunt down those sections until your data is cleaned up enough to go into a DB-table in one go without errors.

5. Look at a bunch of pages. Scan a dump of your new database (do you have any character encoding issues? etc etc).

6. Get it up on a test server and run something like Xenu on it. Looking good? Launch on a low-traffic day and monitor logs for 404s etc etc etc.

Have fun!

SeoGolfer

9:02 pm on Feb 26, 2008 (gmt 0)

10+ Year Member



Excellent explanation. Thanks! How much would you charge to help convert a site like <url removed>?

[edited by: encyclo at 1:41 am (utc) on Feb. 27, 2008]
[edit reason] no links to personal sites please [/edit]

ergophobe

12:10 am on Feb 27, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



How much will you charge to let me hit you repeatedly with a hammer ;-)

Actually, I don't mean to make the task itself sound unpleasant. It's meant more as a commentary on how I feel about taking on extra work. You would get better value from someone who is a real Wordpress nut anyway.

As for how much someone else would charge, you need to find someone you trust and get a bid from them after they've had time to poke around your system. Again, it's all about how the data is currently stored and structured. Could be dead simple, could be miserable.

SeoGolfer

12:15 am on Feb 27, 2008 (gmt 0)

10+ Year Member



Thanks again. I think I would probably charge you alot for the hammer idea...lol...

Any recomendations on where to look for a WordPress Nut? I got a few but would like to hear your ideas.

ergophobe

12:23 am on Feb 27, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Aside from the usual suspects (elance, rentacoder), maybe contact some plugin developers?