homepage Welcome to WebmasterWorld Guest from 54.166.113.249
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Code, Content, and Presentation / Databases
Forum Library, Charter, Moderator: open

Databases Forum

    
How do you import large SQL dumps into phpmyadmin?
Over 1M records, need some help.
rj87uk

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 3582749 posted 11:42 am on Feb 23, 2008 (gmt 0)

Hey All,

I have a probem with a large SQL dump its just over 1M records large however whats worse is that each INSERT has 7000(ish) records so its 1M odd records done within 200 INSERT statements.

I can't even import them one at a time, I tried BigDump but that was also no help. I tried inserting one insert directly into the sql window of phpmyadmin however got a timeout error (I don't fancy doing 200 of these anyway)

If anyone could help that would be great.

RJ

 

rocknbil

WebmasterWorld Senior Member rocknbil us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3582749 posted 6:48 pm on Feb 23, 2008 (gmt 0)

I don't know of a solution via the web for that size of data, but if you have command line access to your server, log in to mysql and type the following:

use [your database];
source [path/to/file.sql];

mjwalshe

5+ Year Member



 
Msg#: 3582749 posted 5:23 pm on Feb 25, 2008 (gmt 0)

for a database import of that size your going to have to go to the command line.

And a single insert with 7000 rows sounds a bit ott.

I would maybe think about dumping the data to a flat file/files and then doing a batch update. Just so i could be sure that all the records went across ok - ok I used to write biiling systems so i'me a bit anal about data integrity :-)

rj87uk

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 3582749 posted 5:40 pm on Feb 25, 2008 (gmt 0)

Cheers for your help, I managed to figure out how to work textpad really well so I managed to each record on its own line with its own insert.

Thanks All - Working with this data is going to be another task on its own. :(

Clark

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 3582749 posted 11:49 pm on Feb 26, 2008 (gmt 0)

Something that may work for you depending on your situation is to stop using mysqldump and start using mysqlhotcopy [dev.mysql.com]. It's much easier and quicker to backup and restore...but you must backup within the same machine. It also has some advantages and disadvantages to mysqldump.

[edited by: Clark at 11:49 pm (utc) on Feb. 26, 2008]

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Code, Content, and Presentation / Databases
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved