| 8:50 pm on Oct 30, 2007 (gmt 0)|
Check your php settings regarding max_execution_time [us3.php.net] and memory_limit [us3.php.net]. Both values would affect your ability to process a file that size.
| 10:02 pm on Oct 30, 2007 (gmt 0)|
Yes, I put
in the script for the timeout factor. I'll see about the other one here in a minute.
| 10:24 pm on Oct 30, 2007 (gmt 0)|
In the PHP.ini file the memory limit was set to 128MB, but that can't be right because whenever I run the script it uses the entire system's memory. Not only can I hear my computer chugging hard (kind of scary) but the memory availabe drops into the single digits :( . I tried upping the memory_limit to 700MB in the .ini file and restarted Apache but got same warning messages and results:
Warning: simplexml_load_file() [function.simplexml-load-file]: ....7770953: parser error : Memory allocation failed : xmlSAX2Characters ....on line 10
and a couple others. But like I said, it will do the smaller file which is in the same format so the script is not the problem. Is there anything else that can be done? Maybe a function in PHP or another setting that would work to open this large XML file and parse it?
| 10:34 pm on Oct 30, 2007 (gmt 0)|
things always get messy dealing with LARGE text files, have you tried splitting it and uploading it in chunks?
| 2:13 am on Oct 31, 2007 (gmt 0)|
Thanks! Is there a way that you can recommend to split the XML file? (For instance using PHP or another method?)
Any help is greatly appreciated! Thanks!
| 4:18 am on Oct 31, 2007 (gmt 0)|
By the way, the reason I ask is I'm having trouble opening in a text file (it just goes on and on loading). Maybe there is a way to split it without having to open and manipulate it. Thanks!
| 3:53 pm on Oct 31, 2007 (gmt 0)|
Any filesplitter will do the job, you've just got to be careful not to split it in the middle of a record.
I've got a good free one on my computer called "filesplitter" but for the life of me i can't find it on the web. but i'm sure there are plenty around.
| 4:43 pm on Nov 1, 2007 (gmt 0)|
Thanks! Just wondering, but why can't I split in the middle?
| 10:29 pm on Nov 1, 2007 (gmt 0)|
well if your record is
and you've split the data then theres a possibility that
then in the next file
Which is fine if you're going to join the two back together again, but with a 700mb file you're far better to deal with each individual file and whack it in a database rather than rebuild the xml file and try and work with that.
| 11:17 pm on Nov 1, 2007 (gmt 0)|
Try "Large Text File Viewer", it was created for viewing large 1GB text files