Browser's maximum capacity to show output

what size of data can be output to the browser

[phparion]

Hi

I have written a spider. It shows different messages while crawling in the browser. It is terminated abnormally sometimes. I wanted to know if it is due to the size of data that can be output to the browser in one go? as the spider status page gets going long as it crawls.

thank you

[coopster]

It likely depends on the browser. How about using the PHP error_log [php.net] function to fire messages into a log? Then you could just use the "tail" command to watch the messages roll by.

[phparion]

In fact, this script runs from a shared hosting and I am not sure if I can run tail kind of commands using php exec() functions... After reading the manual, I think I can mention the path of the error log; so I can point to my shared hosting directory for the log. BUT I am not sure where to use this function? because I have no idea at what point the application breaks...

[coopster]

I was thinking along the lines of outputting to the log instead of the browser. If the application still fails, at least you will know that it is not a browser limitation anymore, but something else in your code.