Hi there.
I need help for script with very heavy text processing tasks.
The script takes a text input from users that can be 500 words long, processes it and sends back.
Recently, for 500 words text my script needs about 2 minutes with 100 CPU usage.
I've tried to optimize as much as I can, it doesn't help much.
I am thinking about distributed system that the main script sends each line of text to different minor scripts, hosted some where else for processing. Main script collects results and merges final text then.
This is my very basic idea, but I don't know how to do that with php.
Please, give me your recommendations.
Thanks a lot in advance.