I am getting a very frustrating error on my VPS when running a large script that curl's a large amount of urls. I am a web developer myself but I have finally given up and am willing to hand this over for someone else to fix as my server experience is minimal.
When doing 200 curl's and then converting the source into arrays my script runs just fine without any errors, however when running it with 500 curls I get the following error inside my error_log:
Connection reset by peer: mod_fcgid: error reading data from FastCGI server
The server is running centos with plesk and my php script is built inside codeigniter (again the script works fine this is a server issue)
So far I have increased all php.ini memory and timeout limits to 1 hour (more than enough) as well as the nginx and mod_fcgi limits to 1 hour and still the error persists. The fact the script runs fine but flags an error when I am running just over a certain ammount says to me it is a problem with a restriction on the server but it could possibly be something else.
I am looking for someone with server and some php experience who can logon my vps and fix the error.