In Progress

Bug fixes php curl web crawler and statistics programs

I have a web crawler based on PHP curl.

The crawler fetches content from websites (bloggs) that contains a specific keyword. The crawler works with parallell processes.

The crawler starts with a list of interesting url:s and follow all internal links but no external.

The crawlers execution time shall be limited to less than one hour and it is started as a cron job every hour. But there are bugs causing the crawler to continue in some way and it's stealing a lot of capacity from our server.

We have two programs written in PHP analyzing the result from the crawler and search for keywords and updating the database . We want to combine the two programs and debug and have it working in a better way.

So in this project there is no new development but we need a serious real expert in curl and php who can start immediately and work with this continuously until it's working perfect. I expect to have this finalised within a week. Please only bid on this if you fulfill these criteria.

You will have to download existing programs and a few database tables so you can run and test on your own server so you need a good Internet connection also.

Skills: MySQL, PHP

See more: curl content crawler, php web crawler cron, working web crawler, web development works, web development programs, web development job search, web development based project, web crawler job search, web based programs, programs new web, programs php web, php mysql connection, job web crawler, want job web development, internet programs, download web development, development web job, content based websites development, bug statistics, php curl crawler, test execution, statistics job, web development keywords, job search web development, web updating

About the Employer:
( 30 reviews ) Stockholm, Sweden

Project ID: #1116184

3 freelancers are bidding on average $470 for this job

jqMike

PHP/cURL expert here. Please contact me to discuss details.

$750 USD in 5 days
(60 Reviews)
6.9
virtcon

Hello. Check PMB please.

$500 USD in 5 days
(18 Reviews)
4.5
orion300

Ready to start.

$300 USD in 3 days
(12 Reviews)
3.6
ExpertMagento

Let me start it and finish it , please check pmb for more details,Thanks

$550 USD in 7 days
(1 Review)
1.0
terrygurwara

Hello, We can trust on us for your project. We are a team of 27 people, Where Terry manages the tech team, Mark is the Design Head and Myself Angel, managing Operations. You can go through our portfolio with our lat More

$359 USD in 20 days
(0 Reviews)
0.0