Find Jobs
Hire Freelancers

Simple data mining project

$30-250 USD

In Progress
Posted almost 10 years ago

$30-250 USD

Paid on delivery
I am looking for someone to help me with a data mining project. I already have the necessary PHP / MySQL code, i am only looking for an infrastructure solution. The script gets some data from a URL like [login to view URL] using file_get_contents. Then it goes through the HTML and stores several values in a MySQL database. Simple. What i need is to process 35.000.000 (35 million) of queries in a relatively short time span (ideally under one week). I am open to different solutions, you can either use your infrastructure, create a proxy cluster and send me the details, or something else. There is a limit of query speed per second on the target server and it's about 2 per second per one IP. I will release the payment once the data is gathered and i receive and verify a CSV or SQL file (can be in parts).
Project ID: 5820013

About the project

5 proposals
Remote project
Active 10 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs

About the client

Flag of POLAND
Szczecin, Poland
5.0
2
Member since Aug 30, 2010

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.