I have an ongoing project that I have a scraper script that is build in php. This script although pulls text and images and inserts into mysql database takes entirely to long to be efficient. I am scraping the data from a popular website and this includes text and images.4 million text and image files to be inserted.
I want a programmer with their own machines to either:
A) Rebuild the script to work faster or more efficient...maybe add multi-threading.
B) Write another script in C or ms dos or what ever language and process you think that is the most efficient
C) Come up with a whole new way of getting this project done.
Project budget: For this project we have a budget of 75$US to 130$US maximum. If you can work from these numbers you are welcome to bid.
1) Programmer must use his or her own machines and equipement to finish the job to 100% completion with out my intervention....all database and cms passwords will be provided.
2) TIMELINE--Job must be done in two to three weeks...this includes the building of the script....the scraping of the data (text and images).....and the inserting of the images into mysql database.
3) Programmer must finish the job to 100% completion which means full scrape and insert of data 100%.
4) Programmer must use their own computers to scrape the data.
If you understand all of the requirements and can do this than reply with a message of yes I can do this and are ready to work. Reply with a skype name so we can have a second talk to confirm all of these details discussed above.
I look forward to working you.