In Progress

Site Crawler and data scraper using MySQL database

Looking for a freelancer with a excellent reputation and good English.

Need Freelancer to develop a windows bases application that will crawl a website for URLs and INSERT and UPDATE data in a MYSQL database. Then the Crawler will need to crawl the URLs it has collected to then scrape data on the webpages and execute MySQL commands to move data in the database.

- The crawler application will need to connect to a MySQL database and will need to store the connection string.(will need to delete and update connection strings if need be)

- The crawler application will need a way to start when windows starts. (a simple shortcut in the startup directory is fine)

- Controls to allow for pause between pages.

- Controls to allow for restart of application after x number of pages have been crawled.

- Controls to allow for time between crawl completion and the start of the crawl again.

Skills: English (US), MySQL, Software Architecture, Windows Desktop

See more: crawler mysql, windows store freelancer, website architecture freelancer, using freelancer site, update the windows freelancer, start using freelancer, startup freelancer, startup for freelancer, shortcut freelancer, mysql database software, mysql database application, freelancer webpages, freelancer site in english, freelancer insert data, freelancer for startup, freelancer for a startup, freelancer bases, freelancer application site, develop webpages, bases freelancer, freelancer startup, freelancer controls, freelancer website scrape, database crawler, data scraper

About the Employer:
( 34 reviews ) Alpharetta, United States

Project ID: #4852471

Awarded to:


Hello! I have scraping experience as well as an excellent reputation (not least in english translation work) and can finish your project within a week.

$245 USD in 5 days
(2 Reviews)

5 freelancers are bidding on average $151 for this job


10+ years experience. 500+ projects completed successfully. I have developed many crawlers in JAVA. The latest crawler that I developed is used to look for videos and store data in MySQL and update regularly. Please s More

$147 USD in 3 days
(92 Reviews)

Hi, Ready to start your work. Eagerly awaiting for your positive reply. Please check your inbox for further details. Thanks, Shaik.

$99 USD in 3 days
(5 Reviews)

Let's start!

$100 USD in 5 days
(14 Reviews)

Hi, please check PM.

$166 USD in 2 days
(0 Reviews)