Webcrawler to Mysql

IN PROGRESS
Bids
11
Avg Bid (USD)
$318
Project Budget (USD)
$30 - $250

Project Description:
I'm looking for an expert who has experience with Nutch or Scrapy to help me set up a webcrawler to scan websites and webfiles and then update a database with the info.
Client-based user interface:
1. create/edit/remove rules
a. real-time webpage scan
b. real-time webpage + crawl scan (crawl means it follows links on the website to other pages, and then scans these pages, for X levels)
c. real-time file scan
d. real-time multiple/batch file scan
rules can be executed one time, continuously, or over a timeframe (every x minutes)
rules can be turned on/off
2. Display live status of the engine in an
3. write to database accroding to structure predefined in rules

Skills required:
Java, MySQL, PHP, Python, Web Scraping
About the employer:
Verified
Public Clarification Board
Bids are hidden by the project creator. Log in as the employer to view bids or to bid on this project.
You will not be able to bid on this project if you are not qualified in one of the job categories. To see your qualifications click here.


$ 225
in 5 days
$ 320
in 12 days
$ 250
in 10 days
$ 400
in 5 days
$ 400
in 25 days
Hire chirgeo
$ 350
in 6 days
$ 350
in 15 days
$ 200
in 7 days
Hire Dutchstudent7750
$ 250
in 7 days
$ 250
in 5 days