Need to build a custom web based data extractor miner, that populates a database, or website, from web based information. Sites are located by included spider, scraped, or data extracted. And data stored in database, reassembled and reproduced in web format, aggregated or original format. Spider shall include ability to automaticaly generate likely folder/file/ file extension names, through an on the fly random generator, this ability will mainly be focused on a specific ip address/ url name and need not be part of the automatic recurring web mining ability.
17 freelancers are bidding on average $735 for this job
We have built many spiders and data parsers in asp.net and C#. We have the experience needed to do this project right. We can provide links and examples (if we are allowed).