Write a Simple C# Web Crawler Manager, using Windows Forms / WPF interface.

Write a Simple Web Crawler Manager, using Windows Forms / WPF interface.


- Should be possible to create a job, by specifying: the site name, starter urls for crawl (simple text area, one initial url per line), url patterns to download (one per line. if not empty, use CONTAINS to see if page should be download to disk), crawl deep, folder to download the html, and retry count.

- Should be possible to pause/resume any job. Pause should also occur if, internet connection breaks down, or the program is closed. When job is finished, should be possible to run it again. Should be possible to delete a job too.

- Should be possible to specify a proxy list. Turn on/off. If on, every time you make a request you get a different proxy from the list.


- Must be fast.

- Must be Multithread.

- Must be written in C#.

- Could use any open source code, as frameworks like NCrawler or Abot to complete your job.

- Downloaded html files can have a pattern file name, like '[site name]-[date].htm'. You also can suggest me something.

- Application must have a job list, showing what is running, minor status.

- Application must have a simple textarea to show any relevant log/console message. Starting.../Downloading...Stopping.


Our system has .NET 4 and Microsoft SQLExpress.


We need a working sample with clean code including all source files in C#, that is able to index <[url removed, login to view]> with a link-depth of 3 and that can paused and resumed, when that pause and resume on disconnect internet connection and reconnect, or close program and open it again and resume the job.

Skills: .NET, C# Programming, Software Architecture, Web Scraping

See more: write me a resume, write a resume, wpf resume sample, c# programming, windows desktop, wpf resume, working of web crawler, what to write on a resume, what to name your resume, what should be on a resume, what is a resume, web wiki software, web program manager, web crawler wiki, web crawler architecture, web-crawler, web application system architecture, system architecture of a web application, status manager, sample of a resume

About the Employer:
( 1 review ) Buenos Aires, Brazil

Project ID: #8243012

Awarded to:


I can get this job done in around 3 days (maybe less than that)! If anything, then we always can discuss that in PM!

$77 USD in 3 days
(0 Reviews)

17 freelancers are bidding on average $438 for this job


Hi I can provide a Desktop application in C# (without WPF) that will used to crawl any site. Can work on a demo if you like. Thanks

$666 USD in 2 days
(189 Reviews)

Hi, Please review my portfolio or blog to get most recent samples about ASP.NET,CSS,HTML,C# and other development technologies. [login to view URL]

$500 USD in 5 days
(100 Reviews)

Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi

$526 USD in 6 days
(150 Reviews)

Hello, sir. I am a expert Web app developer. if you give me a chance, I will do best for you. Thank you!

$315 USD in 5 days
(30 Reviews)

A proposal has not yet been provided

$421 USD in 1 day
(49 Reviews)

Ready to start !Ready to start !Ready to start !Ready to start !Ready to start !Ready to start !Ready to start !Ready to start !Ready to start !Ready to start !Ready to start !Ready to start !Ready to start !Ready to s More

$50 USD in 1 day
(51 Reviews)

A proposal has not yet been provided

$526 USD in 10 days
(23 Reviews)

I have 3+ years expertise developing software by .NET and SQL SERVER. I can help you finish this project with the best quality.

$500 USD in 10 days
(29 Reviews)

Hi, I have good experience in developing crawlers, scrapers, large data mining and web automation projects for social media, classified and market place sites with multi-thread support. I can develop this crawler More

$500 USD in 5 days
(18 Reviews)

Hello, my name is Dmitriy. I'm interested in your job offer. One of the projects made on Freelancer was scraper for LinkedIn network, so I have required experience and pieces to boost development. If you interested in More

$600 USD in 12 days
(4 Reviews)

A proposal has not yet been provided

$333 USD in 6 days
(5 Reviews)

I am suitable for this project. Looking forward for your response. I have 10 years of experience. Thanks.

$1111 USD in 1 day
(0 Reviews)

Last Work Experience: August 2012 – July 2014 Desktop - Web - Mobile Developer. Support - Setup - Deployment Specialist – ERP Developer at ERP DEVELOPMENT AS (Oslo, Norway), developing web applications with Microsof More

$500 USD in 5 days
(0 Reviews)

A proposal has not yet been provided

$25 USD in 1 day
(0 Reviews)

I have the Working experience in C# and in WPF. Being a part of an IT Company i know almost all the Cross Cutting Concerns of an Application. Crawlers are typically programmed to visit sites that have been submitted by More

$66 USD in 1 day
(0 Reviews)

Hello, Its a great pleasure to place a placeholder bid on your project. I have gone through the requirements posted by you and firmly believe that our team will be able to provide great solution along with ideas More

$722 USD in 10 days
(0 Reviews)