Closed

Web Crawler with Variable Proxy

I am looking for a programmer to help develop a web crawler. The app needs to crawl a few websites on a weekly basis. Some of the websites have volume restrictions and require the ability to connect to a proxy server after so many requests. The output needs to be in the format of a .CSV file with headers. One of the websites requires a username and password before proceeding. Please see a couple samples below:

[url removed, login to view]

[url removed, login to view]

I would prefer that the application be written as a macro in VBA for excel but will except all other full applications with raw files. The applications needs to be equipped with error handling incase of a 404, 302, timeout, ect. I would also like to have a status bar or estimated time notification to allow the user to see that the application is in progress.

If you have read the full project details please include the word BLUE in your bid. I have had similar projects completed for less than $100 USD.

Skills: .NET, C# Programming, Python, Visual Basic for Apps

See more: with no restrictions, web develop on python, web-crawler, vba programmer.com, vba excel programmer, programmer excel vba, password vba project excel, looking for python programmer, looking for a python programmer, looking excel macro programmer, excel macro to word, app vba, vba for word, vba error, excel vba help, excel 2013 vba, vba projects, vba programmer, python excel, net proxy, net programmer full time, http web requests, excel python, excel and word project vba, proxy python

About the Employer:
( 7 reviews ) Long Island City, United States

Project ID: #4883415

18 freelancers are bidding on average $131 for this job

barundebnath

Hi, I am expert in making web-scrapping application. Please send me all web-sites list which you want to scroll. Thanks BLUE

$144 USD in 5 days
(61 Reviews)
6.2
akhila27

BLUE : Web Scraping Experts Here. We are the only ones here who develop scrapers with human behavior. If you don't add that, your scrapper will get blocked after few days. One Website: 250$ and 7 days. Masters in Scrap More

$263 USD in 7 days
(12 Reviews)
6.1
ehsankayani

HI. I am interested in doing this job and have done many similar works you can see my profile. Kindly send me a count/links of how many sites to be done? Thank you

$105 USD in 4 days
(36 Reviews)
6.1
SigmaVisual

I can help in your project, please check PMB and our ratings/reviews to get idea of our experience. Please let me know if you have any queries.

$277 USD in 7 days
(20 Reviews)
5.6
kovmisa

No trouble to make this.

$100 USD in 3 days
(12 Reviews)
4.8
hsCodes

i would make the one for you. check pm sir.

$111 USD in 3 days
(17 Reviews)
4.7
nitelfreelance

We can help!

$200 USD in 6 days
(9 Reviews)
4.6
Scorpio1987

BLUE. Please see PM for more details.

$100 USD in 1 day
(12 Reviews)
4.3
szymszteinsl

Ready, sir!

$144 USD in 3 days
(6 Reviews)
4.0
belovzorov

BLUE: Please read private message.

$111 USD in 7 days
(5 Reviews)
3.7
shomratkutub

I have experience with your project requirements , check pm.

$123 USD in 5 days
(4 Reviews)
3.6
vinsoneric

Hi, I can work on this. I am expert in web crawling. Thanks

$155 USD in 3 days
(3 Reviews)
3.1
noone2407

Ready to start your job right now

$155 USD in 3 days
(4 Reviews)
2.7
rezabakhshandeh

BLUE. I can help.

$105 USD in 3 days
(4 Reviews)
2.6
mazenmohammed24

BLUE, I can do this project in 3 days max, I've done similar tasks for many clients.

$94 USD in 3 days
(1 Review)
1.4
vickkey7

I am ready to start this project............

$111 USD in 5 days
(2 Reviews)
0.4
ananth86

Hi, i have 1 year experience in software development. please read pm for details

$100 USD in 3 days
(0 Reviews)
0.0
excelfl

I have scraping skill

$100 USD in 2 days
(0 Reviews)
0.0
weprotechno12

we will want to do work with you , we can make this pls try to contact us.

$133 USD in 10 days
(0 Reviews)
0.0
ziafar

i can help you

$100 USD in 3 days
(0 Reviews)
0.0