Find Jobs
Hire Freelancers

Web scraper

$1500-3000 CAD

Cancelled
Posted about 9 years ago

$1500-3000 CAD

Paid on delivery
Main goal The software should mimic a human who logs in to a secure web site, navigates to a download page after successfully answering any security questions and downloads the desired information being a file or the web page itself. Once the data acquired it has to be saved either in a file on the local hard drive or in a database Details Create a Windows ( or Linux ) based software that will be able to scrape any information from a given web source. The web source might be protected with a user name and a password as well as with security questions that could change every time the URL is accessed so the program should be intelligent enough to detect the questions and answer with the right response. Once the source page containing the desired information has been reached, the software should be able to extract this information and save it into a file on a local hard drive or insert into a database. Specifics 1) The programs should be able to handle successfully: logging in to a web site knowing the user name and the password choosing the right response to a random security question download files through popup dialogues. download files by following a URL download a page containing the desired information 2) The program has to be able to run in a batch mode without a user intervention and without a graphical interface, scheduled as a task on the Windows task manager. 3) The program has to be able to manage with huge variety of possible scenarios for downloading information from the web. after a successful download save the file on the loca disk or insert into a database. I might be forgetting something at the time of writing this project outline so more tasks might be added as the project goes.
Project ID: 6982577

About the project

18 proposals
Remote project
Active 9 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
18 freelancers are bidding on average $2,180 CAD for this job
User Avatar
Hi.. Expert Web Scraper & Data Minor here. I have done too many similar project in past. Having best scraping tools and experience i assure you 100% accurate and good quality work. I have too too scraping experience. you can see my experience here: https://www.freelancer.com/u/uumairkhalid.html looking for your reply. Thanks
$2,368 CAD in 30 days
4.9 (147 reviews)
6.8
6.8
User Avatar
Hello I have a strong experience with web scraping for many years using the latest tools and framework for this kind of work. I am able to implement your project but I would need more information about the questions to answer after login. Looking forward to do business with you. Kind Regards, Q-Protex
$2,500 CAD in 30 days
5.0 (44 reviews)
6.3
6.3
User Avatar
Hi. Interesting project. Well, basically the description is well written but I would like to ask about that "andom security question", how to I know the answer? Do I need to automagically find it? Or there are some predefined cases? Can you give me an example of such site? Thx. Hope we will collaborate.
$2,111 CAD in 9 days
5.0 (33 reviews)
6.5
6.5
User Avatar
Can certainly do (Windows based software using NET). Regards, Svet.
$3,000 CAD in 30 days
5.0 (10 reviews)
5.0
5.0
User Avatar
Hello I'm interested in your project. Could you please provide the URL of the target site? What kind of "questions" it has to identify humans? Could you please provide samples? I'm Python developer and can implement this application as cross-platform and it will work good both at Linux and at Windows. Well if you interesting - let's discuss details. Thanks Regards.
$2,222 CAD in 27 days
5.0 (6 reviews)
4.4
4.4
User Avatar
Hello! I can make crossplatform software in php+curl+mysql. All the security questions are known ?
$1,555 CAD in 3 days
5.0 (3 reviews)
3.8
3.8
User Avatar
Hi! I’m an expert in web-automation tools, specialized in data extraction, human behavior emulation, bots creation, web-scrapers, crawlers, automated posting, resolving captcha and so on. I’ve successfully developed a lot of apps in this sphere, and some of them were not trivial. Is this what you're looking for? I’m really interested in your project as it is exactly within scope of my expertise. I’m a highly skilled Software Developer with 10+ years of extensive experience, worked on both desktop and server-side applications under Windows or Linux. All this allows me to offer you a high-quality and reliable solution, developed in a timely manner. I’ve carefully read all your requirements. Some technical aspects should be agreed, but generally it’s clear. Please, let me know if you are interested. I’m ready to start working on your project right now. Mike
$2,000 CAD in 15 days
5.0 (1 review)
4.0
4.0
User Avatar
i am a java expert nd can work on this project.. please give me more details like type of security questions
$2,222 CAD in 5 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, Sir i have read your project details and got talk well. we are able to complete your job fastly also will update you daily about your project. freel free to award project thanks
$1,666 CAD in 15 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi I did a lot of web scraping at my old job for a technology logistics company. I was the lead developer and we scraped a lot of for trucking companies to get their rates if they weren't technologically advanced enough for api's. As you can guess a lot of trucking companies aren't so we did a lot of scraping. I have my own company were we do some scraping. You can see my site at whitelime.io. I would love to work on this for you and I know my bid is high but my work is quality, I will personally be working on this with all attention and will get it done with efficiency and passion. Thank you, Sean.
$3,333 CAD in 10 days
0.0 (0 reviews)
0.0
0.0
User Avatar
A proposal has not yet been provided
$1,733 CAD in 24 days
0.0 (0 reviews)
0.0
0.0
User Avatar
A proposal has not yet been provided
$1,777 CAD in 30 days
0.0 (1 review)
0.0
0.0

About the client

Flag of CANADA
Canada
0.0
0
Member since Jan 15, 2015

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.