Find Jobs
Hire Freelancers

Automated web data scraping, extraction, parsing

$30-250 USD

In Progress
Posted about 14 years ago

$30-250 USD

Paid on delivery
This job is about developing a simple script that executes the following sequence of activities, either automatically at regular time intervals or when activated by the user. Sequence: 1) check time and connect accordingly to several websites (some password-protected, some public) - should be a list / configuration file that the user can update easily and safely 2) go to several identified pages on these sites - should be a URL list / configuration file that the user can change easily 3) extract specific information identifiable through a column or table header 4) store this information in Excel and / or Google Spreadsheet files and / or text files (final decision to be based on technical feasibility) 6) save the files based on a predefined naming convention that reflects time and date Suggestions are welcome in terms of technology choice. However please note that preference will be given to approaches that make it easy to maintain / modify the code and that reduce development time / cost. For your proposal to be considered, you must IMPERATIVELY provide the following information: a) please detail your prior experience with web automation projects, especially content scraping and parsing. please indicate if you have an existing library of code that you can re-purpose, and how it reduces the cost of your proposal. b) please detail your prior experience with Windows / Excel automation projects. Please note that this is not a deal breaker if the output is a text file. c) please describe what technology you recommend for this project, and why. d) please specify cost range, and estimated completion and delivery timeline for this project. If you need any further details to finalize your proposal, feel free to contact me! Thanks in advance for considering this job and looking forward to your proposal. Job keywords: .NET, Windows, Excel, macros, Excel VBA, script, scripting, automation, web scraping, data scraping, crawling, data extraction, data parsing, PHP, Python, Scrapy
Project ID: 666342

About the project

21 proposals
Remote project
Active 14 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs

About the client

Flag of UNITED STATES
NEW YORK, United States
5.0
99
Member since Aug 31, 2009

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.