Find Jobs
Hire Freelancers

Screen Scraper - Gov't Website - Check MySQL for duplicates

$30-250 USD

In Progress
Posted about 12 years ago

$30-250 USD

Paid on delivery
We need one public gov't website scrapped. It's a simple scrape; nothing special like captcha, password, etc... The gov't site is updated every time there is new information. The (Screen-Scraper .sss) Scraping Session in java would need to be aware of new information, and write this information in tsv format. Scraped data needs to (1) Have unique ID, compared to db for duplicates (mysql) (2) Write scraped data to tsv format (approx 10 fields and 1 image) (3) Have resilient extractor patterns (4) Have Java Codes // Commented/Documented Caveats: The unique ID is incremental, and this is how you get to the details page. The extractor patterns are simple. Java Challenges: (1) Must check if there is new information (scrapable data) with in a short period, or it will no longer be available. (2) Sometimes the image doesn't yet exist, and the data does exist. With that said, here is the challange, sometimes the image will never exist, at which point we need to keep the scraped data, (i.e. iterate - after so many tries - if img not exist, keep the scraped data) (3) It may seem like a simple site to scrape at first glance, but please don't underestaimate it, and leave it for the last day the project is due, as it has to be production ready when you submit it. Requirements: (1) Please only bid if you have experience with [login to view URL] Project Due Date: 3-4 days after bid acceptance This is my first post here with freelancer.com, so please bear with me as I learn the ropes. I work for an attorney firm who specializes with clients in direct marketing, so I will have more projects similar to this. We need this right away and production ready, as this is an integral part of a larger pilot program we are launching. Thanks for reading this. Look forward to the bids.
Project ID: 1618406

About the project

8 proposals
Remote project
Active 12 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
I have lot of experience in Web Scraping. Please check your P.M.B. sir...!!
$90 USD in 2 days
4.9 (23 reviews)
5.5
5.5
8 freelancers are bidding on average $125 USD for this job
User Avatar
Hello, I am an expert data extractor. Please refer your Inbox for my experiences and more details. Thank you.
$100 USD in 3 days
5.0 (56 reviews)
6.4
6.4
User Avatar
I specialize in similar projects. Please check PM for more details.
$180 USD in 4 days
4.8 (16 reviews)
5.6
5.6
User Avatar
hi i can do this contact if interested
$80 USD in 2 days
4.9 (21 reviews)
5.1
5.1
User Avatar
I am confident to do your work.
$47 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
The project will be completed within or before specific time using latest technology and skilled staff.
$55 USD in 4 days
0.0 (0 reviews)
0.0
0.0
User Avatar
<b><i>Removed by Admin</i></b> - Custom software development - skpye: <b><i>Removed by Admin</i></b>
$250 USD in 1 day
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
Miami, United States
5.0
11
Payment method verified
Member since May 9, 2012

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.