Write a Java Program for Web Scraping

Completed Posted 2 years ago Paid on delivery
Completed Paid on delivery

This is a Web-scraping project. In this project, you will deliver an application that reads a dynamic table from a Web site and write its contents into a csv file.

The project will be delivered as a maven project and will be developed using JDK 16.

You will use HtmlUnit for scraping. There is a detailed document that describes this project and I have also uploaded a skeleton project that you can have a look.

Project Delivery

The project is to be delivered as a maven project, using HtmlUnit for the web scraping.

The Java version is JDK 16.

The delivered batch file name is

[login to view URL]

The Maven project name is fdatascraper

he project delivery should be in a way that will enable me to run the application and modify the code as I wish.

If it contains any external components, then please notify me ahead – I may approve or disapprove.

Milestones:

submit 2 milestones - 50% each.

The second milestone will be approved only 2 weeks after the first delivery, because of the changing nature of the web site.

Task List

1. Read the instructions thoroughly. Ask me everything that you are not sure about.

2. Thoroughly test your implementation to make sure that it provides identical responses.

3. Submit the project for my testing.

Do not apply to this project before you have completed Task #1.

Supplied materials and content

The files that come with this project.

1. Example Json file

2. Example csv result

3. This document ([login to view URL])

Project Milestones

The project will be completed in two milestones

1. Project Submission: You will submit a fully functional version including the maven project and the execution batch file, after you have tested it thoroughly.

2. Two weeks testing: Because that website changes every day, I will need to test it for a period of two weeks before approving this project.

Each milestone is worth 50% of the project, so that I will release the second (final) milestone at least two weeks after the first submission.

How to Submit Your Proposal

Your proposal is a commitment!

1. Describe in general terms what you are intending to do, which external toolkits and libraries will you be using.

2. Provide a table of milestones with detailed schedule and percentage of the project in terms of payment.

3. Your suggested price.

GOOD BIDDING!

Java Software Architecture Web Scraping Test Automation Apache Maven

Project ID: #30935796

About the project

6 proposals Remote project Active 2 years ago

Awarded to:

christian523

Hi, I'm new to freelancer.com. I went through your instructions and completely understood the task. I have experience in Java and in HtmlUnit, so I'm sure I can finish this project. I have some questions on it, which I More

$200 USD in 7 days
(0 Reviews)
0.0

6 freelancers are bidding on average $370 for this job

flashsaiful

Web scraping expert I use python language. My scripts works on windows, mac or linux, but linux is preferably. I can schedule scripts on server if it is required. I have more 100 finished projects (google scraping, fac More

$140 USD in 7 days
(131 Reviews)
6.6
namitkhandelwal

Hello, Warm Greetings! I am a Java developer working on Java technology since 7+ years having hands on windows and web development experience. I would like to help in your application development. To proceed further, More

$250 USD in 10 days
(75 Reviews)
5.7
usaravananbe2004

Hi, Hope you are doing well, I went through your requirements, I am pretty much confident that I can complete this task as I am expert in automation using html unit driver(headless) have done similar kind of projects a More

$889 USD in 7 days
(29 Reviews)
5.0
AleksandarDikic

Hello JAVA EXPERT I have read your description and I am so interested in your project. You can see well experienced and skillful Java +15 years of experience in software development. Confident in your project and I can More

$140 USD in 7 days
(5 Reviews)
3.5