Write a Java Program for Web Scraping

This is a Web-scraping project. In this project, you will deliver an application that reads a dynamic table from a Web site and write its contents into a csv file.

The project will be delivered as a maven project and will be developed using JDK 16.

You will use HtmlUnit for scraping. There is a detailed document that describes this project and I have also uploaded a skeleton project that you can have a look.

Project Delivery

The project is to be delivered as a maven project, using HtmlUnit for the web scraping.

The Java version is JDK 16.

The delivered batch file name is

[login to view URL]

The Maven project name is fdatascraper

he project delivery should be in a way that will enable me to run the application and modify the code as I wish.

If it contains any external components, then please notify me ahead – I may approve or disapprove.


submit 2 milestones - 50% each.

The second milestone will be approved only 2 weeks after the first delivery, because of the changing nature of the web site.

Task List

1. Read the instructions thoroughly. Ask me everything that you are not sure about.

2. Thoroughly test your implementation to make sure that it provides identical responses.

3. Submit the project for my testing.

Do not apply to this project before you have completed Task #1.

Supplied materials and content

The files that come with this project.

1. Example Json file

2. Example csv result

3. This document ([login to view URL])

Project Milestones

The project will be completed in two milestones

1. Project Submission: You will submit a fully functional version including the maven project and the execution batch file, after you have tested it thoroughly.

2. Two weeks testing: Because that website changes every day, I will need to test it for a period of two weeks before approving this project.

Each milestone is worth 50% of the project, so that I will release the second (final) milestone at least two weeks after the first submission.

How to Submit Your Proposal

Your proposal is a commitment!

1. Describe in general terms what you are intending to do, which external toolkits and libraries will you be using.

2. Provide a table of milestones with detailed schedule and percentage of the project in terms of payment.

3. Your suggested price.


Skills: Java, Software Architecture, Web Scraping, Test Automation, Apache Maven

See more: java program web application, run java program web, write java program ask user input scores, write java program percent passing, write java program percentage, write java program implements simple game, write java program, write java program convery xml sql, write java program asks users enter, java program web data extraction, run java program web application, how to do web scraping in java, web scraping in java with jsoup, how to write java program in eclipse step by step, how to write java program in eclipse step by step pdf, how to write java program in eclipse youtube, how to write java program in eclipse, web scraping in java tutorial

About the Employer:
( 22 reviews ) Yavne, Israel

Project ID: #30935796

Awarded to:


Hi, I'm new to I went through your instructions and completely understood the task. I have experience in Java and in HtmlUnit, so I'm sure I can finish this project. I have some questions on it, which I More

$200 USD in 7 days
(0 Reviews)

6 freelancers are bidding on average $370 for this job


Web scraping expert I use python language. My scripts works on windows, mac or linux, but linux is preferably. I can schedule scripts on server if it is required. I have more 100 finished projects (google scraping, fac More

$140 USD in 7 days
(131 Reviews)

Hello, Warm Greetings! I am a Java developer working on Java technology since 7+ years having hands on windows and web development experience. I would like to help in your application development. To proceed further, More

$250 USD in 10 days
(75 Reviews)

Hi, Hope you are doing well, I went through your requirements, I am pretty much confident that I can complete this task as I am expert in automation using html unit driver(headless) have done similar kind of projects a More

$889 USD in 7 days
(29 Reviews)

I have gone through the requirement, read the task as well I just checked for a random date and I was able to convert the json to csv from below url [login to view URL] The s More

$600 USD in 7 days
(2 Reviews)

Hello JAVA EXPERT I have read your description and I am so interested in your project. You can see well experienced and skillful Java +15 years of experience in software development. Confident in your project and I can More

$140 USD in 7 days
(5 Reviews)