In Progress

Advanced web scraping, requiring javascript execution

REVIEW DETAILS IN ATTACHMENT BEFORE BIDDING! A bid within 5 minutes of posting the project means you didn't read the details and will not be considered! Award will be no sooner than 48 hours -- so take your time. Past projects have resulted in A LOT of follow on business for the winning bidder.

Project details:

Must mimic browser behavior in Java to obtain the target URL, which contains a frame. Access to the frame URL does not work outside of enclosing scope (can also mimic the referrer and skip the outer URL). Given a name and a file number .... submit the name to the frame's form for lookup, receive the summary of potential matches, parse to find the one matching the given file number, and retrieve the detail page with associated link. The submission of form fields and links require the execution of javascript to work. Prior simple web scraper failed after a recent update to the target site.

"Htmlunit" claims the ability to mimic most browsers, using the Rhino JS engine to execute the javascript. This would be a trivial project for an expert in Htmlunit or some other technology that can execute JS during scraping.

Please do not respond if this would be a learning experience for you. If possible, please provide examples of your similar JS-generated scraped sites.

Skills: Java, Javascript, Web Scraping

See more: web scraping advanced, web scraping javascript ajax, php web scraping javascript, javascript web scraping python, python web scraping javascript, web scraping javascript net, advanced php web scraping tutorial, web scraping software review, web scraping javascript interpreter, web scraping asp page php, call net web service javascript classic asp page, advanced web scraping, javascript web scraping, java web scraping javascript, java web scraping review, web scraping page scraping job posting, web scraping javascript, javascript execution address bar, web service web application aspnet javascript, web scraping visual basic

About the Employer:
( 9 reviews ) Jersey Shore, United States

Project ID: #15663648

Awarded to:


Hi there, I will prepare a JAVA class for you to go thru the website and capture all of the details. I went ahead and prepared a demo for you: [url removed, login to view] [url removed, login to view] This page loads website dynam More

$300 USD in 0 days
(67 Reviews)

17 freelancers are bidding on average $146 for this job


Hi I fully read the documents and can do the project. I know you want Java, but i can develop quickly in C#, let me know if you want to see a demo. Thanks Relevant Skills and Experience Scrape Proposed Milestones $15 More

$155 USD in 0 days
(79 Reviews)

Dear Sir I read your proposal and that is good job for me You can visit [url removed, login to view] , then you can see my past work for 2 years I have rich experience in web development and software development. I th More

$100 USD in 3 days
(20 Reviews)

we recently completed project using Java to scrap OLX ads and store images , title and description in directory given in input . Before this we completed ebay item number and brand detail project Relevant Skills and E More

$164 USD in 2 days
(32 Reviews)

prefer phantomjs to htmlunit. if you like will discuss more and start. Relevant Skills and Experience well experienced in web scaping Proposed Milestones $166 USD - milestone 1

$166 USD in 3 days
(49 Reviews)

Hi Sir, Im a Python Programer. I have created many Bots to scrape the websites like Alibaba(suppliers data), Linkedin, Facebook, Trulia(real estate, homes), [url removed, login to view], Amazon(using API), Aliexpress, yellowpages(au,nz More

$150 USD in 3 days
(59 Reviews)

Hi Good day! I am software engineer & gone through your project requirements, I am enthusiastic to work with you. I have in house team of designers & developers to complete task with daily updates. Relevant Skills a More

$155 USD in 3 days
(5 Reviews)

Hello sir, I have completed many complex scraping projects before. I will use selenium to full automate the user behavour. Please check out my profile for previous jobs and let me know.

$100 USD in 3 days
(28 Reviews)

Hi! My name is Igor, I have strong experience with Java and Javascript for 3+ years, I can do it for you Can we discuss details? Relevant Skills and Experience Java, Javascript Proposed Milestones $122 USD - Final p More

$122 USD in 2 days
(8 Reviews)

Over 8 +years experience writing almost exclusively web scraping code. I've done it all. I can scrape all LinkedIn profile My languages in order of experience and use is Python, JavaScript, PHP. Python libraries ( sele More

$30 USD in 3 days
(5 Reviews)

Hello, I have good experience in web scrapping. I have done 'scrapping ads from given site' which is similar to [url removed, login to view] Relevant Skills and Experience Java, python, web drivers, javascript and it's framewo More

$170 USD in 2 days
(5 Reviews)

This is NOT a java solution proposal, but rather a JAVASCRIPT solution. I too have 38 years coding experience, but have settled on phantomjs or nodejs/headless chrome for Frames, AJAX, Angular. Relevant Skills and Ex More

$250 USD in 5 days
(4 Reviews)
$155 USD in 3 days
(1 Review)

dear sir I am fully ready for your job. If you select me as a contractor, I will reply good quality and rapid turnaround. Relevant Skills and Experience My ability is just suitable for your job. You can see it from my More

$155 USD in 3 days
(1 Review)
$250 USD in 2 days
(0 Reviews)

Hello I am ExpertD.I am professional Developer and i am expert in Java, Javascript, Web Scraping .I have Completed 500+ based projects in programming with 100% client satisfaction. Relevant Skills and Experience I h More

$30 USD in 3 days
(0 Reviews)

HELLO My name is Azaan Ayaan. i am professional developer and I am Expert in programming i have completed 200+ based projects in programming with 100% client satisfaction. I have working experiences of more than 10 y More

$30 USD in 3 days
(1 Review)