Closed

Write script or code to harvest data from websites

### SIMPLE DESCRIPTION ###

I would like someone to write a semi automated script/code or software that will search [login to view URL] using a custom search criteria. It will then collect all the addresses of all the properties that appear in the search and save them.

Then I need a second script/code or software to search all the saved addresses on another website and collect additional data which will be saved in a Microsoft Access Database (.mdb) file for a mail merge.

### DETAILED STEP BY STEP EXAMPLE ###

1) Search [login to view URL] for rental properties in Toowong, QLD 4066 using the following search criteria:

- All property types

- Beds (min): any

- Beds (max): any

- Price pw (min): $350

- Price pw (max): any

- Available date: Any date

- Surrounding suburbs: no

[login to view URL],+qld+4066/list-1

PLEASE NOTE THAT THE SEARCHES WILL ALWAYS BE FOR "RENT" SECTION OF THE WEBSITE, BUT I WILL NEED THE ABILITY TO MODIFY ALL THE OTHER SEARCH CRITERIA

2) The script will then collect all the addresses for all the properties that appear in this search. Please note that several pages appear in the search. eg:

- [login to view URL],+qld+4066/list-1

- [login to view URL],+qld+4066/list-2

- [login to view URL],+qld+4066/list-3

- [login to view URL],+qld+4066/list-4

and all the addresses must be saved, eg:

- 1/39 Brisbane Street, Toowong, Qld 4066

- 2/21 Glen Road, Toowong, Qld 4066

- 601/2-6 Land Street, Toowong, Qld 4066

- 204/573 Coronation Drive, Toowong, Qld 4066

- etc etc

3) all the saved addresses will then be used to search on https://rpp.rpdata.com.... Please note that this website requires a paid account and login which will be supplied by myself.

4) The script will search all these addresses one by one. Please see image 1 for an example of the first address search. PLEASE NOTE THAT ENTERING THE ADDRESS AND PRESSING 'ENTER' DID NOT FIND THE PROPERTY. I had to click the correct address from the drop down box first. Please also note that some properties will not be found and the script needs to be able to filter out as many as possible.

5) Please see image 2 for search results for first property

6) Please see image 3 and 4 for the data shown for that property

7) The script will then collect the address shown in the 'ownership' section. PLEASE NOTE THAT I HAVE HIDDEN THE EXACT ADDRESS FOR PRIVACY REASONS.

eg:

46 XXXXGTON TCE

ROBINA QLD 4226

8) Data collected will then be saved in an .MDB file. Please see image 5 for the format to be used. Please note that the addresses need to be split into columns as shown in image 5.

- 'Owner Address Line1' is the first part of the address that was found in step 7

- 'Owner Address Line2' is the second part of the address that was found in step 7

- 'Field1' is the address collected in step 2

- 'Rental Suburb' is the suburb taken from 'Field1'

#########

I am open to suggestions. If any of this script is too difficult/expensive to write then please recommend a better option. Some parts can be manual if needed.

Please message me if you are interested. I will be ignoring automated bids so please show that you understand the job and explain how you will do it :)

Skills: Javascript, MySQL, PHP, Software Architecture, Web Scraping

See more: write code transfer data sql server excel, collecting data websites php script, create script harvest data, extract data from webpage, scrape data from website python, extract data from website to excel, web scraping tutorial, html scraping, web scraping, how to download data from website using python, script to pull data from website, script read data websites, script scrape data websites, write java script code odd numbers, write script macro copy data website excel, write script copies data excel clipboard, showing data count field pivot script code, data scraping php script code, php script request data websites, script bot gather data websites

About the Employer:
( 41 reviews ) Hawthorne, Australia

Project ID: #17977086

45 freelancers are bidding on average $1180 for this job

tarunmehan

Hello, Greetings for the day! I am ready to help you on an immediate basis to develop script that will search [login to view URL] using a custom search criteria. I have 5+ years of experience in PHP, Wordpress, More

$1200 AUD in 24 days
(81 Reviews)
7.6
pointlogic

Hello, I always provide fastest results with quality. I have an experience of more than 10 years in web development and maintenance. I have in-depth knowledge of php, mysql, javascript , jquery, payment system integrat More

$750 AUD in 20 days
(311 Reviews)
8.1
seaanddream

Hi, my name is Selim. I will write a java based bot with a sipmle UI for you to enter your search criteria and run it easily... I read your `[login to view URL]` project descriptions carefully before bidding. I checked More

$900 AUD in 7 days
(253 Reviews)
7.7
mhmhz

Hi I checked your requirements and i can build fully automated scrapers that can do the search then utilize the addresses. and finally export data to Access DB. PS. the scraper will be a desktop application that More

$3000 AUD in 5 days
(202 Reviews)
7.7
raindropsin

#Scrapping It seems like I need to create SCRIPT which scrapes data from that [login to view URL] real estate website and after gathering that data, need to store it and then also search that address with More

$2000 AUD in 20 days
(106 Reviews)
7.7
AndreiMk

Hi, I visited [login to view URL] to see how it works and reviewed your screenshots. I would suggest to make it as a standalone Windows application for the following reasons: - if it is for your personal use, why ma More

$1250 AUD in 14 days
(111 Reviews)
7.4
phpdeveloper100

I am expert in scrapping data from other website with all criterias as needed genraly , sometimes using proxies also , Please open Message box so that we discuss it in detail Expertise ================== - PHP More

$1186 AUD in 20 days
(73 Reviews)
7.2
ineedWorkJob

Greetings sir, how are you today sir? hope fine. Sir, I have read your project details and i will develop a windows software that will scrap the data from your 1st website based on your set parameters on the sof More

$1000 AUD in 5 days
(188 Reviews)
7.1
junkyfunky

Hello, I've read your project description and I want to tell you that I can write a semi automated script for you that will search [login to view URL] using a custom search criteria exactly as per your requirements. More

$750 AUD in 8 days
(135 Reviews)
6.9
kyrbatow

Hi. I think, all steps are possible to implement. I can use phantomjs to use the same actions as real user. Also I can use http requests. For example, step on screeenshot 1. When you fill in address text, site retu More

$1000 AUD in 20 days
(67 Reviews)
6.8
superman1987417

Greeting. Thanks for your job posting. I've read your job posting carefully and I am very interested in it. As a high skilled Scraping expert, I can do your job perfectly. I believe I possess the all required ski More

$1500 AUD in 20 days
(74 Reviews)
6.9
bestit4u

hi Nice to meet you. I read your job posting and I am very interested. first, Thanks for your detailed description. I think you want to make a automation bot. Yes. I have a good experience in building automation More

$1250 AUD in 20 days
(116 Reviews)
7.2
WebColorIn

All you need is a Chrome extension. Easy to use and customize, add features as well. I will build extension UI so its friendly to use. Will need API ( I will do this) that will post data to sql database if required. More

$1500 AUD in 25 days
(54 Reviews)
6.7
luiswilliam

Hi, how are you? I'm talented web developer. I have completed lots of professional web projects successfully before. And I am continuously supporting all projects which I have done for clients.,.,,///;' However, I' More

$1250 AUD in 20 days
(65 Reviews)
6.6
zekovicm

Hi there,I am Miljan,Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with scraping [login to view URL] ! I can start immediately a More

$1111 AUD in 10 days
(68 Reviews)
6.8
polarjin2017

Hello? How are you? I have good skills in So I can complete your job in time. Hope to work with you. Thank you.

$800 AUD in 3 days
(99 Reviews)
6.7
devi222

Hi Sir, I have scraped the [login to view URL] site before for buy, rent, sold and agents data. I can create a python 3.6.5 script(GUI) will allow you to keep the addresses in the text file or excel file as a list and h More

$1000 AUD in 5 days
(110 Reviews)
6.5
schoudhary1553

I am expert who understands the value of time. I pride myself in my attention to detail. I am very hard working and aim to deliver in less time than quoted. I want to make you, my employer happy without changing my bid More

$1500 AUD in 20 days
(61 Reviews)
6.4
Batista111

Hello, Similar website [login to view URL] Please have a look at my freelancer profile. https://www.freelancer.com/u/Batista111 As you can see I have worked on more than 100 projects includin More

$1250 AUD in 20 days
(111 Reviews)
6.6
novepi

Hi there, I've checked each and every step individually, the requirements are quite clear. To be honest, I'm truly surprised to see that there's no serious measure for bot mitigation on [login to view URL] so this par More

$1000 AUD in 5 days
(47 Reviews)
6.1