Closed

write a crawler

- write a crawler for [url removed, login to view] and [url removed, login to view] using [url removed, login to view] python stack.

- We need to extract the following fields:

- property-type : studio, 1 bedroom, 2 bedroom, office, shop etc.

- city (currency we only support Sofia).

- street (if possible).

- neighborhood

- building type (brick, epg, etc, if it exisits)

- image_urls (no thumbnails, only the large format property images).

- ad-type (rent / buy)

- square meters

- currency

- price

- date the ad was last updated

- contact_details (agency, broker, phone number)

- additional_details (anything else you extract)

- Both crawler need to share their data model.

- The db has to be PostgreSQL

- I would like these two cralwers to also have test, to ensure our crawling is working.

Please research and find a way to test without needing to hit the server, then an easy way to update

the test with the latest info from the crawling target website (so if the website changes we can easily update our tests).

I hope this is well defined.

Feel free to reach out with any questions you might have?

Skills: Data Scraping, Javascript, Scrapy, Web Crawling, Web Scraping

See more: Write a program that handles the basic data structures (i.e. the devices and their queues) in an operating system., write a story ending with the line i should never have behave like that, write a feature article on the buhari presidential media chat putting into cognisance the questions raised and analysing the res, write aprograme to find all the prim number between 1 and 50 a prime can be divided evenly only lori self, free car model data, write crawler using php, write program accept number store digits array, average number polys game model, php write xls file number, number polys game model, write crawler php, car model data, auto model data, write crawler

About the Employer:
( 0 reviews ) Plano, Serbia

Project ID: #15213496

26 freelancers are bidding on average $176 for this job

$257 USD in 10 days
(0 Reviews)
0.0
htmn

ITEngineer, 6 years of experience in web scraping/crawling I work mainly on ecommerce website, Relevant Skills and Experience python/scrapy/linux/postgresql I know how to crawl without agressing server Proposed Miles More

$266 USD in 20 days
(0 Reviews)
0.0
aqueebtechnology

Hello My name is aqueeb I am an expert in programming have completed 200+ based client satisfaction Relevant Skills and Experience I have work experience of more than 10 years. I have checked your project and I am More

$30 USD in 1 day
(0 Reviews)
0.0
qprotex

Hello, My name is Miguel Febres and you can locate my resume and certifications in the following links: [url removed, login to view] [url removed, login to view] In my 10+ years of e More

$155 USD in 3 days
(0 Reviews)
0.0
leavetop

Hello there , i will create scraper for 2 sites with a monitor. You can check scraper without check server. Relevant Skills and Experience Scraping

$155 USD in 1 day
(0 Reviews)
0.0
adilhussain0411

Hello! I am expert in web web crawling and i am certified web scrapper expert i have completed 100+ Project inweb scrapping. More

$30 USD in 5 days
(0 Reviews)
0.0
NomiHD

I have experience of extracting information from different websites using PYTHON's framework scrapy which yields information very quickly and yet in a reliable fashion . Relevant Skills and Experience I have been writ More

$250 USD in 5 days
(0 Reviews)
0.0
bytessolution

A proposal has not yet been provided

$150 USD in 2 days
(0 Reviews)
0.0
$155 USD in 3 days
(0 Reviews)
0.0
pkudriavcevas

® THIS IS NOT GENERAL PROPOSAL ® My name is Povilas and I would be perfect for your task. I'm specializing in data mining and can provide you top quality web crawlers. I have experence in this field from easy data s More

$400 USD in 14 days
(0 Reviews)
0.0
$155 USD in 3 days
(0 Reviews)
0.0
$197 USD in 1 day
(0 Reviews)
0.0
vantuanvn

Hello my friend, I am Tuan Tran from Vietnam with 12 years of software development with many running products in web (PHP laravel, Yii, Symfony… ), Java , J2EE and mobile. (android, iOS and hybrid). Relevant Skills a More

$155 USD in 3 days
(0 Reviews)
0.0
techradius

Hi, Greetings! Embarking our excellence in the world of technology, we, at Techradius Hitech Pvt. Ltd. stand strong with over five years of experience in the development field of the web and mobile applications. W More

$155 USD in 3 days
(0 Reviews)
0.0
$155 USD in 3 days
(0 Reviews)
0.0
$35 USD in 3 days
(0 Reviews)
0.0
mantislin

Hi sir, I am scraping expert, I have did more than 350+ scraping project, please check my feedback then you will know. Can we discuss more details about this project? then I will provide example data/scr More

$188 USD in 5 days
(0 Reviews)
0.0
celestialUK

Hello, i can make a crawler for these sites, not using python but PHP simple_html_dom Relevant Skills and Experience PHP, simple_html_dom Proposed Milestones $50 USD - crawl [url removed, login to view] $50 USD - crawl h More

$150 USD in 3 days
(0 Reviews)
0.0
Angel521

Hi, I have many experience like this job. Relevant Skills and Experience I have 6 years of experience like this job If u hire me, i'll do best for u. Trust me. Thank u. Proposed Milestones $155 USD - Milestone

$155 USD in 3 days
(0 Reviews)
0.0
$277 USD in 7 days
(0 Reviews)
0.0