- write a crawler for [url removed, login to view] and [url removed, login to view] using [url removed, login to view] python stack.
- We need to extract the following fields:
- property-type : studio, 1 bedroom, 2 bedroom, office, shop etc.
- city (currency we only support Sofia).
- street (if possible).
- building type (brick, epg, etc, if it exisits)
- image_urls (no thumbnails, only the large format property images).
- ad-type (rent / buy)
- square meters
- date the ad was last updated
- contact_details (agency, broker, phone number)
- additional_details (anything else you extract)
- Both crawler need to share their data model.
- The db has to be PostgreSQL
- I would like these two cralwers to also have test, to ensure our crawling is working.
Please research and find a way to test without needing to hit the server, then an easy way to update
the test with the latest info from the crawling target website (so if the website changes we can easily update our tests).
I hope this is well defined.
Feel free to reach out with any questions you might have?
25 freelancers are bidding on average $181 for this job
Hi, I have many experience like this job. Relevant Skills and Experience I have 6 years of experience like this job If u hire me, i'll do best for u. Trust me. Thank u. Proposed Milestones $155 USD - Milestone