Collect data / crawl webpages / scrape web data

Completed Posted 5 years ago Paid on delivery
Completed Paid on delivery

Collect daily car ad data from the following web pages:

[login to view URL]

[login to view URL]

and store the initial data and any change (for instance price change, km change) on a Postgre database. The script should be developed with Python and should not be blocked by the website due to too frequent queries. The information for each car should be stored in a tabular form on Postgre. When the ad is not available anymore, it should be stored with a closing entry as well. The main goal of this project is to track how long a car ad is posted and how frequently the price and mileage changes until the car is sold.

Data Mining PostgreSQL Python Web Crawling Web Scraping

Project ID: #18539148

About the project

33 proposals Remote project Active 5 years ago

Awarded to:

ramzitra

Hi, I am interested in your project related to build a scraper to pull ads data from [login to view URL] and autoscout24.ch. I checked both websites, autoscout24 has at the moment 147 240 ads and [login to view URL] has 9960 More

$500 USD in 7 days
(496 Reviews)
8.4

33 freelancers are bidding on average $478 for this job

mhmhz

Hi I know you need in python. But let me know if you can accept the tool to be done in C# and run in windows and save data in mysql Can work on a demo Thanks

$500 USD in 5 days
(115 Reviews)
7.6
gangabass

I checked both sites and I can provide you fast and effective Python (Scrapy) spiders that will check all ads and save information into PostgreSQL database just like you want. My script will check any mileage or pri More

$500 USD in 3 days
(431 Reviews)
7.6
mantislin

Hi sir, This is Lin and I am scraping expert, please check my reviews then you will know. Can we discuss more details about this project? Thanks, Lin

$400 USD in 6 days
(330 Reviews)
7.7
lkhelladi

Hello, I'd be glad to develop a python tools that scraps and analyses data related to car selling ads . Looking forward to chat with you soon for more details. Best regards,

$277 USD in 3 days
(167 Reviews)
7.3
mirniyazuddin92

Hi there, I can collect daily car ad data from the following web pages. If you have questions or doubts about anything, please feel free to ask me. Sincerely, Mir

$250 USD in 10 days
(207 Reviews)
7.6
mingxiao2008

Hello, Dear How are you? I am very interested in your project and am ready for discussing with you about project for now. I have experienced in developing Data Mining, PostgreSQL, Python, Web Crawling, Web Scraping More

$400 USD in 10 days
(54 Reviews)
7.1
motiur03

Dear Hiring Manager, You may see my profile here: https://www.freelancer.com/u/motiur03.html I am writing in response to your advertisement for scraping vehicle website, I have prior experience in similar job. More

$250 USD in 5 days
(138 Reviews)
6.9
schoudhary1553

Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. More

$500 USD in 10 days
(60 Reviews)
6.6
AwaisChaudhry

Hi there, I have checked the details I have rich experienced with Data Mining, PostgreSQL, Python, Web Crawling, Web Scraping. Please initiate chat so we can discuss this job.

$555 USD in 10 days
(8 Reviews)
6.1
kkc264043kkc

can develop script in Python. can think it on daily basis and update the postgres database. want to know more about ad These are my skills related to web scraping and crawling Have done scraping in CasperJS Phantomjs More

$555 USD in 10 days
(55 Reviews)
6.1
farooq4161

Greetings, I have read your requirements and interested to complete this project. As i have done several projects before and same can be verified by my profile. It's my routine job to scrape. Looking forward to hear f More

$333 USD in 5 days
(65 Reviews)
6.2
ZhenExpert

I'm a web scraping and bot developer with 5 years experiences. I developed many bots using selenium technology. Selenium is automation test tool and it uses chrome web driver to automate the chrome browser action. I More

$555 USD in 10 days
(5 Reviews)
5.6
osmanaydin

Hello sir, Please take a look at my reviews and portfolio. I have completed web/data scraping jobs many times. I am interested in your project as well. I would like to discuss details via pm. I look forward to heari More

$499 USD in 5 days
(49 Reviews)
5.7
damilareisaac

Hi there, I can help you complete this project. I will be looking forward to hear from you. Please contact me on PM for details.

$250 USD in 10 days
(43 Reviews)
5.6
lightingdavid

Hello? How are you? I have good experiences in "Collect data / crawl webpages / scrape web data" as you can see my profile for these (Data Mining, PostgreSQL, Python, Web Crawling, Web Scraping). I have been working More

$555 USD in 3 days
(34 Reviews)
5.3
sonarkaushik

Sir, I am well versed in these kind of jobs and can do your project as per requirement. ***I am ready to start Waiting to hear from you. with thanks and regards Relevant Skills and Experience Web scrapping, e More

$555 USD in 7 days
(29 Reviews)
5.3
dreamci

Hello, Full Stack Scraping Expert development team is ready to serve you. We can build an online scraper and admin panel to manage the data. We are working on hourly rate 35usd/h Please check my profile and m More

$555 USD in 10 days
(12 Reviews)
4.5
AhmadSameer

Hi, I'm a System Engineer with coding skills. I had developed tons of scrapers and crawlers. I can help. Regards.

$555 USD in 10 days
(12 Reviews)
4.5
Shashidharsp19

hi, I am a professional web scraper, with experience of 4 years. I can scrape any site with antibot detection using proxies., I check this site also. looks easy I can do it

$455 USD in 6 days
(15 Reviews)
4.3
ludwig333

Hi I have read your description in more details and have interested in your project. I am a star in this field and can do it ahead of schedule perfectly. I would like to have a discussion with chat to get more about More

$600 USD in 20 days
(4 Reviews)
2.7