make a scraper software
Budget $10-70 USD
Job Description:
hi. you can do this in whatever language you want. I am a vb.net coder with 16 years experience and i want you to make a software due to lack of time. i am looking for someone to hire multiple times for years to come, that can code at an ok price for me, so this is not a one time project, if you can do it, you will be hired again by me in the future. as a test,i want to make a software for myself (because i lack the time) that scrapes from a website, price etc to an excel file. this is the site, you can right click and translate from romanian to your language in your browser. i am not interested in python or others. it's important that you know regex to extract the info details. [login to view URL] these are the things that have to get scraped. [login to view URL] and the links to each ad and then go to the link and scrape more details [login to view URL] while getting the pictures of the ad. use regex to get the details from the pages. get all the details on both the search page and the ad page (with the price history and map if you can, if not, it's ok without too). after putting the details each in a row in excel,the software should make a screenshot of the whole ad page if possible(if not, it's ok), the details at "istoric pret" ,history price are optional also. the software should be able to run in the background minimized without using keyboard and mouse. it should put the whole source code of each page in the last column of the excel file. i must be able to schedule scraping every x days so it would start by itself and scrape again the prices for the links of each ad and put it in a column if it is different than it was x days ago(also add the date when that new price was scraped). from the column on the right of each ad where prices from other sites appear, those prices should be put in columns along with the link to the external site. please bid with the lowest amount you could do this project. it must be made in such a way that it will allow me to put in more websites and regex keys made by me. this is the actual interface it will have [login to view URL] and this an example of how it would work. similar but with more info (almost all the info without the map part) from the description page of each ad [login to view URL] it should able to handle more projects/sites in the [login to view URL] workflow is that 1. i click in the first listbox "project name" [login to view URL] the links of that project appear in the second textbox [login to view URL] software applies prefix and suffix to each line in the textbox, then goes in those links and scrapes using surface column [login to view URL] surface column has a checked item, then it will go in the links of that column, and scrape using the deeper column regex list. It should use a different selenium script for each scraping project so that i can set the login for each site. it should not have visible windows popping up, everythings must be done in the background. regex is mandatory. the project should be able to do multitasking, scraping with multiple projects in the same time, you can use separate exe files for example, so that the interface is the same and the workflow, but each exe starts a different project. ignore the scheduling part in the above images,but the other parts must be included (suffix prefix etc). what is the minimum price you would ask?
11 freelancers are bidding on average $50 for this job
I can do it using .NET c#. Greetings, I have gone through your project description. I find myself as a perfect fit for this job. I am working as a Python Developer from last 2 year. Some of my expertise is in the fie More
Hello! How are you? I'm a python development expert with 8+ years experience and I'm very familiar with web scraping and data mining using BS4 , selenium and undetectable chrome driver. I'm also very familiar with han More
Hi there, I can work on this job right now. I would like to work with full commitment and I have good communication skills and years of experience. Ready to start now. Kindly direct message me.
Hello, Nice meet you! I have read your project requirements and then I am sure I can complete that project. I can help you. Thank you.
GOOD IN PYTHON WEB SCRAPPING EXPERT PHP GURU Hello, I have read the job description and your work is doable. I will help you get detailed information. Kindly share more details on the project to get started. i will hel More