Webscraping using PHP or Python


I need a script which can scrape similar data from 4 different websites. Targeted data types are – links, text and numeric. After scraping I need to arrange, sort and calculate all data before the show to my website.

Targeted websites add/change/update their data around 4-5 times per hour. So, I need my script run/scrape automatically 4-5 times per hour.

Similar data found on multiple sites should be overwritten/skip/updated while scraping. Similar numeric data should be overwritten/skip/updated or replaced by higher/lower value while scraping. Some data should be overwritten/skip/updated by early/latest date and time.

There are some custom calculators are present on targeted websites. If those calculators can’t be scraped then those calculators have to be built with collected numeric data.

An admin panel needs to add/modify/delete data manually. Need to start/stop scrapers manually. Need to show the scraping reports. Need to control/modify banners on the website.

I have a basic website for now which I'll need more works on it later.

Thank you.

Skills: Database Programming, PHP, Python, Software Architecture, Web Scraping

See more: export mysql excel using php, free flash forms using php, using php script post xml server, select download path using php, save flash image using php, can save entire page pdf format using php, access mysql port using php, mysql xml file using php, convert php python, csv reader using php, generate worksheets using php, import pdf script using php, read xml using php, upload email attachment using php, setting photo website using php mysql, create online admission using php javascript html, calculate journey using php, convert md5 original value using php, hello i obtained nulled a script using php

About the Employer:
( 142 reviews ) Dhaka, Bangladesh

Project ID: #17566453

35 freelancers are bidding on average $171 for this job


Hello, how are you? I'm interested in your project very carefully. I have being developed many scraper for 8 years by now so that I can build a script using php or python to add/change/update the data on your website More

$155 USD in 3 days
(101 Reviews)

Hello. How are you? I have just read your requirements and it is no problem with me. I am sure I can give you perfect result. Until now I have developed many python scraping app. No problem. If you hire me I will More

$250 USD in 3 days
(52 Reviews)

I have reviewed your requirement, as you mentioned update 4 to 5 times in a hour, then script need to also update 4 to 5 times in an hours, that is fine, but you also want a facility in admin panel there you will start More

$250 USD in 7 days
(38 Reviews)

Hello sir. I have reviewed your job posting carefully and came to the conclusion that I could help you. Actually as an experienced WEB developer for 10+ years, I have so many experiences in building/revamping w More

$255 USD in 3 days
(34 Reviews)

Dear Sir. Glad to meet you. I'm Web developer specializing in web scraping crawling and indexing web pages. Skills: python, scrapy, selenium, requests, beautifulsoup, mechanize, lxml, urllib2, automation, bots, More

$155 USD in 3 days
(64 Reviews)

Hello, I have wide knowledge on both server-side (PHP / MySQL) and client-side (HTML5 / CSS3 / Boostrap / Uikit / LESS / SASS / Javascript / jQuery / Vue.js) development on mid to big web projects. Please take a More

$277 USD in 4 days
(32 Reviews)

Hi, i can take up this task and will ensure the task is done to your level of satisfaction. I have strong experience in scraping though script and Mysql. Looking forward to hear from you.

$155 USD in 3 days
(19 Reviews)

Hi, Can use either python or PHP curl to scrap data, Already worked on similar project and have case study which will give you idea on how we implemented the process. [login to view URL] More

$155 USD in 3 days
(7 Reviews)

Hello. Thanks for the opportunity. I have gone through your project details. i can continue on your website.I have 5 year experienced with symfony, wordpress , magento , angular JS , Laravel , codeigniter, sm More

$177 USD in 3 days
(43 Reviews)

House object detection for an Australian client -Traffic light detection for a self-driving car startup -Logo detection in a video stream for a Israeli brand endorsement company [login to view URL] - classification for different f More

$155 USD in 3 days
(18 Reviews)

Hello! I am a python developer. I looked at your project and it seems interesting. I have all necessary skills required for this project. Ping me to discuss in detail.

$125 USD in 2 days
(28 Reviews)

I am specialize in website design and development Graphics work and are excited for the opportunity to work with you in accomplishing your goals. I am Good atDatabase Programming, PHP, Python, Software Architecture, We More

$155 USD in 9 days
(23 Reviews)

Can provide you python script which can be run over server through the cron job to fetch data in interval of 4 to 5 [login to view URL] to know more about the data fields which need to scrape. these are my skill related to More

$188 USD in 3 days
(25 Reviews)

Hi, I am PHP expert with more than 10 years of experience in PHP, MYSQL, MVC like CI, CAKEPHP, XSS and CSRF attacks, database optimization, Webservices like SOAP, REST, JSON and Javascript framework like Jquery, Ex More

$155 USD in 3 days
(11 Reviews)

Ready to start the work to scrape data from 4 different websites using PHP or Python, We can discuss more over chat, Thanks Regard Arjun S. Please check my recent work Scrapping projects link : [login to view URL] More

$300 USD in 3 days
(23 Reviews)

Hi. I have several questions. What are the four websites? Do you want the scraper to run on the same server as your site or should it be some standalone api thing ?

$222 USD in 3 days
(4 Reviews)

Dear Client, We are expertise in php, core php, CMS, HTML5, CSS3, bootstrap, WordPress, OpenCart, Magento, PSD to HTML, Angular JS, Node JS photoshop, OPencart, Codeignitor, Laravel and many other technologies. We have More

$250 USD in 8 days
(77 Reviews)

I am having experience from past 9+ years & completed 120+ projects in PHP development. I can easily achieve the results that you are asking for. I can surely help for scrapping in php. Looking forward from your en More

$100 USD in 12 days
(20 Reviews)

Hi, I am web scraping specialist (crawled some page in france, swiss, hungary), if you want i can help for you this project. Regards, Josef

$222 USD in 10 days
(1 Review)

Hi, i can do this work for only 199$.. Ping me for more details...

$198 USD in 3 days
(8 Reviews)