Closed

Fix PHP code for website product scraping -- 2

I have a custom code that is used to scrape data from a different website and save images and data in MySQL database. It uses simplehtmldom and Nokogiri to scrape and parse data, angrycurl for proxy connection, etc.. MVC framework is used through the code.

PS: please write 'nokogiri' in your response to make sure you have read the description.

There are bugs and issues that need to be fixed with the code and I need to developer who understand scraping to look into it.

Issues are:

1. fix all the scrapers for the different website to ensure there is no errors and the correct data is being scraped with the correct logic applied before saving into database.

2. There is a refresh mechanism so if the information of a product is changed, products are listed in the refreshed products page. There is a bug prevent this from working.

3. The script also greater XML and csv with product information. Some changes are required to the data and layout of these files.

4. There are currently 2 x [login to view URL] files, so configuration information is saved in two files. Need to merge them info one fire and ensure its secure/safe.

5. Optimize code/script for security and speed of scraping.

Please refer to the attached screenshots.

Skills: PHP, Web Scraping, MySQL, MVC, Scrapy

See more: fix php code, zend encryption secure php code website, html fix php code, web scraping php, web scraping php curl, web scraping, php web scraping tutorial, php scrape web page specific data, web scraping python, scrape data from multiple web pages python, learn how to extract data from websites with php, screen scraping in php, scrape content from website php, rip php code website, integrate php code website, can collect feedback using php code website server, find programmer fix php code, iframe virus fix php code, php code website movie thumbnails, php code website

About the Employer:
( 4 reviews ) Sydney, Australia

Project ID: #26561702

8 freelancers are bidding on average $53 for this job

smsaurabhv

Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON More

$30 AUD in 2 days
(101 Reviews)
5.8
raminde

Have over 10 years of experience in data mining/ Web scrapping/ Scraping Bots/ Chrome/Opera Extensions I have done it all. Tell us your source and we will put it in excel for you, Or we can even give you filtered resul More

$56 AUD in 1 day
(11 Reviews)
5.8
vovapod

Hello! Can you provide full documentation for API? What exact functions of API do you want to use? Thank you for your time.

$20 AUD in 7 days
(30 Reviews)
4.7
chatharnisar

nokogiri [login to view URL] I saw your project description carefully and i'm very interesting in fix all the scrapers But i have some question about your project. If u have enough time to discuss about your project with me ,pleas More

$100 AUD in 2 days
(3 Reviews)
2.5
greendeam1216

"nokogiri" Hello, I have good experiences in working with scraping and I have already worked with lots of web scrapers for product auto checkout, google map scraping, python, PHP, etc. I can start immediately and I w More

$100 AUD in 3 days
(1 Review)
1.2
swapnaja2292

HI, We're a Website design and development company with a focus on user-centered design while helping our clients achieve the desired result. We reviewed the job post and we're qualified to deliver the solution that y More

$20 AUD in 7 days
(0 Reviews)
0.0
Codexnow

Hi, I've carefully read your project description. I am a WordPress & Shopify expert. I am very interested in doing this project. I will build your E-commerce/Online shop By WordPress Premium theme(70% E-commerce websi More

$20 AUD in 7 days
(0 Reviews)
0.0
fillips8

Hello! I can provide you full support for this project. I have high experience with web technologies and I am pretty sure I can help you. So, let's start!

$75 AUD in 7 days
(0 Reviews)
0.0