webscraping using scrapy/django

[login to view URL] should fetch multiple urls from mysql db(urls are manually product matched and updated in product_urls table) and crawl one by one based on competitor and product id and the parsed data should be inserted in competitors_price table.(done using native query but should be implemented using django models)

2. on completion scrapy should notify success/failure to backend server using post rest api.

3. scrapyd must be implemented over scrapy

4. django rest should call the scrapyd passing competitorID and productID as parameters.

Skills: Python, Software Architecture, Windows Desktop

See more: using open realty administrative backend, using excel macro refresh web query, using frontend swing communication backend, spider using scrapy, backend query javascript sql form, using scrapy, using swfupload django, webscraping using rapidminer, using access 2010 frontend backend sharepoint 2010, using scrapy data mining, using scrapy tor, using correct tables schema create query using either, python scrapy django, using heroku mobile app backend, scrapy django, freelancers capable of giving services for websites using python django technology in bulgaria, Django Restful backend, install django 1.11 ubuntu, how to create an html form that stores data in a mysql database using php part 1 of 4, 1 in query expression '| 2

About the Employer:
( 0 reviews ) Chennai, India

Project ID: #19942994

3 freelancers are bidding on average ₹13333 for this job


I can make this django app for scraping web urls saved in database using scrapy .

₹10000 INR in 7 days
(76 Reviews)

Hello Sir, I have gone through your requirement more carefully, Basically,I have already experienced creating the various similar project related to automation using python automation tool like selenium. I have also us More

₹10000 INR in 7 days
(4 Reviews)

Hey there, I have done exactly same project recently. So it will be my things that i understand better. Regards - Ashiq

₹20000 INR in 3 days
(0 Reviews)