Magento Scrape products from Aliexpress Using PHPQuery & Cron

Closed

Magento Scrape products from Aliexpress Using PHPQuery & Cron

I need a scraper/crawler that can scrape specific aliexpress store. All products need to be scraped and all paginated pages.

The scraper will run using crontab every x minutes depending how we set the crontab.

It needs to save products in magento databases and images to specific folder. It can be done as a standalone system or a Magento extension, depends what you are most familiar with.

By default all products status must be set as disable until we manually review and enable them in magento.

I have the exact scraper working on Opencart. However I need one for magento.

It has to scrape all the following:

(i) Product title

(ii) Product Description

(iii) Product ID

(iv) Product URL

(v) Cost

(vi) Shipping Cost

(vii) All images

It also has to check the product URL/ID at least every couple of hours. In case the product is no longer available, it should disable the product on Magneto in the database.

Also we should be able to set a margin profit that the scraper will add to the cost price. This new price will be our selling price.

For example, if we are scraping store1. We can set a profit margin on the price for this specific store.

The scraper must be able to run different instances/task to scrape multiple store and sync all the time to check price and availability.

An example here all products here has been scraped from aliexpress:

[url removed, login to view] ( scraped from [url removed, login to view] )

[url removed, login to view] (scraped from [url removed, login to view] )

The current scraper I have for opencart is using PHP query and crontab running 2 scripts every 5 minutes.

I’ll contact you via private message with my skype and we can discuss. I can also provide access to the admin panel for the current opencart scraper for you to get a better understanding.

I've attached couple of screenshots of the current scraper.

Payment will be made upon completing of project.

Skills: Magento, Open Cart, PHP, Python, Web Scraping

See more: aliexpress magento, magento aliexpress, magento aliexpress products, what is my skype id, what is a crawler, contact aliexpress, aliexpress contact, scraping crawler, scrape html, scrape contact, price crawler, opencart shipping, magneto product, magento vi, get products from aliexpress, completing the case, aliexpress, multiple url scraper, message scrape, message cost skype, magento review url, html sync, message crawler, opencart check, magento query

Project ID: #5051248

18 freelancers are bidding on average ₹26512 for this job

SigmaVisual

Dear Client, I can help in your project. We have already experience of working on similar projects. Please see below to get idea of our experience: Amazon/Ebay Bots: http://sigma-dns.sigmavirtual.com/PDemo1/Am More

₹15463 INR in 5 days
(248 Reviews)
7.9
p4provider

Here are Magento Experts , please check Our Latest Magento work In PMB For Our Experience and skills Regarding Magento projects and Let me start your work , Thanks All major open source technologies(WP, Magento, More

₹15463 INR in 10 days
(114 Reviews)
7.5
srinichal

I am an expert in scraping and can deliver the project to your specifications and thanks for the invite

₹10526 INR in 12 days
(112 Reviews)
7.3
geekydeveloper

Hello Mate, We have experienced programmers team.we have worked in scrapping project. Thanks for your invitation. How can we discuss more about job? Reference links http://www.hscap.kerala.gov.in/transfer/main More

₹10309 INR in 10 days
(30 Reviews)
6.5
dinastalb

Hello, I am John Profit. I work with my partners Marlen and Van at Netronian Inc., in Orlando, Florida. We have great experience with Magento. 80% of our developed websites are Magento websites. We are the masters More

₹315789 INR in 30 days
(30 Reviews)
6.6
sainathkohta

Hello Sir, I am from Confianza Technologies. I have gone through your requirements. We have developers who have vast experience in required technologies. We are interested in your project, but before finalizing budget More

₹36082 INR in 9 days
(37 Reviews)
6.5
alifinteractive

Hi, We have a rich experience in opencart developemnt and have completed many successful projects using it. Please check our some good works using the below URLs. Opencart Projects http://www.mumyathome.com/ ht More

₹30927 INR in 18 days
(39 Reviews)
6.4
pytho

Hello! I will provide you best custom services of Magento theme customization and template design. With my skills based on 5 years experience in this field i will professionally design templates for your online stor More

₹46727 INR in 20 days
(23 Reviews)
6.1
uumairkhalid

Hi.. Expert web scraper/Data Minor here. Interested in your project. I assure you 100% accurate and good quality work. I have too too scraping experience. let me know if you want sample before awarding. lets start. Reg More

₹105263 INR in 3 days
(53 Reviews)
5.8
tiabrains

Dear Hiring Manager, I am ready to help you in your project . I have read your project description . Please note that we are into IT industry since last 10 years and we have served thousands of clients since 2003. More

₹50363 INR in 20 days
(24 Reviews)
5.8
VnBestSolutions

Dear Sir, We claim to get it done perfectly for you EXACTLY in the way you want it - Kindly give we a chance and we will prove myself - Ready to prove our words, let's get it done right away and I mean RIGHT AWAY !! More

₹58421 INR in 7 days
(40 Reviews)
5.4
phpmysqlrocks

Hello, Greetings!! Had a look at your project post and we are well suited for this Job as magento is our core work domain which is backed by our strong portfolio and feedback of the clients. Look forward to work with y More

₹14736 INR in 6 days
(39 Reviews)
5.4
proauthor

Dear employer, I'm expert in data mining and web scraping technologies and tools. I can deliver the data in the required format suitable to your storage needs (csv, excel, sql etc). I follow very systematic approach More

₹9999 INR in 5 days
(31 Reviews)
5.3
jitendraparmar07

Hello sir, Thanks for the invitation. I'm very pleased to submit this proposal to you. My main profession is web scraping. I've been scraping products onto magento since last 2 years.Also developed 200+ desktop a More

₹10309 INR in 4 days
(31 Reviews)
5.2
zyeloncomputech

Hi sir, Thank you for giving opportunity for biding... we have gone through your requirements and we can do Scrape products from Aliexpress Using PHPQuery & Cron according to your exact requirements. Please Bef More

₹36082 INR in 12 days
(19 Reviews)
4.9
deepakc147

I have experience of7+years PHP E-Commerce,Opencart,Bigcommerce,Shopify,Joomla,Magento , Prestashop, Wordpress Plugin Design, responsive theme Development & Customisation. You can call me Deep. I can start on your proj More

₹10309 INR in 5 days
(28 Reviews)
4.8
AndroPetre

Hello Spykey, thanks for inviting me to bid on your project. I have some experience with magento and this project would be a challege whici I think I can bypass easily.

₹34322 INR in 30 days
(11 Reviews)
3.6
shreeyait

Hello Sir, We have checked your job detail and as per that we are able to do your job and we have very good experience in Word Press, Joomla, Joomla component, Modules, PHP, HTML,Magento etc . As well knowledge on More

₹10309 INR in 7 days
(10 Reviews)
3.4
anuyadav1

i am well experienced in scraping with python..............................and can add cron job to it

₹10000 INR in 5 days
(6 Reviews)
3.2
DevelopersTeam85

Hello sir,  I have seen your requirement of the project and can do the mentioned requirement with good efforts and 100% completion with good quality and on time completion. Website Implementation Done :  ------- More

₹10102 INR in 26 days
(2 Reviews)
2.5