Magento Scrape products from Aliexpress Using PHPQuery & Cron
I need a scraper/crawler that can scrape specific aliexpress store. All products need to be scraped and all paginated pages.
The scraper will run using crontab every x minutes depending how we set the crontab.
It needs to save products in magento databases and images to specific folder. It can be done as a standalone system or a Magento extension, depends what you are most familiar with.
By default all products status must be set as disable until we manually review and enable them in magento.
I have the exact scraper working on Opencart. However I need one for magento.
It has to scrape all the following:
(i) Product title
(ii) Product Description
(iii) Product ID
(iv) Product URL
(vi) Shipping Cost
(vii) All images
It also has to check the product URL/ID at least every couple of hours. In case the product is no longer available, it should disable the product on Magneto in the database.
Also we should be able to set a margin profit that the scraper will add to the cost price. This new price will be our selling price.
For example, if we are scraping store1. We can set a profit margin on the price for this specific store.
The scraper must be able to run different instances/task to scrape multiple store and sync all the time to check price and availability.
An example here all products here has been scraped from aliexpress:
[url removed, login to view] ( scraped from [url removed, login to view] )
[url removed, login to view] (scraped from [url removed, login to view] )
The current scraper I have for opencart is using PHP query and crontab running 2 scripts every 5 minutes.
I’ll contact you via private message with my skype and we can discuss. I can also provide access to the admin panel for the current opencart scraper for you to get a better understanding.
I've attached couple of screenshots of the current scraper.
Payment will be made upon completing of project.
18 freelancers are bidding on average ₹26512 for this job
Hello Spykey, thanks for inviting me to bid on your project. I have some experience with magento and this project would be a challege whici I think I can bypass easily.