Magento Scrape products from Aliexpress Using PHPQuery & Cron
I need a scraper/crawler that can scrape specific aliexpress store. All products need to be scraped and all paginated pages.
The scraper will run using crontab every x minutes depending how we set the crontab.
It needs to save products in magento databases and images to specific folder. It can be done as a standalone system or a Magento extension, depends what you are most familiar with.
By default all products status must be set as disable until we manually review and enable them in magento.
I have the exact scraper working on Opencart. However I need one for magento.
It has to scrape all the following:
(i) Product title
(ii) Product Description
(iii) Product ID
(iv) Product URL
(vi) Shipping Cost
(vii) All images
It also has to check the product URL/ID at least every couple of hours. In case the product is no longer available, it should disable the product on Magneto in the database.
Also we should be able to set a margin profit that the scraper will add to the cost price. This new price will be our selling price.
For example, if we are scraping store1. We can set a profit margin on the price for this specific store.
The scraper must be able to run different instances/task to scrape multiple store and sync all the time to check price and availability.
An example here all products here has been scraped from aliexpress:
[url removed, login to view] ( scraped from [url removed, login to view] )
[url removed, login to view] (scraped from [url removed, login to view] )
The current scraper I have for opencart is using PHP query and crontab running 2 scripts every 5 minutes.
I’ll contact you via private message with my skype and we can discuss. I can also provide access to the admin panel for the current opencart scraper for you to get a better understanding.
I've attached couple of screenshots of the current scraper.
Payment will be made upon completing of project.
Looking to make some money?
- Set your budget and the time frame
- Outline your proposal
- Get paid for your work
Bids on this Project
Confianza Technologies is a dynamically growing company with creative team and successful experience in web designing and development. Our competence groups are able to handle web designing projects of various scope and scale. We deliver the full range of services right from web designing, development and hosting services . we are experts at designing highly complex, long-term engagements that our clients require. We work in long-term partnerships with our customers. In today's competitive market, capturing the attention and business of a customer is challenging. We take pride in filling the needs of the customer while providing superior quality. It requires value - high-level product performance at a desirable price. And it takes an undying devotion to customer service and support. All of these elements play a critical role in Confianza Technologies success, and contribute to our most important endeavor -satisfying our customers. We provide web designing and services that help our clients efficiently evaluate risks and changes to their business and then develop and implement processes and controls to optimize their ability to achieve their goals. We Value our clients Confianza Technologies is a company that works in an flexible environment for website development process, adjusting as per our clients requirements. Quality work is a prerequisite for every task we undertake we consider that 'every day counts.' Any why not; we know that good jobs always bring new clients. We believe in Quality Attempting to provide world-class services, we always strive to provide you with quality work and consider 'every effort counts.' Excellent and consistent quality at low cost is what we known for. We value our people People are the key resources in any service industry. We highly value our people and their performance. Confianza Technologies ensures providing an environment to develop their skills and offers them a rewarding career. Web services we provide: WEB DESIGN - Web Site Design - Website Redesigning - Website Maintenance - Search Engine Optimization (SEO) WEB DEVELOPMENT - Web Programming - Portal Development - B2B, B2c Application - E-learning CORPORATE IDENTITY - Corporate Logo Design - Brand Strategy - Corporate Branding - Corporate Communication
I've 13+ years of experience in the web application development on various topics. My expertise includes Java/J2EE, web scraping, wordpress and Magento technologies. I always try to ensure that there is excellence in my delivered work. I will even provide support, after completion of the project, for a short span. So, you're assured that you get the best when you choose me.
Panchsheel Nagar, India
EXPERT IN HTML5/CSS3, PHP, E-Commerce, Opencart, Bigcommerce, Shopify, Joomla, Wordpress development and MOBILE WEBSITE ( jQuery Mobile ). We feel good to help client, achieving goal in the areas of web-based enterprise solutions, web application, and portal development.
We have great experience to work on web development, from last 5 year we are working on php or its CMS or Frameworks. We are professional in : Core-php, Open-cart, E-Commerce, Joomla(virtue mart), Codeigniter, wordpress, jquery , java script, html, html5. Our work quality is best.
We are a software and web development company, established in 2010 with the aim to provide high quality services in all major open source technologies (i.e. Magento, Prestashop, Wordpress, Joomla, Drupal and Php/MySql ) and as well mobile technologies such as iOS ans Android. Our expert services ranges from small to medium and large scale businesses. We have successfully completed 170+ projects for small to medium and large scale organizations/ businesses at freelancer.com with great feedback and ratings. We are top the magento developers among thousands of developers We have dedicated developers and designers for the said technologies. We use core coding/designing standards & techniques and provide 100% quality and productivity work within specified time-frame accordingly. Our consultation services shape an efficient, effective and scalable online presence for eCommerce.
Perfection and dedication are the way we deal with projects on freelancer. There have been many clients all over the world that are satisfied with the solutions provided.All types of automation works along with web based solutions are our expertise. Looking to provide solutions in the Mobile markets as well. Some of the automation tools are listed in portfolio and here as well: * AutoBidder tool for Madbid like sites * Automation tools For all emails and social Bookmark sites * Social Bookmarking tools * Facebook Likes Automation * Webbased Versions of tools tailored to custom needs * Desktop apps tailored to customer needs * Proxy tools tailored to your requirements. A dedicated team that can literally deliver any project solution with high expertise. Please don't hesitate to contact us via freelancer. Satisfaction guaranteed solutions delivered all over the world. The Skill Set ranges from C# to PHP, Iphone to Andriod. We can deliver almost any solutions for your needs. We can also take up any type of work based on web design to desktop or mobile in the broad spectrum as we always strive to learn and perfect.
I'm web developer with 10 years of experience . I am experts in these areas, Analysis, design and development of simple and complex systems. I am given services for these technologies, PHP5, jQuery , Facebook API, Facebook Fan Pages,Facebook Connect, AJAX, HTML , CSS, Complex API , XML , Yahoo,Google OAuth, JSON JSONP, Amazon API with AS3 , CMS.
We are a Website Design and SEO Services company located in Romania and founded in 2006. During this period we specialized ourselves in getting businesses on the Internet quickly and professionally. As a one-stop provider, you will find it easier than ever to gain the strong web presence every modern business requires: from Web Design to SEO Services - we can provide it all. If you came at us, you won’t be needed to search for anyone else. Our experience of over 10 years in web development and over 1000 of successfully completed projects recommends us as a Web Design Company that always puts client’s interests in first place. We recently developed our own products (design themes) which are selling successfully worldwide on various platforms. We have worldwide partners: US, UK, Australia and Europe. We are ready to serve your projects with global resources, always keeping in consideration the high standards of the quality services we deliver.
Thanh Hoa, Vietnam
New Delhi, India
Our team of website designers at would like to welcome you to our humble web-abode. Alif Interactive, we are based India at New Delhi, we deliver elevated quality, and cost successful, consistent consequence oriented WEB as well as MOBILE solution. Website design focused in custom intended, competently created websites for both personal and corporate business. OUR SERVICES :- Web Development & Design: PHP Development, Mobile Website, WordPress, Drupal, Joomla, CakePHP, CodeIgniter, Responsive Design and Store with Onix Integration Ecommerce Development : Magento, Opencart, Shopify, BigCommerce, osCommerce, Prestashop, ZenCart, WooCommerce and Virtuemart Development Mobile Application: iPhone, Android and PhoneGap Apps Development Online Marketing: SEO, Content Writing, Social Media Marketing, Digital Marketing and Email Marketing At Alif Interactive we are ever ready to help you 24x7.