. a user right clicks on a product image and selects SAVE from the contextual menu (on a page displaying multiple products....not a single product page!),
. the scraper grabs the Title, correct Price, product link, image src, current url, and hostname and stores them into variables
. Via AJAX..the variables are sent to my MySQL database server. (can be done through message passing within the chrome extension)
.Product scraped! and the user can navigate to my website to view their products (I will be creating the website...website not required)
The scraper must work on as many sites as possible...preferably a high portion of U.S. Top 500 retailers (list provided by Internet Retailer [url removed, login to view])...Most, if not all, eCommerce sites nowadays layout their products in one of two layouts. 1) product image on top, title & price directly below...and 2) product image on the far left container, title in the middle container and price in the far right container, and almost ALL require the image link and the title text link to be exactly the same. This should help with traversing for the correct title and price. Example of image on top, title and price below...Target.com. Example of image to the left, title in middle, price to the right...Bestbuy.com.
Price scraper must be mindful of strikethroughs/strike HTML/CSS tags as an indication of old prices versus new prices. Usually, the correct price is the largest text...this may help if you can compare css font-sizes as one way to determine correct price. I only want the correct price and as reliably as possible.
. script that can be used as a content script in a chrome extension
. stores Title, correct Price, product link, image source, current page url and hostname into varibles (may need to store more information in order for PHP price scraping script to work efficiently...details are below)
. sends these variables via AJAX to MySQL server...stores them in database (can be done through message passing within the chrome extension, I use this technique [url removed, login to view])
Secondly, I would like a PHP price scraping script that works with the data the product scraper above retrieved, so that I can set price alerts on the products that were scraped and be notified if they increase or decrease at a later date.
The requirements for the PHP price script are as follows:
. Each row has a Price Alert text field that I can enter a price and submit it to the PHP script
. Within the script, I'd like the ability to automatically run the script at set time intervals...1x a day...2x a day..3x a week etc...
. If the price returned after a scrape is below or equal to the price I submitted in the text field...add an indicator flag next to the product row in the HTML as a visual cue.
. Once the product has been scraped and the updated price has been reterieved...it needs to be saved in the MySQL database
Thanks so much for reading, and I look forward to working with you on this project!
Please read the project first and write the word "Understood". Also write your steps and suggestions to complete the project with a short description of what you understood.