. Travel portal - [url removed, login to view]
2. ( Demo User: testy | Pass: mytestpass )
3. Want total checkout pricing of exact same hotel & search parameters performed by a [url removed, login to view] user to be parsed into query string via Java/Jquery with results returned to page in comparison display divs (to be coded).
4. Hotel Checkout and majority of booking path take place on external (white label) server of which we control headers, footers and CSS. We are able to execute Java and DOM functions. Front end of site is wp/php/mysql.
5. Only want results from Expedia, [url removed, login to view], [url removed, login to view], Hotwire.com.
2) The current requirement is to develop a Server version of the scraper. The expected features are as under:-
a) The Products Table in the server database to be automatically populated by the scraper. The required fields are Product ID, Title, Price, Vendor, Stock Position, Payment Options, Delivery Time
b) Easy extensibility (with some python coding) to add more sites in future.
c) To meet the above, the scraper to be implemented as two modules. The &quot;Scraper Module&quot; and the &quot;Parameter Module&quot;.
f) The scraped URLs (referred by the primary URL) to be saved in a Database Table with &quot;processed flag&quot;, so that these can be skipped if scraping needs to be resumed after interruption.
g) Primary URLs also to be saved with the date of last successful scraping, to enable scheduling of periodic repeat scrapings.
h) While executing scraping, only those fields that have changed since last scrape are to be extracted and the original table entry for the product to be &quot;updated&quot;, as required. In case of new products, the details to be &quot;inserted&quot; as a new row in the Products Table.
j) Performance must be adequate to enable scraping of the sites in order to generate the Products database
Budget: USD 200 to USD 300
7 freelancers are bidding on average $296 for this job
I'd like to help you with this data scraping project. I've done a lot scraping before in python and scrapy (yellowpages, toyotires...). Please pm me and we can start right away. Thanks.