Scrape Product Info from Websites (RPA)

  • Status: Pending
  • Prize: $500
  • Entries Received: 4

Contest Brief

I need someone to develop a service that will perform the following:

- Take a website product page URL as an input
- Capture and return the product title, SKU/product code, summary text, image and price

You could use some web scraping libraries like Beautiful Soup, Scrapy or Selenium to come with a generic script that handles various form elements/divs where this information are usually stored. We are happy to consider your entry if your function handles most of the websites out-of-the-box and the scraping ability can be extended by updating the script/expression used.

You may also consider AI/Machine Learning/Deep Learning to come up with a custom learning model. However not too sure the success rate of this approach.

The success criteria for this project will be the tools capability to deal with ANY URL as an input and return the mentioned attributes. Attached along are some of the product detail links that you can test your script. Thanks.

Recommended Skills

Top entries from this contest

View More Entries

Public Clarification Board

  • muhammadhari336
    muhammadhari336
    • 3 weeks ago

    I have several questions. Can I get those answered before starting off? Waiting.Thanks

    • 3 weeks ago
    1. muhammadhari336
      muhammadhari336
      • 3 weeks ago

      Leave a text.Thanks

      • 3 weeks ago
    2. muhammadhari336
      muhammadhari336
      • 3 weeks ago

      I want to share some info and to discuss if possible.Thanks

      • 3 weeks ago
  • busygayan
    busygayan
    • 1 month ago

    Hi,
    Really interested in the contest, could you please be kind to make the contest #guaranteed

    Cheers!

    • 1 month ago
    1. acmoau
      Contest Holder
      • 1 month ago

      Deployment as webapp sounds good and ability for us to enhance model with additional links is required. I look forward to your demo

      • 1 month ago
    2. busygayan
      busygayan
      • 1 month ago

      I have added the entry, please be kind to contact me so i could share the demo video.

      • 1 month ago
  • techiestc
    techiestc
    • 1 month ago

    Hi, There is problem in Submitting my entry I'm sharing with you a SS of code which is written in python and capable to extract required info from any dynamic website. I can't share the full SS here, kindly connect through Inbox I'll share the Script. You can test it. PF link given below::https://drive.google.com/file/d/1pia8qpImrIaBHg0yxMDsGRZxhggAN4Mm/view?usp=sharing

    • 1 month ago
    1. acmoau
      Contest Holder
      • 1 month ago

      Not sure why you are unable to submit an entry, the winner will only be picked-up from the submitted entries. Please upload a video/screen recording of how your script performs to the list of links provided.

      • 1 month ago
  • Yateesh2
    Yateesh2
    • 1 month ago

    How long can you wait, I'll try to integrate AI into this cuz it looks interesting.

    • 1 month ago
  • Yateesh2
    Yateesh2
    • 1 month ago

    I didn't want to show my code to others can you send me a message privately I'll sen youd the code

    • 1 month ago
    1. acmoau
      Contest Holder
      • 1 month ago

      Makes complete sense, I just uploaded a list of 30 product detail pages that will be used to evaluate the entries. As I don't need to see your code for the initial review, it is best if you can upload a video/screen-recording of your script extracting the information from these links and writing it to a CSV file. The complete code can be shared once I am happy with your script.

      • 1 month ago
  • Yateesh2
    Yateesh2
    • 1 month ago

    Can please explain why my entry was rejected I'll make any changes if you want

    • 1 month ago
    1. acmoau
      Contest Holder
      • 1 month ago

      Your submission only included some screenshots from webpages and part of your code, and did not show any evidence of how your script extracts values.

      • 1 month ago
  • ashikmohann
    ashikmohann
    • 1 month ago

    #guaranteed

    • 1 month ago
  • amrkhaled32
    amrkhaled32
    • 1 month ago

    sir, what do you mean with the SKU? because most products pages doesn't have it

    • 1 month ago
    1. acmoau
      Contest Holder
      • 1 month ago

      SKU refers to product code or item code.

      • 1 month ago
  • MdShohan756
    MdShohan756
    • 1 month ago

    Please Check #3

    • 1 month ago
  • shouravahmed96
    shouravahmed96
    • 1 month ago

    I am interested in this contest and have an idea.
    I have a question, by "website product page" did you mean a webpage for a specific product,
    like this? https://www.amazon.com/Lenovo-Processor-Graphics-Included-81X20005US/dp/B086226DDB/

    • 1 month ago
    1. acmoau
      Contest Holder
      • 1 month ago

      That is correct, however the service should work with any websites - AI/Machine Learning is the key as you could navigate to the page, capture screenshot and have the script extract the information using ML. We could start with little or no knowledge, however with ML the plan is to evolve and make it accurate.

      • 1 month ago
  • Nir0shan
    Nir0shan
    • 1 month ago

    Dear contest holder, please check #1. Also check its comments which give a description of what the outputs will be . The images are only a sample (not the full code).

    • 1 month ago
  • gtx99
    gtx99
    • 1 month ago

    Hey there,

    Hope you are doing good! Since scraping for different websites have different implementations, could you atleast specify the websites you are planning to scrape.

    Warm Regards

    • 1 month ago
    1. acmoau
      Contest Holder
      • 1 month ago

      The contest is to have a service that is generic and something that can be used to extract product detail from any website.

      • 1 month ago

Show more comments

How to get started with contests

  • Post your contest

    Post Your Contest Quick and easy

  • Get tons of entries

    Get Tons of Entries From around the world

  • Award the best entry

    Award the best entry Download the files - Easy!

Post a Contest Now or Join us Today!