Create a Scrapping Program

Contest Brief

Need a python or Java or C# program that scraps Amazon and outputs results to Google Doc.

It need to do the following:

Select 5 Products

Based on key phrases provided
Number of Reviews
Average Rating
(Essentially getting the best products for the keyphrase)

Output: Name, Amazon URL,

How it would work:

I enter a key phrase
Program scraps Amazon using that phrase.
It finds the products with the most reviews
It then picks the 5 that have the best average rating

Produces results with product name & Amazon URL

Additional information: Output to Google Doc.
Process: Duplicate existing template, Replace Product 1, 2, 3, 4, 5 with Scrapped data.

Exceptions:

If not enough products found: Not enough products
If not enough reviews found: Not enough reviews

Recommended Skills

Top entries from this contest

View More Entries

Public Clarification Board

  • dataexpert18
    dataexpert18
    • 4 years ago

    #extend duration

    • 4 years ago
  • mahmoudkhayrall8
    mahmoudkhayrall8
    • 4 years ago

    Hi sir,
    please check my entry #8
    thanks in advance :)

    • 4 years ago
    1. mahmoudkhayrall8
      mahmoudkhayrall8
      • 4 years ago

      and please notice the comments as well since the description is not enough for all the details
      you will have a full nicely-formatted and detailed documentation with the delivery file of course

      • 4 years ago
  • sandeepdudhraj5
    sandeepdudhraj5
    • 4 years ago

    Hello Sir, Please do check my work. I've completed most of the tasks related to this problem. Few changes are required though.

    Entry number: #9

    • 4 years ago
  • sandeepdudhraj5
    sandeepdudhraj5
    • 4 years ago

    Hello Sir, I am currently testing the program I've written for scrapping amazon. I've got a few questions though.
    1. On which platform will you use this program (Windows, Linux or Mac)?
    2. Do you require GUI (Graphical User Interface) or are you comfortable with running commands on cmd/bash (CUI)?

    • 4 years ago
  • dataexpert18
    dataexpert18
    • 4 years ago

    can the result be in csv instead of google docs?

    • 4 years ago
    1. mkwnyd
      Contest Holder
      • 4 years ago

      It would be acceptable.

      • 4 years ago
  • mahmoudkhayrall8
    mahmoudkhayrall8
    • 4 years ago

    Hi sir ,
    Is there a threshold for the number of reviews ? I mean what do you mean by products with the most reviews ? how many of them ? or what's the minimum number of reviews possible ? thanks in advance :)

    • 4 years ago
    1. mkwnyd
      Contest Holder
      • 4 years ago

      No there isn’t a threshold. It varies. For instance, if you search for best bike for 8 year old. The highest reviews may be 200 and for some terms it may be just 18. The program will first pick the ones with the most reviews. Then select just 5 of those with the best star ratings.

      • 4 years ago
  • dhsorkar91
    dhsorkar91
    • 4 years ago

    #guaranteed

    • 4 years ago
  • sakhawat2
    sakhawat2
    • 4 years ago

    #guaranteed

    • 4 years ago
    1. mkwnyd
      Contest Holder
      • 4 years ago

      Done

      • 4 years ago
  • heybiswajit
    heybiswajit
    • 4 years ago

    #guaranteed

    • 4 years ago
    1. mkwnyd
      Contest Holder
      • 4 years ago

      Done

      • 4 years ago
  • TalhaTarar
    TalhaTarar
    • 4 years ago

    Which products do you want to scrap ? Can you please share the URL of your required products ?

    • 4 years ago
    1. mkwnyd
      Contest Holder
      • 4 years ago

      Hi Muhammad. The aim of the program is for me to be able to decide what I want to scrap and do it at any time. Could be "best toy for fish" or anything else.

      • 4 years ago
  • markelof
    markelof
    • 4 years ago

    Can it be written in the C# programming language?

    • 4 years ago
    1. mkwnyd
      Contest Holder
      • 4 years ago

      Hi Demir. Absolutely. Not fussy about the language. I have experience with Java and Python which is why my listing mentioned them. C# is welcome

      • 4 years ago
  • dataexpert18
    dataexpert18
    • 4 years ago

    you want to scrap by phrase or by phrase, review and rating?

    • 4 years ago
    1. mkwnyd
      Contest Holder
      • 4 years ago

      Hi Zafar. Thanks for your question. Phrase, review, and rating.

      • 4 years ago
  • sandeepdudhraj5
    sandeepdudhraj5
    • 4 years ago

    #increaseprize #guaranteed

    • 4 years ago
  • mitukallul
    mitukallul
    • 4 years ago

    Would you please guaranteed the proposal?

    • 4 years ago
    1. mkwnyd
      Contest Holder
      • 4 years ago

      Will have a look once I’m on a computer. This is the first contest I’ve run.

      • 4 years ago

Show more comments

How to get started with contests

  • Post your contest

    Post Your Contest Quick and easy

  • Get tons of entries

    Get Tons of Entries From around the world

  • Award the best entry

    Award the best entry Download the files - Easy!

Post a Contest Now or Join us Today!