Scrape websites with scraper and parse data to elasticsearch / kibana / logstash
- Status Closed
- Budget $250 - $750 USD
- Total Bids 41
- Show my products, and show competitor (29 sites) prices of that same product.
(!!! there needs to be a solution to link productname of theirs to mine productnames. I have 'Brand', and 'Modeltype' to make a link easyer!)
- Visualize price progression over time with kibana per product / store. (Schedule a scraper every night!)
- Show if a price is dropping or going higher per product.
Use the opensource python scraper 'Scrapy'.
Adding sales of my shop, adding positions of product in categories of competitors and mine.
The scraper will run on a DigitalOcean VPS. You install the server + scraper etc.
The Kibana Logstash etc. server will run on other server.Get free quotes for a project like this
Looking to make some money?
- Set your budget and the timeframe
- Outline your proposal
- Get paid for your work
Hire Freelancers who also bid on this project
Looking for work?
Work on projects like this and make money from home!Sign Up Now
- The New York Times
- Wall Street Journal
- Times Online