Build a Property Aggregating Website pulling from about 5 different property agency website and blog.

Completed Posted 7 years ago Paid on delivery
Completed Paid on delivery

We are doing a Proof of Concept project that would like to aggregating 5 different property agency sources of website and blog that I would like to be able to set the time of auto-scrape their content, e.g. daily or weekly. I can setup by a parameter.

We will provide the Raw table structure and each website field mapping. Most of the source sites don't have RSS feeds so they would need to be scraped by identify website content. Scraped content would remain in a database.

Parameter need to be set

Time Interval (hours): 24, means run every 24 hours

Source: From 0 to 5. 0 means run all source, 1 to 5 specific run individual source only

Top: 0 to 100, 0 means scrape all content until finished, 1 - 100 means top 1 to top 100 record only.

Output: DB or JSON. We can set the output as JSON or direct to our DB

HTML PHP Python Website Design

Project ID: #10308573

About the project

8 proposals Remote project Active 7 years ago

Awarded to:

Verz1Lka

Hello! I'm web scraping expert and i can done your project. I use python language and scrapy framework. My scripts works on windows, mac or linux, but linux is preferably. I can schedule scripts on server if it is re More

$157 USD in 10 days
(42 Reviews)
5.7

8 freelancers are bidding on average $176 for this job

pmrs1978

A proposal has not yet been provided

$166 USD in 5 days
(2 Reviews)
5.5
swatirewagad

A proposal has not yet been provided

$155 USD in 3 days
(0 Reviews)
0.0
Jawjawjaw

Hi , I have exeprience in web-scraping. I work as python developer. I could build webscrapers inserting to DB quickly and without any errors. MVC controller could be built in PHP cake or Django.

$144 USD in 3 days
(0 Reviews)
0.0