looking for programmer who is able to create a crawler that will crawl few websites with property listings and extract data (several attributes or specifications of entities) and input them into my database.
## Deliverables
**Project overview:**
1. Primary purpose is to crawl a specific number of specific real
estate sites (i need 3 sites at the moment) for property listings and return the specific listing
results to a MySQL database.
2. The crawler will be scheduled to crawl a specified number
of major real estate sites for listings once a day. (mainly the 3 sites i want)
3. Each site being crawled will have differing layouts, and so
it must be possible to intelligently specify per site
the layout and what to search for/return.
[login to view URL] crawler must have the ability to compare previous days returned
results and current results to identify new listings [recently
added]
[login to view URL] crawler must run on a Linux server and be capable of being
scheduled to automatically run at certain times.
[login to view URL] functions must be allowed to enable the addition/removal of
sites and to update layout instructions per site.[--optional.]
I would provide you with a script which would search on my website for that data from my database. Where users will be able to search my database for Property listings by their specific attributes (basic and advanced search with filters).
You are expected to integrate the crawler wit the script and modify the scripts filters to suit the requirements
Please reply with specific experience and examples of crawlers/spiders you have developed that meet similar requirements
**Budget:**
300-350 USD
**Deadline**:
2 weeks
A detailed report of the project will be sent to those eligible.