REAL ESTATE LISTING DATA SCRAPER

Our firm has the need for a qualified web scraper to develop a system to validate addresses and mls status’ for homes located in the united states and listed through various real estate agencies. The system should function as a web application that will be hosted at the location of our choice with a secure login and password validation system. STEP 1. UPLOAD FILE THAT NEEDS VALIDATION: Developer will build a mechanism that allows one of our staff members to upload a list of the current housing inventory we wish to scrub, the data set will be formatted as follows in CSV format: FIRST, LAST, ADDRESS, CITY, STATE/REGION, POSTAL CODE STEP 2, VALIDATION PROCESS USING DATA ON [login to view URL], [login to view URL] AND [login to view URL] The web application should begin to take the data set and automatically scrub websites that are publicly available to validate the addresses and determine the following: 1. IF THE PROPERTY IS FOR SALE ([login to view URL] AND [login to view URL]) STATUS IS LISTED ON TRULIA BUT DATA IS DELAYED, [login to view URL] IS A BETTER RESOURCE 2. THE CURRENT LIST PRICE ([login to view URL]) IF LISTED 3. THE CURRENT LISTING AGENT AND REAL ESTATE COMPANY ([login to view URL]) IF LISTED 4. THE MOST RECENT ACTIVITY ON THE PRICE HISTORY CHART WE ONLY NEED THE MOST RECENT “DESCRIPTION” AND “SOURCE” ([login to view URL]) AND EXAMPLE IS HERE: [login to view URL] 5. IF THE MOST RECENT ACTIVITY IS “SOLD” THEN WE NEED TO FLAG THIS HOME, USE A FLAG ICON AND CREATE A SPECIAL FLAGGED ICON AND A PAGE TO ACCESS THESE – AN EXAMPLE OF A SOLD HOME IS AVAILAIBLE LIKE THESE: [login to view URL] (QUICKEST TO UPDATE) OR [login to view URL] AS “RECENTLY SOLD” STEP 3, CREATE REPORT WITH NEW FIELDS FOR EXPORT/DISPLAY THE FOLLOWING COLUMNS WILL BE ADDED TO OUR ORIGINAL DATA SET: FOR SALE LISTING AGENT LISTING COMPANY LIST PRICE PRICE HISTORY RECENTLY SOLD Y TOM WATSON COLDWELL BANKER 654,000 06/11/2009- LISTED FOR SALE - SOURCE N N NA NA NA N Y BILL SMITH SMITH REALTORS 148,000 N • IF THE PROPERTY IS “RECENTLY SOLD” THE COLUMN NEEDS TO HAVE THE FOLLOWING ICON RED “Y” THAT LINKS DIRECTLY TO THE [login to view URL] PAGE SHOWING THE SOLD LISTING. DATA SHOULD EXPORT TO A NEW CSV FILE THAT CAN BE OPENED IN EXCEL FOR STAFF REVIEW