Build a Scrapy scraper
$10-50 USD
Paid on delivery
Scrape a real estate website for all properties and agents
Utilizing Scrapy & Scrapinghub
All fields to be scraped will be provided
• Scraper must be efficient
○ Don't check every URL on the site
○ Fast to find items
• Scraper must be accurate
○ No false negatives with regards to duplication
○ Limited or no duplication
○ Field values are populated if they exist
○ Field values contain correct data
• Scraper must include a data sanitation pipeline
○ Scraper will output to a file any item removed
• Scraper must include a pipeline to feed to a Wordpress site via a custom API
○ Feed properties into WP site with no dupes and correct values in fields
○ Feed agents into WP site with no dupes and correct values in fields
○ Associate agents to properties utilizing an existing property field
○ Upload images and associate to property utilizing existing WP field
○ Upload images and associate to agent
○ Export a list of statuses, types, locations, etc. that did not match
• Before payment
○ Scraper must run on the entire site at least once for results to be verified
Spot checking will be performed to ensure accuracy
First complete the scraper logic then complete the pipelines
Project ID: #15347328
About the project
Awarded to:
I will write a spider for you in `scrapy` with both parsing, crawling logic and Item Pipeline which will make any sanitizing checks easy to be performed on the scraped data Relevant Skills and Experience I am a specia More
12 freelancers are bidding on average $66 for this job
Hello Client, Hope you are doing well ! I have great experience of extracting information from websites . I provide best solutions at fastest speed with the cheapest cost. Your satisfaction is my only priority. I wou More
Hi.. I am interested to your project . I believe that I'll do this work properly and in timely . I am agree with your budget. And I'm sure that I'll finish the task with your full satisfaction . Lets start More
Expert here to do and complete this project professionally and quickly, I have done similar projects, I can do trial work before hire me sir , will wait for your reply, Thanks, Syed
write the spider for the scraper, include the Item pipelines and the feed export to store the data either locally or in Amazon s3