Completed

Scrap 4 Sites

This is a repost of my previous job post, with some modifications. Please read the description carefully, then submit your proposal.

We want to develop a website where user can search for air travel and accommodation information. Basically, our site will not contain any air travel or accommodation information. It will read (scrap) data from other websites for every search request.

We are targeting the following sites to read data:

1. [login to view URL] (Air travel information)

2. [login to view URL] (Air travel information)

3. [login to view URL] (Air travel information)

4. [login to view URL] (Air travel information)

5. [login to view URL] (accommodation information)

We already develop a python scraper that can read data from [login to view URL] (no 1). It's running successfully in our server. You have to work on number 2, 3, 4 and 5. If you can work only 1 site then I can create a separate freelancer.com project for you to work on a single site.

So, we need an experienced developer (or team) who has scraping experience. Developer should develop REST API where it will take some parameters (like date, number of passengers, etc) and API will return JSON response based on those sites search result.

You have to develop the REST API only. We have our very own front end developer, who will connect the backend (REST API) with the front end.

Currently, our dev site is hosted at [login to view URL] and you can check search result at [login to view URL]

A developer will get priority If he can show a demo (any one of the four sites). But please don’t share your code with me before awarding the project to you.

Language: Any language preferred.

Attachment: response json and form-data parameters.

Important Note: We have already hired 3 developers average of 3 years of experiences. They all failed. So, make sure you are confident enough to do the task.

Thank you.

Skills: Django, PHP, Python, Software Architecture, Web Scraping

See more: webmaster 1000 class sites, hosted freelance consultant sites, online jobs adults sites, searching class logo sites, class web flash sites, chat sites adults, picture adults class, egroupware hosted sites, chat sites adults cam, hosted classified sites, 5310 adults mobile web sites, scrap posting sites, scrap data sites, need vbulletin scraper scrap vbulletin sites forum, move 4 sites, We are wanting this redesigned with similar content. Pages we are needing designed are Home Page, Content, Contact/Quote, Distri

About the Employer:
( 7 reviews ) Dhaka, Bangladesh

Project ID: #20066416

Awarded to:

patelfarhaaan

I am working on the same project for a client and have implemented the code as you need. I can show you the demo using a lambda function. You can test the same in your postman and compare the results. For a better unde More

$650 USD in 5 days
(1 Review)
3.4

40 freelancers are bidding on average $528 for this job

abstractsoftweb

[login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] http://www.myfcpower.com. [login to view URL] http More

$400 USD in 10 days
(156 Reviews)
7.6
widadsaghir1993

Hi there. As you can see my profile, I have gained vast experiences in scraping with python, selenium. I can do your project with 250 per a site. Looking forward to further discussion with you Thank you Regards

$500 USD in 7 days
(140 Reviews)
7.5
ineedWorkJob

Greetings sir, I have read your project details and i will develop the scraping script in php for your search engine. So, when user try to search on your page, it will scrape data from all those sites and show as se More

$800 USD in 5 days
(217 Reviews)
7.2
etuannv

Hi there, I am interested in your project. I would approach your project by Python with Scrapy to extract the data. It could be run on any operating system. We could use scrapyrt to return json data. That means we don More

$888 USD in 10 days
(122 Reviews)
7.0
C3guru

Hi, it's Cui. I just noticed you repost the project and bid here. Actually, I'm a Python and Javascript expert. As you said, you have already made a Python scraper for no.1, I can take a look on it (if you can share i More

$800 USD in 7 days
(50 Reviews)
7.1
khoadeveloper

Hi, Dear client. I am a web scraping/automation/bot/chrome extension expert with 6 years of experience in NodeJS, Puppeteer, Chromy, Selenium, Chrome-extension, Chrome-headless, Firefox-headless, SilmerJS, PhantomJS More

$733 USD in 10 days
(12 Reviews)
6.5
leemilun

Hi. Sir I would be very glad to meet you. I can bring you perfect result as you want. I am experienced Python and PHP developer. Checking my profile, you can see the projects I did before. I can work at anytime in your More

$400 USD in 7 days
(97 Reviews)
6.9
sky930320

Dear Sir. Glad to meet you. I'm Web developer specializing in web scraping crawling and indexing web pages. Skills: python, scrapy, selenium, requests, beautifulsoup, mechanize, lxml, urllib2, automation, bots, spide More

$500 USD in 7 days
(38 Reviews)
6.9
adampohp79

Dear Sir. Glad to meet you. I'm Web developer specializing in web scraping crawling and indexing web pages. Skills: python, scrapy, selenium, requests, beautifulsoup, mechanize, lxml, urllib2, automation, bots, spide More

$500 USD in 7 days
(86 Reviews)
6.4
kkc264043kkc

Can scrape data from the airline website and provide you with REST API with json response. have done scraping of many website like [login to view URL] [login to view URL] expedia.com. These are my skills related to web scraping and cr More

$555 USD in 3 days
(56 Reviews)
6.1
yesikov1224

[login to view URL] I am web scraping expert.I have much experience for 10+ years such as avoiding recaptcha, using multi threading, avoiding site security.... I can do your job with crawler,scrapy, BS4 ,Perl script, Seleinum modu More

$250 USD in 3 days
(58 Reviews)
6.1
farooq4161

Greetings, I am an experienced professional scrapper and have done similar projects in the past. Same can be verified from my profile. Let me allow to assist you with your requirements. Thanks

$400 USD in 5 days
(68 Reviews)
6.2
smsaurabhv

‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHO More

$444 USD in 3 days
(106 Reviews)
5.9
rstomar

>>>similar work we have done <<< Hello there Hope you are doing well!! I am glad to say that we have developed more than 100+ websites different platform As per my understating you need to scrap website P More

$250 USD in 10 days
(40 Reviews)
5.6
saranaone

I am professional Python web scraper I can complete your web scraping requirement on time with good quality results using Python scripting I start script right away and deliver within your timeline I use Python Beau More

$250 USD in 5 days
(94 Reviews)
5.4
Stephenrajs

Hi there, I Have Scraped Amazon, Aliexpress, [login to view URL], Yellow Pages, Yelp, Zomoto Etc. I Have 500 GB Internet With 20 Mbps Speed. I Have 6 Systems. I can do it. I have done many related projects like this. If y More

$300 USD in 7 days
(114 Reviews)
5.6
shivansh121

Hi Employer, I can extract any data from any [login to view URL] I have scraped the data from these websites & stored scraped data into CSVs and excels as per my clients requirement. :- You can check these websites... More

$345 USD in 12 days
(48 Reviews)
5.7
amitadlakha04

Hi winexsoft I've checked your job post Scrap 4 Sites and I am much interested to assist you on requirement . I'll provide you with the quick turnaround for this work and i can start working on it right away. I have More

$335 USD in 12 days
(26 Reviews)
5.2
Guptapuru304

Sir/Ma'am, I have done such works previously for a lot of modules which includes LinkedIn, Amazon, YouTube, etc. I have the basic scripts ready with me which can be tweaked according to your requirements and can be d More

$560 USD in 4 days
(20 Reviews)
5.3
anislazaar

Hi there. I’d like to work with you on this one if possible! My name is Anis and I’m Developer with nearly 6 years of experience, with 4 of those years in .Net and C# programming. I do a lot of desktop application, a More

$250 USD in 7 days
(15 Reviews)
5.1