Create a Web Scrapping Program

Cancelled Posted Dec 15, 2013 Paid on delivery
Cancelled Paid on delivery

We want a program that scrapes/extract data from various websites. The program will go to [login to view URL] and then put various search inquires (Accounting textbooks, Law textbooks, Chemistry textbooks, Biology textbooks, ETC) and search. Next it will look at the used price of the book. If the price of the book is greater than $40 then it should click on the link and extract the ISBN number. If it is less than $40 then the program should move on to the next book. It will continue this process until it reaches the end of the books/searches and put the information in an excel file. The program will then use the ISBN numbers (in the excel file) to go to [login to view URL] and use the ISBN numbers one by one to search the prices for the books. Also, when the program is searching the ISBN numbers on [login to view URL] it should uncheck all of the options on the left side except New and Used. Next, the program will look at the lowest price and check the merchant/website. If the website is "Amazon" or "[login to view URL]" then it will cancel the search and move on to the next ISBN number in the excel file. If it is not "Amazon" or "[login to view URL]" then it will check the condition of the lowest price book and if the condition is "brand new, new, like new, mint, very good, or good" then the program should move on to the seller's comments available below the condition in the same section (If the condition does not match then it should move on to the next result). However when the program is extracting the comments it should look for specific words in the description and if they are present then the program should move on to the next search result and repeat the process. If the next one is good (does not contain "blacklisted words") then the program should extract the information (price, website/bookstore, condition, and the seller's comments) and then put the information in the same excel file as the ISBN numbers. This is the whole process but the program interface should be made as follows: The program should be extremely simple. It should consist of 2 options. One option should be to search all subjects (biology, accounting, etc). We will provide you with a list of subjects for the program to search and also a text file with the "blacklisted words". The program will put the information from each of the subjects into the previously mentioned excel file. The second option should be to search specific subjects. If we select the 2nd option then a dialog box will open on the program which will allow us to input the subjects that we would like to search. The program will then put the extracted information in individual tabs of the excel file. For each of the subjects the program will extract all of the ISBN numbers from Amazon and the information for each of the ISBN numbers. The program will also consist of a button to run the program. I understand that the description seems complex but it is much simpler than it sounds. Please feel free to ask any questions you may have.

Data Mining Perl PHP Software Architecture Web Scraping

Project ID: #5231171

About the project

20 proposals Remote project Active Dec 21, 2013

20 freelancers are bidding on average $285 for this job

mhmhz

Hi Ye, the requirements can be more simple if you use screenshots. This will make every thing easy in verification. I could provide a desktop application in C#. Let me know if you are interested. Thanks

$263 USD in 1 day
(226 Reviews)
8.0
ehsankayani

HI, i have developed similar bots for searching DVD . And you can see my profile for many amazon bots . i can best perform this job as i already have much skills regarding this. Thank you

$210 USD in 6 days
(227 Reviews)
8.0
srinichal

I am an expert in delivering scrapers and willing to discuss further details about the project specifications and needs

$315 USD in 8 days
(199 Reviews)
7.7
phpXpertbd

Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL from many sites. I just scraped the data from web site and then wrote the data in mysql database or excel or csv or xml file. More

$250 USD in 3 days
(95 Reviews)
7.4
rotfor

Hi, This seems to be an interesting project. I think I can demonstrate results from an working prototype if you request. Thanks

$250 USD in 3 days
(67 Reviews)
6.0
rsoftsl

This bid is for a Windows program that does what you want. My bid includes the program's source code (written in C3 or Delphi, whichever you like better), 2 years of free tech support and your first good review on this More

$188 USD in 3 days
(51 Reviews)
5.8
miraclesolution

Greetings We would like to discuss in more details before placing a confirm bid. Let us know if you have some time to chat on Freelancer. Awaiting to hear from you,Have done similar work to your requirements in the More

$500 USD in 4 days
(37 Reviews)
5.7
MagedGazzar

I've a very good experience in this field and can get this job done easily and if you interested in my bid we can make a conversation.

$166 USD in 3 days
(8 Reviews)
5.2
ecaresoftech

Hi, I have seen your requirements, we can do it. Already we have done lots of projects similar to your requirements. Please make us to confirm so we can start work on your requirements. Ms. Rani

$194 USD in 3 days
(5 Reviews)
3.2
fabiomenza

Non hai ancora fornito una proposta

$200 USD in 10 days
(4 Reviews)
2.8
minhas760

Hi There, Thanks for seeing my bid. I can build a php script to scrap data. I have completed this for one of my client before. I would like to build this again for you. Please! give me chance to provide you scri More

$155 USD in 5 days
(0 Reviews)
0.0