Find Jobs
Hire Freelancers

Building a website scraper and running it

$30-100 USD

Completed
Posted over 11 years ago

$30-100 USD

Paid on delivery
I'm looking for a website scraper that takes information from a large collection of pages (> 35000) and puts them in a file or database. I'm open to all technologies. Part of this job is to write the scraper. The other part is actually running it and generating that file/database for me. The deliverables are both the scraper and its code (for future use) and the file/database. The pages have various fields on them and are typically formatted like this: Name: Angelina Onova Born: December 21, 1978 (1978-12-21) (age 33)Czech Republic For this example, the output should have a Name column with value Angelina Onova and a Born field with value 12-27-1978. There are around 15 fields like this. They're mostly formatted in the same way, so if you have one, the rest is pretty much copy/paste work. The job has two parts: programming the scraper and letting it run on the site. As I said, the site has a ton of pages, so it will take some time to do the job. Getting a list of the URLs is also part of the job, but I think this is fairly easy for an experienced scraper. Please give me a fixed price and an estimated time needed. If possible, please split this price and time up for the two parts (programming part and scraping part). Also tell me which technologies you want to use and how I can use it myself later on. Last but not least, tell me what kind of output options you can offer. CSV is fine for me, but I'm ignorant to what is best/easiest. When it's all ready, I'll probably have a PHP script import the data into my MySQL database. So maybe a MySQL database as export option for your script is also a good option. Finally, keep in mind that the target site contains adult content, so it is NSFW (Not Safe For Work).
Project ID: 3992265

About the project

17 proposals
Remote project
Active 11 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
description
$50 USD in 7 days
5.0 (2 reviews)
1.9
1.9
17 freelancers are bidding on average $78 USD for this job
User Avatar
Hi sir, please check PM, thx Kimi.
$88 USD in 2 days
5.0 (344 reviews)
7.9
7.9
User Avatar
I can do this for you. See PMB for details.
$60 USD in 2 days
4.9 (371 reviews)
7.7
7.7
User Avatar
I worked on many similar projects, I have big experience in data mining projects. I can finish this task in short time, with the best quality.
$100 USD in 1 day
4.9 (74 reviews)
7.2
7.2
User Avatar
Hi, I can develop you a desktop java program to scrape that website and enter member data (name, birth date etc.) into a csv file. I can also run the program and deliver you the data included in this bid. You may import csv file into your mysql db. Web scraping is my main profession and i completed many scraping jobs before successfully. You may see this as you review my work history and ratings. Please let me know if you have any question/doubt regarding my proposal. Regards, Sedat
$80 USD in 1 day
5.0 (72 reviews)
6.6
6.6
User Avatar
Hi, I can create a windows desktop app to scrape this website. The output file can be in csv, xls, xlsx, xml, or sql. Please see inbox for more details. Thank you.
$100 USD in 5 days
5.0 (55 reviews)
5.5
5.5
User Avatar
Hi! I have read and understood the project details. Check PMB for more details.
$100 USD in 5 days
4.9 (29 reviews)
5.4
5.4
User Avatar
Hi, Ready to start your work. Eagerly awaiting for your positive reply. Please check your inbox for further details. Thanks, Shaik.
$99 USD in 5 days
5.0 (44 reviews)
5.3
5.3
User Avatar
Details (split of costs,schedules,etc) are in PM. Please check PM and send me the URL and I'll create a free scraping demo for you. PHP will be used. A very experienced scraper here, my clients' reviews on my profile don't cheat.
$70 USD in 3 days
4.8 (4 reviews)
4.1
4.1
User Avatar
Ready to do.
$80 USD in 4 days
5.0 (2 reviews)
2.2
2.2
User Avatar
May I have the URL of the site you would like to scrape data from?
$99 USD in 3 days
5.0 (1 review)
1.2
1.2
User Avatar
Hi I can do this in perl . Please see PMB. Thanks
$75 USD in 3 days
5.0 (1 review)
1.4
1.4
User Avatar
Hi, I like your work.
$77 USD in 7 days
4.2 (2 reviews)
1.4
1.4
User Avatar
Hi, This bid is for delivering the datalist. I can write a scraper in matlab, but you would actually need matlab to run it. If you need a re-run in the future i'd be glad to help you out with that.
$75 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, ready for this Job. Advanced level in data mining. Wide range of tools. Details - PMB. Best regards, Rubens.
$30 USD in 1 day
0.0 (1 review)
1.1
1.1

About the client

Flag of BELGIUM
Neerpelt, Belgium
5.0
37
Payment method verified
Member since Oct 3, 2005

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.