Find Jobs
Hire Freelancers

I need a text web crawler for this site: https://breakingnewsenglish.com/

$30-250 USD

Completed
Posted over 5 years ago

$30-250 USD

Paid on delivery
I need a crawler for this site: [login to view URL] It has many news. And each news is written in different levels of English. And now here is and archive: [login to view URL] I need to download only those articles that have Level 0, Level 1, Level 2 and Level 3 at the same time. Other articles should be ignored. The articles should be saved in following manner: [login to view URL] [login to view URL] [login to view URL] [login to view URL] The articles must be saved in UTF-8, I need the articles to be lowercased normalized and tokenized. For this you can use this [login to view URL] pipeline of tools. The test should also be in one line – no new line symbols in text. The tool must work under Ubuntu Linuux
Project ID: 17585393

About the project

18 proposals
Remote project
Active 6 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
I have already developed the concept and the theoretical algorithm for this project, so it will not take much effort to finish it.
$30 USD in 2 days
5.0 (1 review)
1.0
1.0
18 freelancers are bidding on average $176 USD for this job
User Avatar
Hi. I am very interested in your project, because I have much experience in such projects. I have good skills with the program language including C/C++, C#, java, php, asp.net, python, VB.NET. So I have expert and smart technic with web scraping (1000 over projects for scraping), automation and bot(500 over projects for automation and bot), selenium, mobile (android, ios native and others). Especially, I am an expert in betting project and gambling games and sites(bet365, bwin, pinnacle, betfair...) ,,, shopping auto buyer(adidas, footlocker, eastbay, supreme and etc) So, I can solve the captcha automatically. Please contact me, then we can discuss about the details and the price. And I am free in recent days, so I can do my best for your project. Thanks.
$222 USD in 3 days
5.0 (72 reviews)
6.8
6.8
User Avatar
Hi there, I have read the details I am experienced with Web Crawling. I can help you with this job, Please come to chat so we can discuss this job.
$555 USD in 3 days
4.9 (13 reviews)
6.1
6.1
User Avatar
Hello Sir, I am the expert freelancer here. I am on the 6th position through out the world to deliver the quality job. I have deliver here more than 385 + projects with 100% client satisfaction. I have more than 5 years of the experience in Java, Perl, Python, UNIX, Web Crawling Please check the profile reviews. I can deliver your job with in your deadline. Please ping me for more discussion. Thanks.
$250 USD in 4 days
4.9 (44 reviews)
6.0
6.0
User Avatar
Hi there, The requirements are quite clear so no questions. I'll use python to implement the crawler and it'll be ready in 24 hours at most, thanks.
$110 USD in 1 day
5.0 (22 reviews)
5.0
5.0
User Avatar
I will build the crawler in Python just checked the website so you need the articles in txt format ok and the UTF-8 format so no unicode errors, as well as lowercase normalized and tokenized i will either use scrapy framework or if needed multithreaded headless browsers.
$99 USD in 3 days
5.0 (52 reviews)
5.0
5.0
User Avatar
Hello, I can write you script in python for this. I can also normalized and tokenized text in python. This way you don't need to use external tools. I can start working almost right away It can take 1-2 days to make and test this script Josef
$100 USD in 3 days
4.6 (41 reviews)
5.2
5.2
User Avatar
How are you? I have read your initial requirement in detail and have become very interested in your requirement. I have the skill to satisfy your requirements. I have experience of 10 years for web site build using various frame work such as laravel,codeigniter, amazon and eBay manage using api ,c++,c#, python ,crypto currency development, trading exchange and so on. If you hire me, I'll work hardly and you'll get very good results.
$222 USD in 3 days
5.0 (4 reviews)
4.4
4.4
User Avatar
Hello, I have a complete experience scraping data from websites. I have already done a lot of scraping on similar websites Let's discuss. I have created the crawlers in my previous project using Java. I can do the same for you in this one as well. Kindly assign me the project so we can build a long-term relationship.
$222 USD in 3 days
4.8 (1 review)
3.0
3.0
User Avatar
Hi , l am very intrested to work on your project. I have more than 15+ years of experience in Web Development and around 1000 projects finished with success and some of them can be seen on freelancing websites Please send me all details for this project to agree on final terms and start working. NOTE: my bid is relative and final budget will be discussed before starting
$250 USD in 25 days
5.0 (2 reviews)
2.1
2.1
User Avatar
Hello Sir, I’ve gone through your requirements and confidently I can assure you for the best service available in the industry with 7+ years’ of expertise hand on Web development, Mobile App, and SEO & SMO projects. I can start work on your project immediately once you confirm me. I am also open to further discussion if you want.
$155 USD in 3 days
5.0 (1 review)
0.7
0.7
User Avatar
Hi I can do this task and have read all the details. I will use python and selenium and will provide you with the running code that will work under windows and linux both. Contact me to share further details Thanks
$200 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi. I can make you a web crawler that will extract the required articles, with corresponding information and content, and save the data in required manner in text files(.txt). You can also opt to update the data periodically. This code will run on any system which has python installed in it. I will provide you with a step-by-step guide to help you run the crawler. Thank You!
$222 USD in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of POLAND
Czestochowa, Poland
5.0
173
Payment method verified
Member since Jan 8, 2012

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.