Find Jobs
Hire Freelancers

Python - Web scraping of content from 500 sites (home page only)

$10-100 AUD

Completed
Posted over 4 years ago

$10-100 AUD

Paid on delivery
We require scraping of 500 websites (home page only) to gather the following: - Title - Meta Description - og:site_name - og:title - og:URL - og:Description - og:Image - og:image:width - og:image:height - Body Text ( The Main Content) *** A few things to know. We expect the list of URLs to be ok, but they have not been tested, so you will need to check that they resolve, and you may need to convert www. to non-www and vice versa or http to https and vice versa etc if required to resolve. *** we are looking to gather the first 150 words from the main body of content. It doesn’t matter if more is provided. Please only take this job if you have a pre-written Python Script, and if you a re capable of getting the page's Main Content which is the most important part Please add the word Welcoming so that I know that you have read this.
Project ID: 22088154

About the project

26 proposals
Remote project
Active 5 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Welcoming Hi, I am a software developer with 5 years of experience in web scraping and web development. I can make the web scraper to extract the mentioned data from the website homepages.
$100 AUD in 7 days
5.0 (1 review)
1.7
1.7
26 freelancers are bidding on average $62 AUD for this job
User Avatar
Hi. I did read the project description and have a few questions. 1. Do you need the script as well or data only? 2. What is the format of the output data? CSV is OK? We can do other formats as well. 3. Which fields do you want to extract from the website? 4. How many results/urls are there? 5. What is the website? Let's get in touch and we can provide a sample. Thx, waiting for these details and hope to collaborate.
$200 AUD in 5 days
5.0 (133 reviews)
7.6
7.6
User Avatar
Okay. I have huge experience in working with these projects. If you need sample work just send me a message. Waiting for your quick reply.
$30 AUD in 1 day
4.9 (88 reviews)
6.2
6.2
User Avatar
Hi, I am expert with copy typing, copy pasting as well as great skills for data entry. I have complete number of project for Data Entry and data scrapping like you are looking for. So, you can trust me for best output and timely manner completion. You can check my profile feedback and you will satisfied to discuss with me for this job. Your work will be delivered well in advance with seamless communication & timely response until project is completed. As well as for any alternation and querry we are avaialbe 24 x7. Looking forward for great business deal."
$30 AUD in 1 day
4.8 (78 reviews)
6.3
6.3
User Avatar
Welcoming Hello! I have a script in Python that can open URL and extract Title, Meta, Body, etc from the HTML code. I can make it try https instead of http and vice versa. The same with www.
$50 AUD in 1 day
5.0 (38 reviews)
5.9
5.9
User Avatar
Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs less ,,,,,,,  , , ,
$55 AUD in 3 days
4.9 (104 reviews)
5.9
5.9
User Avatar
Greetings, I am an experienced professional scrapper and doing this since many years. I have scrapped more than 1000 websites, same can be verified by my profile. Please allow me to assist you. Thanks
$200 AUD in 10 days
4.8 (65 reviews)
6.2
6.2
User Avatar
⭐⭐⭐Dear sir!⭐⭐⭐ I have read your description and bid here. I can make your script using BS4 or Selenium, Scrapy. I am a web scraping expert in python scraping. I can help you perfectly. Please see my profile (https://www.freelancer.com/u/naravila?w=f) As you can see my profile I am web scraping expert in python. I can make your script using BS4 or Selenium, Scrapy. So please discuss in chat. I am waiting for your ping. Thank you!!
$150 AUD in 1 day
5.0 (17 reviews)
5.5
5.5
User Avatar
Welcoming. Hi. I am ready to write your project Write apps on your demand in many languages (Visual Basic, VBA, VBS, .NET, C#, JS, Python, Java, PowerShell) Write database apps including many db formats: MS Access, MS SQL, SQL Server, MySQL, SQLite, PostgreSQL, Firebird Write Automation apps including: * Automation Desktop apps. Some examples: Automation Playing Games, Automation Start/Stop/Click 3rd party apps * Automation Web apps. Some examples: Automation Web Scraping apps, Automation Web Crawling apps * Automation Data Processing apps: Automation formatting data to a specified template * Automation Data, Document Converting apps * Automation Macro, VBA for all apps in MS Office (Excel, Word, Outlook), OpenOffice, GoogleSheet * Automation Installers/Setups * Convert your Manual tasks to Automation solutions Write Web Service, Web API, Desktop API apps. Some examples: Google API, Bing API, Facebook API, MS API Fix/Solve any errors in your OS, apps
$30 AUD in 1 day
4.9 (41 reviews)
5.3
5.3
User Avatar
*Welcoming* Thank you for your attention. I read the project description with interest. I strongly believe I am the proper candidate. I fit all the requirements you mentioned, including Python. I can help you kindly and full time. Please check my profile and past reviews. Let us discuss in more detail through chat. Thanks.
$30 AUD in 7 days
5.0 (14 reviews)
4.5
4.5
User Avatar
Hello, I have experience in web scraping with Python. I can use Selenium, Scrapy, BeautifulSoup and Requests to make the best web scrapers! I hope to work with you!
$220 AUD in 7 days
5.0 (6 reviews)
4.2
4.2
User Avatar
Hello There, I have rich experience in scraping websites data with python. I would like to do your project. Message me for more details. We can discuss more over chat.
$20 AUD in 1 day
4.8 (20 reviews)
4.3
4.3
User Avatar
welcome, I have read your full description about your need. I am a we scraper. I am willing to help you to this work. WOuld you please share the link that you want to scrap? I will wait for your reply. Thanks. Shahidul.
$30 AUD in 1 day
5.0 (10 reviews)
3.9
3.9
User Avatar
♚♚➤➤Hi There♚♚➤➤I am ready to start your work right now. I will impress you with my work and will do good job for you. 10 Year experienced in Excel, word, typing, data scraping, Web scraping.
$75 AUD in 1 day
5.0 (3 reviews)
3.3
3.3
User Avatar
Welcoming I am a Senior Python developer has over 6 years experience in python script/app development. I've built a lot of python scrapers using Scrapy framework and Selenium/Phantomjs/Requests/lxml/bs4 packages. And also I've worked with various version of python. (2.x/3.x) The project I am most proud of was to scrape the certain data (such as products, review, categories, price and so on) from the ecommerce websites worldwide. And also another was to automate the login, register workflow and scrape the recursive data. I am ready to start immediately. Regards,
$75 AUD in 3 days
5.0 (2 reviews)
1.2
1.2
User Avatar
Welcoming. Hi buddy, please contact me on the chat for other things then i can start to code your bot ASAP. BTW i'm experienced Python and Selenium WebDriver developer which is best for your job. I'm waiting to hear from you. Regards
$25 AUD in 1 day
5.0 (1 review)
0.6
0.6
User Avatar
= Welcome = Hi. I am a software engineer and love to program things for the beneficial of people around the globe. I have great experience of extracting information from websites i.e. Scraping/Crawling and also have experience of developing android/mobile apps with social integration using API's and SDK's. I would like to discuss your job with you. Best regards. Thanks.
$30 AUD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Dear Rechard, I read your job description and i see that you are finding someone who can exract data from a website i can surely help you with this project. The technologies i use to extract you data is via python programming i will generation pattern of each data and crawl to to website link. Fell free to reach to me and discuss about the project.
$20 AUD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, I have done work around extraction of the data from .csv,.txt,.xls,.xlsx,.log,.xml,.dat,.html,.pdf,.Jason,.ej ( electronic Journal. i.e. ATM logs),dropBox,Webpage Navigation (Sample),.css,.php,.doc,.docx,.rtf,.ppt.,Web scraping The information can be stored in the Database or CSV file as requested. I will not only pick the information inside the file but also about the file (metadata). I am an expert in this work and can achieve the results in the fastest time-frame. Please let me know if you are interested to have a conversation. Happy to have a chat or call. Thanks, Harsh
$20 AUD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
hi a haved read your proyect Andrés i can do it for you. Welcoming. Note: the price is low because i want to get mi first review.
$20 AUD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi! My name is vivek and I am a passionate Engineer having 2 years experience in Python and writing other useful python scripting utilities. I'm specialized on web scrapping/django and other python field. I will Scrape any Website for you in any format you want. I have more than 1 years of experience in Web Scraping, Web scraper developmen. I use python techniques to scrape data and I have completed more than 500 scraping tasks successfully in my company i will use Python, Requests, BeautifulSoup, Selenium, Scrapy for web scrapping. Just send in website URL with the template you need the data in and I will output data in any format you need e.g. csv, xlsx, xls, txt, xml, json, doc, docx etc.
$20 AUD in 1 day
0.0 (0 reviews)
0.0
0.0

About the client

Flag of AUSTRALIA
newtown, Australia
4.8
5
Payment method verified
Member since May 22, 2019

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.