Find Jobs
Hire Freelancers

Custom URL Harvester Software Needed

$30-250 USD

Closed
Posted about 10 years ago

$30-250 USD

Paid on delivery
I need a web-based URL harvester that will filter the results based on if the websites have any legal pages, such as a Terms of Service, Privacy Policy, or Earning's Disclaimer. It should be written in PHP or HTML so that the entire scraper can be embedded into a website and the output can be viewed on the site and downloaded. Formatting is not required for this project, but the scraper should be able to be formatted in the future using basic CSS. Project Requirements: 1) Web-based UI (either PHP or HTML) able to be formatted with CSS 2) User must be able to enter a keyword related to local businesses 3) Scraper will search for websites related to those keywords and see if they have legal pages. 4) If the website does not have a Terms of Service or Privacy Policy page, it will output the URL to the final list 5) The output list of URLs should be able to be viewed on a web page and be able to be downloaded in either TXT, CSV, or EXCEL format Optional: 1) If possible, it should also harvest the contact emails and business name for the websites that do not have legal pages and output it along with the URLs Example: For example, a visitor should be able to search for "Nail Salon Houston, TX" and the program will return a list of local nail salon websites in Houston, TX that do not have either a Terms of Service or Privacy Policy. Preference will be given to the lowest bidder that can include the optional features of contact emails and business names along with the URLs. Please respond with a brief overview of the features you will include in this program to make sure you fully understand the project.
Project ID: 5474011

About the project

3 proposals
Remote project
Active 10 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
3 freelancers are bidding on average $179 USD for this job
User Avatar
Hi, I have done similar work in past and would like to work on your project. My road-map would include: - build a form for user to input search keyword - perform search, based on input keyword, on search engine (google) to gather links - gather links from first two pages - scrap each sitemap/menu of gathered links and look for Terms of Service, Privacy Policy or Disclaimer page - look for Contact page within pages that have Terms of Service, Privacy Policy or Disclaimer page - build dashboard that would have search term, time/date of search and downloadable processed data Processed data would have search term and date as headers and Business name, URL and contact information. For this I would need some database (PostgreSQL, MySQL, even Mongo or alike), PHP and web server. All this is usually provided by most hosting companies. I could provide demo on my server, but for final deployment would need above mentioned things. Good luck and best regards, -Ersan
$166 USD in 5 days
4.9 (6 reviews)
3.2
3.2
User Avatar
A proposal has not yet been provided
$155 USD in 3 days
5.0 (1 review)
1.4
1.4

About the client

Flag of UNITED STATES
Newtown, United States
5.0
9
Payment method verified
Member since Feb 8, 2012

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.