Find Jobs
Hire Freelancers

Multithread python crawler for determination of pHash values

$30-250 USD

In Progress
Posted about 9 years ago

$30-250 USD

Paid on delivery
I am looking for a guy who can program a multithread python crawler and the user interface. User interface: ------------------- - User has the option to add several pictures (of which the pHash value is determined) - User has the option to add URLs to be crawled detected Step 1: --------- Each day, the entire website of the typed in URLs is crawled that way, that the paths of each subpage, etc. is determined. The paths shall be shared into 10 databases. (e.g.: A website has 100 subpages - 10 of these URLs are put to the first database, 10 to the second, etc.) Step 2: --------- One crawler (one crawler per server) cares for one database, visiting all stored URLs and getting the pHash values of the pictures displayed on the website. The pHash value shall be stored in a central result database together with the server path of the picture) Step 3: --------- The pHash value of the originally uploaded picture and the found picture on the websites is compared. If the value is above a certain, by the user determinable value, the found picture is listed in the user interface as a potential match. Other requirements: -------------------------- * I need to have the option whether [login to view URL] and meta information shall be respected or not while crawling. * I need to be able to set an hourly limit of the number of crawls per one website in order not to take to much attention and resources of the foreign websites. * German freelancers are preferred.
Project ID: 7464007

About the project

3 proposals
Remote project
Active 9 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
A proposal has not yet been provided
$200 USD in 3 days
4.9 (31 reviews)
4.2
4.2
3 freelancers are bidding on average $232 USD for this job
User Avatar
A proposal has not yet been provided
$250 USD in 5 days
4.7 (37 reviews)
5.4
5.4

About the client

Flag of GERMANY
Lüneburg, Germany
5.0
105
Payment method verified
Member since Jul 21, 2013

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.