crawler to index and download PDF files

$30-250 USD

Completed

Posted

over 11 years ago

$30-250 USD

Paid on delivery

We have a list of URLs in excel We need a Crawler (that will crawl the whole list ) on a fixed schedule We will set the frequency from back end We need : ID number to each file ALL the files of those URL's stored in a new DB ,we will set manually what file types we will choose (file type (PDF,DOC,HTML,IMGAES,OFFICE FILES,- all the versions ) ALL links to the file The file links on the main site.

.NET

C# Programming

Web Scraping

Project ID: 2390161

About the project

17 proposals

Remote project

Active 12 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

Awarded to:

@mittelmania

I can complete the application you want according to your specifications. I can build the scraper for you as a full application with a handy GUI you can use, or as a DLL you can then incorporate into future solutions, including all the features you demanded. Can start immediately.

$100 USD in 5 days

5.0

(7 reviews)

3.1

17 freelancers are bidding on average $119 USD for this job

@srinichal

I can deliver the automated script

$250 USD in 5 days

4.9

(88 reviews)

6.9

@barundebnath

Hi, I am expert in making Web scrapping and crawling application. Please send me full project details. Thanks

$150 USD in 2 days

5.0

(63 reviews)

6.2

@boygiandi

Hi. I can do it. Please send me more details. Thanks

$150 USD in 3 days

5.0

(10 reviews)

4.3

@tsstaff

Please give me the details of the project. Thank you.

$60 USD in 3 days

4.8

(7 reviews)

4.0

@studioprog

Hi, I have 5 years experience in asp.net. I can do it.

$100 USD in 5 days

4.2

(4 reviews)

3.3

@rizwanfpak

Already developed many web scrapping and technical applications solutions. Please see your PM. Thanks

$150 USD in 5 days

5.0

(3 reviews)

3.1

@donhuan

Dear Hiring Manager I'm a expert in scraper. I have created many scraper projects (please see my past works) and have experiences of your problem. I guarantee to complete your job well. Can i start? Best Regards, do-nhuan

$120 USD in 3 days

5.0

(1 review)

1.2

@toddzhuang

Hi, I have experience to do such project. In my current company, I developed a program which will download videos from remote server and convert the video from flv to avi, after that, it will insert some datas to database.

$200 USD in 4 days

0.0

(0 reviews)

0.0

@xaptor

we can do this. ready to start asap.

$75 USD in 3 days

0.0

(0 reviews)

0.0

@mz1

We can talk further about project.

$100 USD in 12 days

0.0

(0 reviews)

0.0

@rakeshkumaryadav

Hi. I can complete this task, please see PM for more detail. Thanks Rakesh Yadav

$50 USD in 2 days

0.0

(0 reviews)

0.0

@jayashantha82

We have developed similar applications. We can deliver the solution on time with quality.

$100 USD in 10 days

0.0

(0 reviews)

0.0

@jacktheripper

Can implement this program no problem. Let me know what kind of interface you would like for the crawler. Would you like a graphical interface or would you prefer a command line interface that can be run automatically from a server? If you choose my bid can have this implemented in no time. Jack

$130 USD in 3 days

0.0

(0 reviews)

0.0

@survey9706

I have relevant c# experience in making windows forms and console applications, extracting the data from the web, and writing this information to a database.

$100 USD in 5 days

0.0

(0 reviews)

0.0

@MarkOfNY

Hi, I've written a great deal of web scrapers and am very familiar with parsing HTML DOM model, going through all links and saving files from URLs. This would be developed as a service that runs periodically every defined number of hours, access all of the URLs specified, and save all the info to the database.

$150 USD in 2 days