Goal of Program: A program/script that scrapes free public proxy websites, sorts them by country/city in America and puts them in a data base.
Script Features:
1. We need a script/database that scrapes free proxy websites (with provided list, that we can update )
2. Sort the proxies and categorize them by country then run through [login to view URL] and sort by State, City.
3. Mulit-threaded
4. Continually repopulate/update the working proxy list (remove timeout etc)
5. Custom proxy filter that will remove government (.gov) and others we provide
6. Built in search function that will display the closeted proxy to a given city or zip.
**Example: Search "Dallas, TX 75204" > Script will display closest proxies to that city, closest could be Oklahoma for example, it will display first and so on.
7. Option to remove proxy from list (checkbox next to proxy)
8. Proxies will be used with FoxyProxy a Mozzila Add on. Check it out.
I have some desktop programs that do this for an example. This needs to work on a server.
For scraping Proxies off sites: [login to view URL]
For Geo locating to the city: [login to view URL]
[login to view URL]
Employer questions:
(1) Experiences with script building?
(2) Project Time Frame?
(3) Do you have an understand of proxies?