45542 Datafeed Slurper

In Progress Posted Sep 19, 2005 Paid on delivery
In Progress Paid on delivery

This project will be geared toward downloading and parsing data for a shopping/deal site. It needs to support an unlimited number of merchants, as well as text AND image 'deals'. The data needs to be downloaded to and synchronized with a MySQL database (version 4.1.x). The data also needs to be updatable, for time-sensitive items or things that are no longer in the datafeed, but things which remain the same should not be modified. There will need to be edit interfaces that can change descriptive text and URLs for each merchant, as well as the individual products (for instance, if the title is not great, there needs to be a way to rename a specific link, but still keep it linked to the original data, in case it ever changes or expires). I should note there are image links in both programs, and the images will need to be stored in an image table, or at MINIMUM cached locally (and tracked to the link url). To summarize: The candidate should be skilled in PHP and Curl, specifically downloading and parsing large amounts of data. The data should be downloaded, parsed and inserted into a MySQL database. A sample of the database and admin interface will be provided, but are not fully functional. The two parts to the project include A) Downloading data via Curl (https/cookies/javascript) B) managing content in a php web-based interface to turn ads on or off. The entire structure is custom needs to be portable to different domains, and optionally with support for multiple domains on the backend (rather than duplicating the data - but this is an option). Please feel free to ask questions about scope and size - but once a tool can download two merchants with two items, automating it across 5,000 shouldn't be that much harder, hopefully.

Odd Jobs Perl PHP

Project ID: #1794878

About the project

Remote project Active Jul 11, 2012