Scrape USDA Database
- Status Closed
- Budget $30 - $250 USD
- Total Bids 32
Scraping USDA 2016 database
Go to [url removed, login to view]
Scrape all the items in the database (77,413 listed):
For each page (1549 listed), grab for each item:
Information from the three columns:
From “Description”, extract the UPC code if available (leave it in the Description field too)
Go to the link of the “NDB. No” column and grab information from columns
Column 1: “Nutrient”
Column 2: “Unit”
Column 3: “Value per 100g”
Export into Excel file with
1 row per item
Columns: NDB. No, Description, Food group, UPC, and nutrition information
Note: “nutrition information” does not have a consistent format. Some items give “energy, proteins, total lipid, carbohydrates, sodium”, some give “energy, proteins, total lipid, carbohydrates, fibers, sugar, calcium, iron”, and some other might give other nutrients. Make sure to keep similar nutrients in the same column and add a column for every new nutrient found.
In the output file, similar nutrients should be put in corresponding columns. If an item does not contain information on a nutrient, the cell should be left blank (do not put a zero).
Get free quotes for a project like this
Looking to make some money?
- Set your budget and the timeframe
- Outline your proposal
- Get paid for your work
Hire Freelancers who also bid on this project
Looking for work?
Work on projects like this and make money from home!Sign Up Now
- The New York Times
- Wall Street Journal
- Times Online