Scrape online recipe nutrition facts

Scraping online recipe nutrition facts involves extracting structured data (like calories, fat, protein, etc.) from recipe websites. Here’s how you can approach this, legally and technically:

1. Understand Legal Considerations

Before scraping any website:

• Check the site’s Terms of Service.

• Respect robots.txt to see if scraping is allowed.

• Consider using APIs (e.g., Spoonacular, Edamam) if available, which are designed for legal data access.

2. Choose Tools and Libraries

Use Python with the following tools:

• requests – to fetch web pages

• BeautifulSoup – to parse HTML

• pandas – for structuring data

• re – for regex extraction

• Optional: Selenium for JavaScript-heavy sites

3. Basic Scraper Example

Here’s a basic scraper using requests and BeautifulSoup for a static recipe page:

python
CopyEdit
import requests
from bs4 import BeautifulSoup

url = 'https://www.allrecipes.com/recipe/24074/alysias-basic-meat-lasagna/'
headers = {'User-Agent': 'Mozilla/5.0'}

response = requests.get(url, headers=headers)
soup = BeautifulSoup(response.content, 'html.parser')

# Example: Find nutrition facts
nutrition_section = soup.find('section', {'class': 'nutrition-section container'})
if nutrition_section:
    nutrition = nutrition_section.get_text(strip=True)
    print("Nutrition Facts:", nutrition)
else:
    print("Nutrition information not found.")

4. Extract Specific Nutrients

You can further refine this by extracting specific nutrients:

python
CopyEdit
import re

pattern = r'(d+)s*calories|(d+)s*g fat|(d+)s*g protein|(d+)s*g carbohydrates'
matches = re.findall(pattern, nutrition.lower())
print(matches)

5. Use Recipe APIs for Structured Nutrition

If you need bulk or reliable structured data, use an API:

Spoonacular Example:

python
CopyEdit
import requests

api_key = 'YOUR_API_KEY'
query = 'chicken alfredo'
url = f'https://api.spoonacular.com/recipes/complexSearch?query={query}&addRecipeNutrition=true&apiKey={api_key}'

response = requests.get(url)
data = response.json()

for recipe in data['results']:
    print(recipe['title'])
    print('Calories:', recipe['nutrition']['nutrients'][0]['amount'])

6. Store and Use the Data

After scraping or using the API:

• Store in CSV or database

• Normalize units (g, mg, kcal)

• Display or analyze in your app or website

7. Scraping Sites with JavaScript

For sites like Food Network or BBC Good Food:

python
CopyEdit
from selenium import webdriver

driver = webdriver.Chrome()
driver.get('https://www.bbcgoodfood.com/recipes/spaghetti-carbonara')
soup = BeautifulSoup(driver.page_source, 'html.parser')

# Extract nutrition info
nutrition_info = soup.find_all('table')
for item in nutrition_info:
    print(item.get_text())
driver.quit()

8. Tips for Better Results

• Use browser dev tools (F12) to inspect exact class names for nutrition facts.

• Handle pagination or multiple recipes with loops.

• Add delay (time.sleep) to avoid getting blocked.

Let me know if you want a ready-to-run scraper script for a specific site or integration into a larger project.