Scrape artist lyrics and sort by theme

To scrape artist lyrics and sort them by theme, follow this step-by-step process using Python and appropriate libraries:

1. Web Scraping Setup

Libraries Needed:

bash
CopyEdit
pip install requests beautifulsoup4 nltk sklearn

Import libraries:

python
CopyEdit
import requests
from bs4 import BeautifulSoup
import os
import re
import nltk
from sklearn.feature_extraction.text import TfidfVectorizer
from sklearn.cluster import KMeans
nltk.download('punkt')
nltk.download('stopwords')

2. Function to Scrape Lyrics

Here’s an example function using Genius.com (you’ll need a Genius API key or parse web pages carefully if no API is used):

python
CopyEdit
def scrape_lyrics(artist_name, num_songs=10):
    base_url = "https://genius.com"
    search_url = f"https://genius.com/api/search/multi?per_page=5&q={artist_name}"
    headers = {'User-Agent': 'Mozilla