Monitor Google Alerts with Python

Google Alerts is a powerful free tool that enables users to track specific search terms and get notified when they appear in new web content. While Google Alerts doesn’t offer an official API, you can still monitor alerts using Python by automating email retrieval and parsing. This article covers how to set up and monitor Google Alerts using Python, IMAP email access, and basic parsing logic.

Understanding Google Alerts

Google Alerts allows you to receive notifications via email when new content related to your specified keywords appears online. These alerts are typically sent to a Gmail account. Since there is no direct API for Google Alerts, the most effective method is to receive alerts via email and automate their extraction using Python.

Step 1: Set Up Google Alerts

1. Go to Google Alerts.

2. Enter your desired keyword or phrase.

3. Choose alert frequency, sources, language, region, and how many results you want.

4. Set the delivery to your Gmail account.

Once this is set up, you’ll start receiving email alerts based on your specified criteria.

Step 2: Enable IMAP in Gmail

To access Gmail alerts via Python, enable IMAP in your Gmail settings:

1. Go to Gmail settings.

2. Click the “Forwarding and POP/IMAP” tab.

3. Under “IMAP access,” select “Enable IMAP.”

4. Save your changes.

You also need to create an App Password if you use 2-step verification:

• Visit Google App Passwords.

• Select the app (Mail) and device (your script or PC).

• Generate the password and save it securely for use in your script.

Step 3: Install Required Python Libraries

To interact with Gmail and parse email contents, use the following libraries:

bash
CopyEdit
pip install imaplib2 email beautifulsoup4

These libraries help retrieve and parse email content effectively.

Step 4: Connect to Gmail Using IMAP

Use the imaplib and email modules to log into Gmail and fetch unread Google Alert emails.

python
CopyEdit
import imaplib
import email
from bs4 import BeautifulSoup

EMAIL = 'your_email@gmail.com'
APP_PASSWORD = 'your_app_password'
IMAP_SERVER = 'imap.gmail.com'
IMAP_PORT = 993

python
CopyEdit
def connect_to_email():
    mail = imaplib.IMAP4_SSL(IMAP_SERVER)
    mail.login(EMAIL, APP_PASSWORD)
    mail.select("inbox")
    return mail

Step 5: Fetch Google Alert Emails

Filter messages from Google Alerts using sender and subject keywords.

python
CopyEdit
def fetch_google_alerts(mail):
    result, data = mail.search(None, '(FROM "googlealerts-noreply@google.com" UNSEEN)')
    alert_emails = data[0].split()
    alerts = []

    for num in alert_emails:
        result, data = mail.fetch(num, '(RFC822)')
        raw_email = data[0][1]
        msg = email.message_from_bytes(raw_email)

        if msg.is_multipart():
            for part in msg.walk():
                if part.get_content_type() == 'text/html':
                    html_content = part.get_payload(decode=True).decode()
                    soup = BeautifulSoup(html_content, 'html.parser')
                    alerts.append(soup.get_text())
        else:
            if msg.get_content_type() == 'text/html':
                html_content = msg.get_payload(decode=True).decode()
                soup = BeautifulSoup(html_content, 'html.parser')
                alerts.append(soup.get_text())
    return alerts

Step 6: Store or Process Alerts

Once alerts are extracted, you can store them in a file, database, or trigger custom logic.

Example: Print Alerts to Console

python
CopyEdit
if __name__ == '__main__':
    mail = connect_to_email()
    alerts = fetch_google_alerts(mail)
    for i, alert in enumerate(alerts):
        print(f"Alert {i+1}:n{alert}n{'-'*40}")

Example: Save Alerts to a File

python
CopyEdit
with open("google_alerts_log.txt", "a", encoding="utf-8") as f:
    for alert in alerts:
        f.write(alert + "n" + "="*80 + "n")

Step 7: Schedule the Script

To run this script automatically at regular intervals:

On Linux/macOS:

Use cron:

bash
CopyEdit
crontab -e

Add a line like this:

bash
CopyEdit
0 * * * * /usr/bin/python3 /path/to/your/script.py

This runs the script every hour.

On Windows:

Use Task Scheduler to set up a recurring task that runs the Python script.

Security Considerations

• Use App Passwords instead of your main Gmail password.

• Never hard-code credentials in your scripts. Consider using environment variables or a .env file managed by python-dotenv.

• Always encrypt stored data if it contains sensitive information.

Optional Enhancements

Keyword Filtering

Add keyword filtering to refine which alerts are logged or acted upon:

python
CopyEdit
def keyword_filter(alerts, keywords):
    filtered = []
    for alert in alerts:
        if any(keyword.lower() in alert.lower() for keyword in keywords):
            filtered.append(alert)
    return filtered

Slack or Email Notifications

You can forward filtered alerts to Slack or send a custom email using smtplib or services like Twilio SendGrid or Mailgun.

Database Integration

Store alerts in an SQLite or PostgreSQL database for advanced querying, analytics, or UI dashboard display.

Conclusion

Monitoring Google Alerts with Python is a practical workaround in the absence of an official API. By combining IMAP email access with parsing logic, you can track web mentions of specific topics in near real-time. This solution can be integrated into larger workflows for brand monitoring, competitive intelligence, news tracking, and SEO strategy.