Automated News Scraper & Alert System
Budget: $250 – $750 CAD
Job Title: Junior Mining Stock News Scraper with Automated Alerts and Flexible URL Management
Project Overview: I’m looking to build a fully automated web scraper to monitor news and updates from junior mining stock sites. This tool should extract information from specific news pages, parse relevant data, and send alerts (e.g., email notifications) when new information is posted. The project will involve cloud setup for scheduled scraping and data storage for easy tracking and analysis.
Project Requirements:
Web Scraper Development:
Targeted Sites: The scraper will monitor news pages of selected junior mining companies (initial URLs provided).
Data Extraction: Capture specific elements from each page, such as:
News headlines
Publication dates
Summary text or content snippets
Links to full articles
Flexible URL Management: The system should include a simple way for me to cut and paste URLs to easily add new stocks or remove those that aren’t performing well, without requiring technical changes.
Cloud-Based Automation:
Platform: Deploy the scraper on a cloud platform (e.g., Google Cloud, AWS, or Azure) for scheduled scraping.
Scheduling: Automate regular checks (e.g., daily or weekly) for new updates on the target sites.
Scalability: Ensure the setup can handle adding more sites or pages in the future.
Alert System:
Email Alerts: Integrate an alert system to send notifications when new content is detected.
Customizable Notifications: Allow settings to customize alert frequency (e.g., instant, daily digest).
Optional: Reporting and Data Storage
Set up a lightweight database or Google Sheets to store extracted data for reference and analysis.
Optional automated reporting feature that summarizes recent news updates.
Skills Needed:
Web scraping experience, preferably in Python.
Familiarity with cloud deployment (Google Cloud, AWS, or similar).
Knowledge of email API integrations for alerts.
Data storage skills (Google Sheets, databases, etc.) and handling user-editable URL lists.
Timeline and Budget: Please provide an estimated number of hours and rate. I aim to complete this project within 1-2 weeks, but I’m flexible based on requirements.
Project Overview: I’m looking to build a fully automated web scraper to monitor news and updates from junior mining stock sites. This tool should extract information from specific news pages, parse relevant data, and send alerts (e.g., email notifications) when new information is posted. The project will involve cloud setup for scheduled scraping and data storage for easy tracking and analysis.
Project Requirements:
Web Scraper Development:
Targeted Sites: The scraper will monitor news pages of selected junior mining companies (initial URLs provided).
Data Extraction: Capture specific elements from each page, such as:
News headlines
Publication dates
Summary text or content snippets
Links to full articles
Flexible URL Management: The system should include a simple way for me to cut and paste URLs to easily add new stocks or remove those that aren’t performing well, without requiring technical changes.
Cloud-Based Automation:
Platform: Deploy the scraper on a cloud platform (e.g., Google Cloud, AWS, or Azure) for scheduled scraping.
Scheduling: Automate regular checks (e.g., daily or weekly) for new updates on the target sites.
Scalability: Ensure the setup can handle adding more sites or pages in the future.
Alert System:
Email Alerts: Integrate an alert system to send notifications when new content is detected.
Customizable Notifications: Allow settings to customize alert frequency (e.g., instant, daily digest).
Optional: Reporting and Data Storage
Set up a lightweight database or Google Sheets to store extracted data for reference and analysis.
Optional automated reporting feature that summarizes recent news updates.
Skills Needed:
Web scraping experience, preferably in Python.
Familiarity with cloud deployment (Google Cloud, AWS, or similar).
Knowledge of email API integrations for alerts.
Data storage skills (Google Sheets, databases, etc.) and handling user-editable URL lists.
Timeline and Budget: Please provide an estimated number of hours and rate. I aim to complete this project within 1-2 weeks, but I’m flexible based on requirements.