Golang Web Scraping & Email Notification
Budget: $30 – $250 USD
I need a Golang expert to develop a web scraper that collects announcements from a specific website. The tool should also be able to send email notifications with the full text of each new announcement. The scraping frequency will vary depending on configuration from a database record.
Tasks overview:
1. API endpoint that takes in 4 parameters and saves them to a database table.
2. Based on the database table records, regularly crawl (job/task needed) a public website to look for new announcements, then:
a. Send an email notification when a new announcement is found
b. Save the result in a second database table
Note: 2 pages will be crawled and parsed
3. Another API endpoint that allows #2 to be triggered manually.
Deliverables: Go project, docker-compose.yaml for a PostgreSQL database, and Dockerfile to run the Go application
Good to have: Unit tests for task #2 (perhaps by invoking endpoint in task #3)
Tasks overview:
1. API endpoint that takes in 4 parameters and saves them to a database table.
2. Based on the database table records, regularly crawl (job/task needed) a public website to look for new announcements, then:
a. Send an email notification when a new announcement is found
b. Save the result in a second database table
Note: 2 pages will be crawled and parsed
3. Another API endpoint that allows #2 to be triggered manually.
Deliverables: Go project, docker-compose.yaml for a PostgreSQL database, and Dockerfile to run the Go application
Good to have: Unit tests for task #2 (perhaps by invoking endpoint in task #3)