Web Data Scraping Automation
Budget: $30 – $250 AUD
I need a web-based automation tool to scrape data from a public website that requires login access. The site does not have API endpoints.
Requirements:
-Source URL: https://myrta.com/oplinc2/pages/security/oplincLogin.jsf
- Scrape text data and PDF files
- Download relevant PDF files
- Export scraped data to MySQL database
- Operate within a specified time interval
Ideal skills and experience:
- Proficiency in web scraping tools (e.g., Beautiful Soup, Scrapy)
- Experience with MySQL
- Familiarity with handling login sessions in scraping
- Ability to set up automation (e.g., using cron jobs, scripts)
Please provide examples of similar work done.
Requirements:
-Source URL: https://myrta.com/oplinc2/pages/security/oplincLogin.jsf
- Scrape text data and PDF files
- Download relevant PDF files
- Export scraped data to MySQL database
- Operate within a specified time interval
Ideal skills and experience:
- Proficiency in web scraping tools (e.g., Beautiful Soup, Scrapy)
- Experience with MySQL
- Familiarity with handling login sessions in scraping
- Ability to set up automation (e.g., using cron jobs, scripts)
Please provide examples of similar work done.
Related categories:
PHP
Data Processing
Web Scraping
MySQL
Database Programming
Elasticsearch
Web Development
Scrapy
Data Extraction
Automation