Python Blog Scraper & Poster
Budget: $10 – $30 USD
The goal is to create a small Python application that uses Selenium to pull full blog posts from Site A and publish them to the existing blog section on Site B in one smooth run. Each post must include its title, main content, every in-article image, and some links that appears on Site A . so the copy on Site B is complete and faithful.
Typical flow I have in mind:
• Navigate through Site A, collect the URL list of new articles, and scrape title, text, images.
• Upload the same information to Site B’s blog area using Selenium-driven browser actions (credentials and URL paths will be provided).
• Store basic logs so I can confirm which articles were moved and when.
Deliverables that will mark the project finished:
1. Well-commented Python script (or small package) that runs headless with Selenium.
2. README explaining setup, required libraries, and how to adjust CSS/XPath selectors if either site changes.
The solution should be clean, dependable, and easy for me to schedule with cron or Task Scheduler once testing is done.
Typical flow I have in mind:
• Navigate through Site A, collect the URL list of new articles, and scrape title, text, images.
• Upload the same information to Site B’s blog area using Selenium-driven browser actions (credentials and URL paths will be provided).
• Store basic logs so I can confirm which articles were moved and when.
Deliverables that will mark the project finished:
1. Well-commented Python script (or small package) that runs headless with Selenium.
2. README explaining setup, required libraries, and how to adjust CSS/XPath selectors if either site changes.
The solution should be clean, dependable, and easy for me to schedule with cron or Task Scheduler once testing is done.
Related categories:
Python
Data Processing
Web Scraping
Data Extraction
Selenium Webdriver
Selenium
Automation