Domain Scanner & Extractor Script
Budget: $30 – $250 USD
I need a single, fully-automated script that does three things from start to finish:
1. Systematically scan the entire public zone so every domain—new, expiring, or otherwise—can be discovered and recorded in a clean, deduplicated list.
2. For each domain found, connect to the host (FTP/SFTP, HTTP, or any other dependable method you propose) and pull down every PHP file you can reach.
3. From those PHP files, extract the raw TXT content I specify and store it neatly in local folders that mirror the domain structure.
A concise log of successes, failures, and any unreachable hosts must accompany each run so I can track coverage. The finished deliverable should be a runnable script with basic setup notes (dependencies, config file, and one-line run command) plus a quick README explaining the core logic.
If you have an existing approach or toolset that speeds up the discovery phase, describe it briefly; otherwise, feel free to build from scratch in Python, Go, or another language you are confident will stay maintainable.
1. Systematically scan the entire public zone so every domain—new, expiring, or otherwise—can be discovered and recorded in a clean, deduplicated list.
2. For each domain found, connect to the host (FTP/SFTP, HTTP, or any other dependable method you propose) and pull down every PHP file you can reach.
3. From those PHP files, extract the raw TXT content I specify and store it neatly in local folders that mirror the domain structure.
A concise log of successes, failures, and any unreachable hosts must accompany each run so I can track coverage. The finished deliverable should be a runnable script with basic setup notes (dependencies, config file, and one-line run command) plus a quick README explaining the core logic.
If you have an existing approach or toolset that speeds up the discovery phase, describe it briefly; otherwise, feel free to build from scratch in Python, Go, or another language you are confident will stay maintainable.
Related categories:
PHP
Perl
JavaScript
Web Scraping
Software Architecture
MySQL
Scripting
Data Extraction
Automation
Certified Ethical Hacking