Comprehensive Website Scraping Delivery
Budget: $30 – $250 USD
I will supply the full URL of the target site and need an automated crawl that captures every internal page, pulls out all text and every embedded image, and records the direct URLs discovered along the way. Rather than a flat file hand-off, the collected material should be transferred into another website I specify, maintaining the original page structure so that links, headings, and image references remain intact.
Please handle the job with a reliable stack such as Python, Scrapy or BeautifulSoup for the crawl, and use whatever bridge—REST, direct database import, or CMS API—you find most efficient for moving the scraped data into the destination site.
Deliverables
• A reproducible script or crawler project.
• Full text and image assets migrated to the destination site, preserving hierarchy and links.
• A mapping file (URL → new location) for verification.
Acceptance Criteria
All public pages are reachable from the destination site, text matches source pages, images load correctly, and no broken links appear after migration.
Please handle the job with a reliable stack such as Python, Scrapy or BeautifulSoup for the crawl, and use whatever bridge—REST, direct database import, or CMS API—you find most efficient for moving the scraped data into the destination site.
Deliverables
• A reproducible script or crawler project.
• Full text and image assets migrated to the destination site, preserving hierarchy and links.
• A mapping file (URL → new location) for verification.
Acceptance Criteria
All public pages are reachable from the destination site, text matches source pages, images load correctly, and no broken links appear after migration.
Related categories:
PHP
Python
Web Scraping
Software Architecture
Scrapy
Data Extraction
BeautifulSoup
API Development