PDF Crawler Development

I want to develop a PDF crawler that, when given a website domain, will scan the entire domain and extract all PDF URLs. These URLs should then be saved into a database. The crawler should continue recursively until it has finished scanning all accessible URLs under the domain.

If you're able to achieve this core functionality, we can then move on to discussing the database structure and implementation details.