Custom Python Google Crawler & Link Extractor
Budget: ₹1,500 – ₹12,500 INR
I'm in need of a skilled Python developer to create a cost-effective Google search crawler for me. The crawler should:
- Use specified dorks, such as site:*.example.com, to find site links.
- Extract all hyperlinks from the search results, including those with and without query parameters.
The extracted hyperlinks should be stored in a PostgreSQL database. I'm looking for a freelancer who can deliver a robust and efficient solution without relying on third-party services. Experience with web crawling, Python, and PostgreSQL is essential for this project.
- Use specified dorks, such as site:*.example.com, to find site links.
- Extract all hyperlinks from the search results, including those with and without query parameters.
The extracted hyperlinks should be stored in a PostgreSQL database. I'm looking for a freelancer who can deliver a robust and efficient solution without relying on third-party services. Experience with web crawling, Python, and PostgreSQL is essential for this project.