Webpage Scraping Tool Via Subscription SEO Tool
Budget: $200 – $600 AUD
Hi,
We use a paid SEO tool to manually do reporting on:
* Website pages that rank for certain keywords
* Websites that report on known competitors (and we put this process into a loop until we extra ALL competitors)
* We process all competitors websites to see all of the backlinks (from unique websites) they have pointing to the competitor websites (and exclude certain websites from this list based on the website name or it being a certain low metric as reported in the tool)
* We use the same tool to then see ALL the websites that link to the competitors are also linking out to (all the other websites they also link to)
* We then do the same process to see where each of those websites are getting links from to build up a target of websites (and pages on those websites) that are linking back to these websites.
* We store all the competitors in a standard Google Sheet
* We store all the backlinks found (that meet our criteria in a standard Google Sheet)
* We store all the backlinks found on the other websites that linked to our competitors and linked out to other external websites in a standard Google Sheet
Once we have found all of our backlink site prospects, we also then put it into a webpage tool (manually at the moment) that checks if those websites are blacklisted or not. We would like to automate that process. We can feed between 500 and 1000 URLs into that tool at a time.
There is one more thing we would like to be able to automate. There is a free browser plugin that can be installed on Chrome or Firefox from a company called Link Research Tools. Its called LRT Power*Trust. We set that plugin to report the scores at the page level. Right now, we manually go to each page and note down the score that will range from 0 to 100. We would like to be able to automate this process as well.
The tool we use is a well known industry SEO tool. There are many of them out their like SEMRush, Serpstats, Ahrefs and many more. It is one of these tools.
The tool would need to allow us to login to our own subscription of one of these tools and basically perform the tasks we currently do manually, and speed it up to to automate the process. While we would prefer to be able to make this process 100% automated, if there is some small amounts of manual intervention required, we can live with that.
Being able to update the Google Sheets with the data available would be very good.
To win this job, you will need to be very experienced with website page scraping. There is no Google scraping involved with this task. It will be using a paid subscription. There is no API available (that is why we are needing to scrape this data).
When you bid for this project, please say "Top SEO Tool Scraper Ready" as the opening remarks. This way we know you have bothered to read the requirements. If you do auto bidding, we will simply reject your bid, so don't bother wasting your time or others.
In your bid, ONLY be specific about previous work you have done for webpage scraping and tools you have made to do this.
We would need to be able to run this scraping tool ongoing to perform the exact same tasks on a regular basis (we are not looking for you to provide data to us - we need an actual tool that can do this job ongoing and can be updated if needed).
If its a client based tool, it needs to be able to run on both Mac and Windows. Ideally, it would be a browser based tool using something like Puppeteer (or similar) to perform the tasks required.
This will be a pretty straight forward and reasonably simple task for someone experienced who knows what they are doing.
We will look forward to getting your bids. Please do not instant message us wanting to discuss the project. Provided your followed our guidelines, we will message you to discuss further. We would be needing to also make ongoing enhancements, so it would be important for us to hire someone who is available for the long term. Don't do placeholder bids. Bid the final amount.
We use a paid SEO tool to manually do reporting on:
* Website pages that rank for certain keywords
* Websites that report on known competitors (and we put this process into a loop until we extra ALL competitors)
* We process all competitors websites to see all of the backlinks (from unique websites) they have pointing to the competitor websites (and exclude certain websites from this list based on the website name or it being a certain low metric as reported in the tool)
* We use the same tool to then see ALL the websites that link to the competitors are also linking out to (all the other websites they also link to)
* We then do the same process to see where each of those websites are getting links from to build up a target of websites (and pages on those websites) that are linking back to these websites.
* We store all the competitors in a standard Google Sheet
* We store all the backlinks found (that meet our criteria in a standard Google Sheet)
* We store all the backlinks found on the other websites that linked to our competitors and linked out to other external websites in a standard Google Sheet
Once we have found all of our backlink site prospects, we also then put it into a webpage tool (manually at the moment) that checks if those websites are blacklisted or not. We would like to automate that process. We can feed between 500 and 1000 URLs into that tool at a time.
There is one more thing we would like to be able to automate. There is a free browser plugin that can be installed on Chrome or Firefox from a company called Link Research Tools. Its called LRT Power*Trust. We set that plugin to report the scores at the page level. Right now, we manually go to each page and note down the score that will range from 0 to 100. We would like to be able to automate this process as well.
The tool we use is a well known industry SEO tool. There are many of them out their like SEMRush, Serpstats, Ahrefs and many more. It is one of these tools.
The tool would need to allow us to login to our own subscription of one of these tools and basically perform the tasks we currently do manually, and speed it up to to automate the process. While we would prefer to be able to make this process 100% automated, if there is some small amounts of manual intervention required, we can live with that.
Being able to update the Google Sheets with the data available would be very good.
To win this job, you will need to be very experienced with website page scraping. There is no Google scraping involved with this task. It will be using a paid subscription. There is no API available (that is why we are needing to scrape this data).
When you bid for this project, please say "Top SEO Tool Scraper Ready" as the opening remarks. This way we know you have bothered to read the requirements. If you do auto bidding, we will simply reject your bid, so don't bother wasting your time or others.
In your bid, ONLY be specific about previous work you have done for webpage scraping and tools you have made to do this.
We would need to be able to run this scraping tool ongoing to perform the exact same tasks on a regular basis (we are not looking for you to provide data to us - we need an actual tool that can do this job ongoing and can be updated if needed).
If its a client based tool, it needs to be able to run on both Mac and Windows. Ideally, it would be a browser based tool using something like Puppeteer (or similar) to perform the tasks required.
This will be a pretty straight forward and reasonably simple task for someone experienced who knows what they are doing.
We will look forward to getting your bids. Please do not instant message us wanting to discuss the project. Provided your followed our guidelines, we will message you to discuss further. We would be needing to also make ongoing enhancements, so it would be important for us to hire someone who is available for the long term. Don't do placeholder bids. Bid the final amount.