Puppeteer+NodeJS bug fix for forum automation
Budget: $30 – $250 USD
Problem: I'm trying to automate some forum posting on https://www.webhostingtalk.com/. This is a standard forum.
I'm using NodeJS+Puppeteer+Puppeteer Stealth Plugin on an Ubuntu 20.04 Linux Box
The script will run on a VPS.
In order to simulate the IP of the VPS I use a local Linux machine and use OpenVPN to change my IP to that box for testing.
I'm testing with headless turned off.
When puppeteer goes to the site it's just a blank page with a random advert from the forum.
My conclusion is that the forum itself recognizes that it's Puppeteer+Datacenter Ip Address and hides the website content as a security measure.
Scenarios:
Manual+Not OpenVPN(Residential IP) -> Forums Works
Manual+OpenVPN(Datacenter IP) -> Forums Works
Puppeteer+Not OpenVPN(Residential IP) -> Forums Works
Puppeteer+OpenVPN(Datacenter IP) -> Forum shows blank page
So the forum only stops working properly (showing a blank screen) if I use puppeteer and use the IP address of the VPS server (via OpenVPN) at the same time.
This behavior only seems to happen on this forum specifically.
If you have experience please bid on this project!
I'm using NodeJS+Puppeteer+Puppeteer Stealth Plugin on an Ubuntu 20.04 Linux Box
The script will run on a VPS.
In order to simulate the IP of the VPS I use a local Linux machine and use OpenVPN to change my IP to that box for testing.
I'm testing with headless turned off.
When puppeteer goes to the site it's just a blank page with a random advert from the forum.
My conclusion is that the forum itself recognizes that it's Puppeteer+Datacenter Ip Address and hides the website content as a security measure.
Scenarios:
Manual+Not OpenVPN(Residential IP) -> Forums Works
Manual+OpenVPN(Datacenter IP) -> Forums Works
Puppeteer+Not OpenVPN(Residential IP) -> Forums Works
Puppeteer+OpenVPN(Datacenter IP) -> Forum shows blank page
So the forum only stops working properly (showing a blank screen) if I use puppeteer and use the IP address of the VPS server (via OpenVPN) at the same time.
This behavior only seems to happen on this forum specifically.
If you have experience please bid on this project!