Looking for Python coder for web scarping and crawler to capture the prices / rates / details.
Budget: $30 – $250 USD
1. We need to right simple and effective python programming which runs as cloud function (GCP function) (mean just a individual program on AWS cloud, this function will be invoked by the AWS API gateway. In other words, we will have REST API which will take JSON object as a input and call the Python function by sending the JSON object as a input.)
2. JSON object will have name, URL, direct page url, class id, DIV tag ID..etc (which we need crawler the page and retrieve the values defined in the page). a. Sometimes we will have array URL’s and tags for the same URL with different links. We need to crawler few pages and capture the values for each page in JSON object.
3. Once we have the final JSON object, we need to call another REST API by sending final JSON object as a PUT request.
4. It should call the recurring website pages in a loop
5. This is a long term project
2. JSON object will have name, URL, direct page url, class id, DIV tag ID..etc (which we need crawler the page and retrieve the values defined in the page). a. Sometimes we will have array URL’s and tags for the same URL with different links. We need to crawler few pages and capture the values for each page in JSON object.
3. Once we have the final JSON object, we need to call another REST API by sending final JSON object as a PUT request.
4. It should call the recurring website pages in a loop
5. This is a long term project