Configure the "Wordpress Content crawler" Plugin "Post page filters"
Budget: €8 – €30 EUR
I am looking for a freelancer who can configure the "Wordpress Content crawler" plugin to crawl a specific website for personal use through the use of "filters" of the plugin.
What is requested is to do exactly the same as shown in this video https://www.youtube.com/watch?v=gW83JgbViLc&t=1413s "Retrieving related products from eBay"
But instead of "Retrieving related products from eBay" it would be "Retrieving related videos from Youtube".
If the plugin is creating an article about "Lions" from an specific website, should add an embed video from "https://www.youtube.com/results?search_query=lion" using the "Post page filters"
What the author of the plugin has told me about how to proceed may help:
"The source code of the search results page of YouTube does not seem to contain the HTML code of the results. Instead, it looks like the data is defined as JSON. For example, when I search for the ID of a video from search results in the source code of the page, I see this: https://ibb.co/W2mDCdM So, the data seems to exist in the source code in JSON format. The plugin has commands to convert JSON into HTML, examples of which are available in the same video. So, it seems to be possible to extract that JSON data, convert it to HTML and then include that HTML code into the target page's source code."
AND:
"The JSON data in the page cannot be detected by the plugin, because it is defined as a JavaScript variable. You need to inspect the page, remove the non-JSON things from the script element that contains the JSON data as a JavaScript variable, and then convert that valid JSON to HTML.
In your video, the CSS selector found by the plugin cannot find any elements. That might be because the target page's source code changes between different requests. If that is the case, you need to find the data that does not change between requests, which might be the JSON data existing as a JavaScript variable."
What is requested is to do exactly the same as shown in this video https://www.youtube.com/watch?v=gW83JgbViLc&t=1413s "Retrieving related products from eBay"
But instead of "Retrieving related products from eBay" it would be "Retrieving related videos from Youtube".
If the plugin is creating an article about "Lions" from an specific website, should add an embed video from "https://www.youtube.com/results?search_query=lion" using the "Post page filters"
What the author of the plugin has told me about how to proceed may help:
"The source code of the search results page of YouTube does not seem to contain the HTML code of the results. Instead, it looks like the data is defined as JSON. For example, when I search for the ID of a video from search results in the source code of the page, I see this: https://ibb.co/W2mDCdM So, the data seems to exist in the source code in JSON format. The plugin has commands to convert JSON into HTML, examples of which are available in the same video. So, it seems to be possible to extract that JSON data, convert it to HTML and then include that HTML code into the target page's source code."
AND:
"The JSON data in the page cannot be detected by the plugin, because it is defined as a JavaScript variable. You need to inspect the page, remove the non-JSON things from the script element that contains the JSON data as a JavaScript variable, and then convert that valid JSON to HTML.
In your video, the CSS selector found by the plugin cannot find any elements. That might be because the target page's source code changes between different requests. If that is the case, you need to find the data that does not change between requests, which might be the JSON data existing as a JavaScript variable."