Advanced PHP Web Spider with AI
Budget: $250 – $750 USD
I'm looking for a skilled PHP developer to create a command line based web spider with AI capabilities.
Required technologies: PHP, curl, mySQL, ChatGPT (we will provide the account), rotating proxies (if needed to access the spider targets)
We need a command line spider in PHP with the following specification:
The spider should work through the command line. We will need a web interface for it later.
The following steps should be activated in separate functions and should be available to be started separately through the command line.
For example:
spider.php -getTrends -language=de
spider.php -getBooksonTrends -language=de
The spider should work in different languages. For example (our main target) = German (de).
Functions:
1. Get trends
Use ChatGPG API (connected to Bing) to get the current trends in books and news in the selected language with a suitable prompt.
Save these trends in the database.
For example:
love novels
Russia/Ukraine war documentaries
Trump biographies
2. Get books on trends
Spider Amazon to get complete book information (title, author, description, price, URL to cover picture) in the selected language on:
trends selected in no. 1
trending topics according to the Amazon book bestseller lists/charts (in different categories) - get the 25 most trending books in all categories
Save all book information in the database:
title
author
rank in charts (“#8 in charts”) in all categories
editions (Kindle? hardcover? audiobook? etc)
price options for different editions (with currency)
description
total review score
number of reviews in different scores (for example: 25 x 5 stars, 12 x 4 stars, 3 x 3 stars,...)
length
languages
publisher
publication date
“frequently bought together” recommendations
ISBN-10 (= unique)
ISBN-13 (= unique)
About the author information
This is the first part of a more complex task.
If this is completed successfully, there will be more parts/extensions.
Required technologies: PHP, curl, mySQL, ChatGPT (we will provide the account), rotating proxies (if needed to access the spider targets)
We need a command line spider in PHP with the following specification:
The spider should work through the command line. We will need a web interface for it later.
The following steps should be activated in separate functions and should be available to be started separately through the command line.
For example:
spider.php -getTrends -language=de
spider.php -getBooksonTrends -language=de
The spider should work in different languages. For example (our main target) = German (de).
Functions:
1. Get trends
Use ChatGPG API (connected to Bing) to get the current trends in books and news in the selected language with a suitable prompt.
Save these trends in the database.
For example:
love novels
Russia/Ukraine war documentaries
Trump biographies
2. Get books on trends
Spider Amazon to get complete book information (title, author, description, price, URL to cover picture) in the selected language on:
trends selected in no. 1
trending topics according to the Amazon book bestseller lists/charts (in different categories) - get the 25 most trending books in all categories
Save all book information in the database:
title
author
rank in charts (“#8 in charts”) in all categories
editions (Kindle? hardcover? audiobook? etc)
price options for different editions (with currency)
description
total review score
number of reviews in different scores (for example: 25 x 5 stars, 12 x 4 stars, 3 x 3 stars,...)
length
languages
publisher
publication date
“frequently bought together” recommendations
ISBN-10 (= unique)
ISBN-13 (= unique)
About the author information
This is the first part of a more complex task.
If this is completed successfully, there will be more parts/extensions.