Real-time English & Chinese STT->AI->TTS chatbots with a factual knowledge base.

Job ID: 37302668

Budget: $1,500 – $3,000 USD

Goal: Implement a real-time English and Chinese chatbots with a factual knowledge base for English and Czech language. speech-to-text -> AI -> text-to-speech.

Example:
1. English/Czech words to the microphone of PC using Chrome (sent to the Linux server)
2. An API service for STT (user-selectable from: Microsoft, Google, OpenAI, Tencent, Baidu) on Linux server
3. AI chatbot answer generation (AI with a factual knowledge base. user-Selectable from: Microsoft, Google, OpenAI, Tencent, Baidu)
4. An API service for TTS (user-selectable from: Microsoft, Google, OpenAI, Tencent, Baidu) on Linux server
5. Receiving audio data and playing audio data in Chrome on PC speakers

In other words:

Goal: Implement a real-time English and Chinese chatbots (user-Selectable from Microsoft, Google, OpenAI, Tencent, Baidu) with a factual knowledge base. For English and Czech languages. The user interface will use speech-to-text (STT) to input text to the chatbot, which will then use AI to generate a response, and finally use text-to-speech (TTS) to output the response to the user.

Example:


1. The user speaks English or Czech words into the microphone of their computer using Chrome. The audio is sent to the Linux server.
2. The STT API (user-selectable from Microsoft, Google, OpenAI, Tencent, or Baidu) on the Linux server converts the audio to text.
3. The AI chatbot (user-selectable from Microsoft, Google, OpenAI, Tencent, or Baidu) generates a response to the text input.
4. The TTS API (user-selectable from Microsoft, Google, OpenAI, Tencent, or Baidu) on the Linux server converts the text response to audio.
5. The audio is sent back to the user's computer and played through their speakers.


In other words:

• For voice input, use a speech-to-text (STT) service from American or Chinese companies (listed above) for English and Czech languages.

• Choose a suitable American and Chinese chatbots or AI APIs that support real-time questions and answers with voice input and synthetic voice output (from companies listed above).

• The intended languages to use are English and Czech.

• The proposed chatbots/AIs are Google Bard, OpenAI, Microsoft Azure, Baidu Ernie, and Tencent AI Chatbot.

• Implement the selected APIs in PHP according to the language model documentation.

• For synthetic voice output, use a text-to-speech (TTS) service.

• Synthetic voice creation and AI responses should be selectable and independent on platforms. For example, you should be able to use an American TTS voice for content generated by a Chinese AI.

• Create a Chrome extension that is connected to the PHP script and the TTS service. The extension should allow the user to speak to the chatbot or AI API and receive responses in synthetic voice.

• Deploy the PHP script and the Chrome extension to the Linux server.



Time-Line: 14 days.

I will require a live-demo of already working similar project before accepting a bid.
Related categories: PHP Google Chrome Web Hosting Plugin API Integration