Voicemail Transcription System with AI Integration
Budget: €250 – €750 EUR
This system is an automated voicemail processing and transcription platform designed to manage, transcribe, and prioritize voicemail messages from an IMAP mailbox. It integrates Google Voice-to-Text and ChatGPT to summarize voicemail content and categorize it for users based on predefined mailbox IDs.
Key Features:
User Management:
Admin can add, list, and delete users.
Users have mailbox IDs linked to their accounts.
Voicemail Processing:
Retrieves voicemail files (WAV format) from an IMAP mailbox every minute.
Extracts a 12-digit identifier from the email subject to assign messages to users.
Moves processed emails to _DONE or _FAIL folders based on user matching.
Transcription & Summarization:
Converts voicemail audio to text using Google Voice-to-Text API.
Uses ChatGPT to generate a concise summary of the message.
Stores the summarized voicemail in the user’s phone call list with timestamp, caller number, and priority.
Prioritization:
If certain important keywords (configurable in backend) appear in the voicemail, the priority is set to high.
User Interface:
Users can view, search, sort, and mark calls as done.
Admin can configure API keys and manage important words for prioritization.
Use Case:
This system is ideal for businesses handling voicemail-based orders, inquiries, or service requests, ensuring efficient processing, transcription, and tracking of incoming messages.
1. Backend
1.1 Admin Panel
User management functionalities:
Add and list users.
Assign multiple Mailbox IDs (12-digit format).
Delete users if necessary.
1.2 User Management
Add new users with the following details:
First Name, Last Name, Company, Email, Password.
Multiple Mailbox IDs (12-digit format).
Delete users if required.
User authentication: Users can log in securely.
1.3 User Dashboard
Phone Call List:
Display phone calls.
Sorting options: Priority, Date/Time, and Phone Number.
Integrated search functionality.
Calls can be marked as "Done".
1.4 System Settings
Configure API keys:
Google Voice-to-Text API Key.
ChatGPT API Key.
Manage Important Words:
Add or remove priority keywords that influence call urgency.
2. System Functionality
2.1 Voicemail Processing
IMAP Mailbox Integration:
Retrieve voicemail attachments in WAV format via IMAP.
Automatic synchronization every minute using a cron job.
Email Processing:
Extract 12-digit number from the email subject.
Identify the caller’s phone number from the email metadata.
Mailbox Assignment Logic:
If the 12-digit number matches a registered user’s Mailbox ID:
Move the email from INBOX to _DONE.
If no match is found:
Move the email to _FAIL.
2.2 Transcription & AI Processing
Convert WAV audio files to text using Google Voice-to-Text API.
Send the transcribed text to ChatGPT API with the following command:
“Verkürze diese Medikamentenbestellung aus einem Telefonat kurz und fasse zusammen: $text_from_voice”
Store the ChatGPT-generated summary in the user’s Phone Call List, with:
Date/Time.
Caller’s Phone Number.
Message Summary.
Priority Status.
2.3 Priority Management
If the transcribed text contains keywords from the Important Words list, the system automatically assigns high priority to the call.
Key Features:
User Management:
Admin can add, list, and delete users.
Users have mailbox IDs linked to their accounts.
Voicemail Processing:
Retrieves voicemail files (WAV format) from an IMAP mailbox every minute.
Extracts a 12-digit identifier from the email subject to assign messages to users.
Moves processed emails to _DONE or _FAIL folders based on user matching.
Transcription & Summarization:
Converts voicemail audio to text using Google Voice-to-Text API.
Uses ChatGPT to generate a concise summary of the message.
Stores the summarized voicemail in the user’s phone call list with timestamp, caller number, and priority.
Prioritization:
If certain important keywords (configurable in backend) appear in the voicemail, the priority is set to high.
User Interface:
Users can view, search, sort, and mark calls as done.
Admin can configure API keys and manage important words for prioritization.
Use Case:
This system is ideal for businesses handling voicemail-based orders, inquiries, or service requests, ensuring efficient processing, transcription, and tracking of incoming messages.
1. Backend
1.1 Admin Panel
User management functionalities:
Add and list users.
Assign multiple Mailbox IDs (12-digit format).
Delete users if necessary.
1.2 User Management
Add new users with the following details:
First Name, Last Name, Company, Email, Password.
Multiple Mailbox IDs (12-digit format).
Delete users if required.
User authentication: Users can log in securely.
1.3 User Dashboard
Phone Call List:
Display phone calls.
Sorting options: Priority, Date/Time, and Phone Number.
Integrated search functionality.
Calls can be marked as "Done".
1.4 System Settings
Configure API keys:
Google Voice-to-Text API Key.
ChatGPT API Key.
Manage Important Words:
Add or remove priority keywords that influence call urgency.
2. System Functionality
2.1 Voicemail Processing
IMAP Mailbox Integration:
Retrieve voicemail attachments in WAV format via IMAP.
Automatic synchronization every minute using a cron job.
Email Processing:
Extract 12-digit number from the email subject.
Identify the caller’s phone number from the email metadata.
Mailbox Assignment Logic:
If the 12-digit number matches a registered user’s Mailbox ID:
Move the email from INBOX to _DONE.
If no match is found:
Move the email to _FAIL.
2.2 Transcription & AI Processing
Convert WAV audio files to text using Google Voice-to-Text API.
Send the transcribed text to ChatGPT API with the following command:
“Verkürze diese Medikamentenbestellung aus einem Telefonat kurz und fasse zusammen: $text_from_voice”
Store the ChatGPT-generated summary in the user’s Phone Call List, with:
Date/Time.
Caller’s Phone Number.
Message Summary.
Priority Status.
2.3 Priority Management
If the transcribed text contains keywords from the Important Words list, the system automatically assigns high priority to the call.