Bedrock LLM Token Tracking
Budget: $30 – $250 CAD
I would like to track the usage of tokens and their cost at user level . In our office We have aws bedrock llms , specifically we have got access to anthropic claude through aws bedrock . There are multiple ways people at office are accessing these llms . some through CLI, some using APi and some through agents .
I need a straightforward way to count the token usage and cost at user level , application level and agent level. The objective is to track and restrict the users at our office . The metrics can then be pushed to datadog for observability.
I need a straightforward way to count the token usage and cost at user level , application level and agent level. The objective is to track and restrict the users at our office . The metrics can then be pushed to datadog for observability.
Related categories:
Python
Artificial Intelligence
AI (Artificial Intelligence) HW/SW
AI Agents
Agentic AI