Build an internal SaaS service with cost and usage tracking for foundation models on Amazon Bedrock
AWS Machine Learning Blog
FEBRUARY 9, 2024
To track consumption and cost per team, the solution logs data for each individual invocation, including the model invoked, number of tokens for text generation models, and image dimensions for multi-modal models. inputTokens – The number of tokens sent to the model as part of the prompt (for text generation and embeddings models).
Let's personalize your content