Vercel AI SDK - Counting Tokens in NextJS App? (Amazon Bedrock - Claude 3.5 Sonnet)

[cbaird-1337]

Summary

Hi all, I'm not sure if this is the best place to ask this, but I'm working on building an LLM chat feature into my app and struggling to find something similar to OpenAI's Tokenizer for counting tokens. My general idea here is pretty straightforward, wanting to track total token consumption (input + output) per user, in as close to real-time as possible.

Thanks in advance!

Example

No response

Steps to Reproduce

N/A

[pawlean]

Hi @cbaird-1337!

It might be worth asking in the AI Discussions.

[cbaird-1337]

I will do that, thanks!

[github-actions[bot]]

This discussion was automatically locked because the community moved to a new site. Please join us at vercel.community