-
-
Notifications
You must be signed in to change notification settings - Fork 322
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
enable prompt caching #2702
enable prompt caching #2702
Conversation
Reviewer's Guide by SourceryThis PR enables prompt caching for AI services by updating the system message structure and adding prompt caching headers for Anthropic. It also includes updates to LangChain-related dependencies. No diagrams generated as the changes look simple and do not need a visual representation. File-Level Changes
Tips and commandsInteracting with Sourcery
Customizing Your ExperienceAccess your dashboard to:
Getting Help
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hey @imolorhe - I've reviewed your changes - here's some feedback:
Overall Comments:
- Please fill out the PR description with details about the prompt caching changes being implemented and check the relevant checkboxes in the PR template.
Here's what I looked at during the review
- 🟢 General issues: all looks good
- 🟢 Security: all looks good
- 🟢 Testing: all looks good
- 🟢 Complexity: all looks good
- 🟢 Documentation: all looks good
Help me be more useful! Please click 👍 or 👎 on each comment and I'll use the feedback to improve your reviews.
Visit the preview URL for this PR (updated for commit 1dc2296): https://altair-gql--pr2702-imolorhe-enable-prom-lxu2r5jl.web.app (expires Sat, 16 Nov 2024 03:10:42 GMT) 🔥 via Firebase Hosting GitHub Action 🌎 Sign: 02d6323d75a99e532a38922862e269d63351a6cf |
Fixes
Checks
yarn test-build
Changes proposed in this pull request:
Summary by Sourcery
Enable prompt caching in the AI service by adding cache control to system messages and update relevant dependencies to their latest versions.
New Features:
Enhancements: