Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Expose tokens / prompt / http response etc through the Collector interface #1512

Open
wants to merge 32 commits into
base: canary
Choose a base branch
from
Open

Expose tokens / prompt / http response etc through the Collector interface #1512

wants to merge 32 commits into from

Conversation

aaronvg
Copy link
Contributor

@aaronvg aaronvg commented Feb 24, 2025 •
edited
Loading

Implement the LogCollector

  • python (missing some more tests with retries / fallbacks / llm http failures / and parsing failures, as well as bedrock support for getting raw http request/response)
  • typescript
  • ruby

Other bugfixes

  • Fix memory leak for Python streams
  • dont add deserializer conditions on final response of a stream due to high memory usage

aaronvg and others added 29 commits February 10, 2025 15:14
@aaronvg
merge tracingv2 branch
b4af094
@aaronvg
Building again
d263cac
@aaronvg
sandbox dep fix
fcd9636
@sxlijin
LogEvent->TraceEvent, LogEventContent->TraceData
96d620e
@sxlijin
re-generate test data
89e0e92
@aaronvg
Some more setup
3a1d4da
@aaronvg
redo tracer and publisher using once_cell
36d94d9
@aaronvg
Merge branch 'canary' into tracingv3
323e70b
@aaronvg
working in wasm
42b7ff3
@aaronvg
function start
c1d4bc1
@aaronvg
Better handling of streaming errors, and add tracing to http requests…
b2c053e 
…, responses, as well as log our standardized llm response
@aaronvg
WIP collector
654abab
@aaronvg
wip
5039b27
@aaronvg
wire up more of python ffi
480a05c
@aaronvg
WIP ref counts
3666a8c
@aaronvg
refcountv2
7662960
@aaronvg
support multiple collectors, fix some more bugs
860d5cd
@aaronvg
Add more models, and return vec of calls
aca0f60
@aaronvg
more tests
5a61072
@aaronvg
add request id wip
7bcad27
@aaronvg
merge canary up to new response types
92bb81a
@aaronvg
Pass httprequestid through the orchestrator calls
7ca592f
@aaronvg
wasm tweaks
90f1b16
@aaronvg
Python checkpoint -- missing more tests
26bf6ce
@aaronvg
cleanup couple logs
a33b1f3
@aaronvg
fix issue with http bodies being strings always
43fb11d
@aaronvg
Fix memory leak in python due to circular reference, and add more eve…
393c68b 
…nts for streaming
@aaronvg
add more tests, and fix bug with parallel contexts getting the wrong …
16b5632 
…span id
@aaronvg
preserve insertion order of function_logs
bdea400
@vercel Vercel
Copy link

vercel bot commented Feb 24, 2025 •
edited
Loading

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
baml ❌ Failed (Inspect) Feb 24, 2025 6:40pm

@ellipsis-dev ellipsis.dev
Copy link
Contributor

ellipsis-dev bot commented Feb 24, 2025

⚠️ This PR is too big for Ellipsis, but support for larger PRs is coming soon. If you want us to prioritize this feature, let us know at [email protected]

Generated with ❤️ by ellipsis.dev

@aaronvg aaronvg changed the title tracingv3.1 Expose tokens / prompt / raw response etc through the Collector interface Feb 24, 2025
@aaronvg aaronvg changed the title Expose tokens / prompt / raw response etc through the Collector interface Expose tokens / prompt / http response etc through the Collector interface Feb 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@aaronvg @sxlijin