Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Http Logging/Tracing #666

Open
lambdakris opened this issue Jan 25, 2025 · 0 comments
Open

Http Logging/Tracing #666

lambdakris opened this issue Jan 25, 2025 · 0 comments
Assignees
Labels
component:python sdk Issue/PR related to Python SDK status:triaged Issue/PR triaged to the corresponding sub-team type:feature request New feature request/enhancement

Comments

@lambdakris
Copy link

Description of the feature request:

I have been working on an issue where HTTP logging/tracing for the LLM call would have been useful, but have been unable to find a way to capture/intercept http requests and responses. I tried using tools like LangSmith and Phoenix, however, since the generative-ai-python sdk itself doesn't seem to be instrumented, it didn't do much good. It looks like the sdk uses requests under the hood, and I was able to set the log level to DEBUG which helped a little bit, but I was not able to change what get's captured (such as headers, etc). Even a solution like being able to access the underlying http client and add hooks or something would suffice, but I was not able to find any documentation whatsoever on how to gain access to the underlying http client so no luck. I tried asking Gemini for help but it could not produce anything that worked, probably cause there just ain't no documentation around it.

What problem are you trying to solve with this feature?

I'm trying to troubleshoot http request issues

Any other information you'd like to share?

No response

@gmKeshari gmKeshari added type:feature request New feature request/enhancement status:triaged Issue/PR triaged to the corresponding sub-team component:python sdk Issue/PR related to Python SDK labels Jan 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component:python sdk Issue/PR related to Python SDK status:triaged Issue/PR triaged to the corresponding sub-team type:feature request New feature request/enhancement
Projects
None yet
Development

No branches or pull requests

3 participants