You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Ah yes the handoff back to langsmith from langchain code still is manual, and the evaluation runner currently is instrumented using langchain code - I have a ticket to fix this. Does the following work for now?
I'm running into a similar issue when running the official Evaluation Quick Start example. I can see the llm child_run in the json, but its not visualised. Is this the same bug or different?
Issue you'd like to raise.
We're running evaluations on a pipeline that we've already instrumented with
@traceable
, when those evaluations run the trace shows up fine in the normal project view:https://smith.langchain.com/public/1480ce7d-103e-426c-b416-cef4b9c670ac/r
However, in the evaluation run's trace it's empty:
https://smith.langchain.com/public/37a27aba-ea90-4184-9686-01e302b4de6f/r
Suggestion:
Have the fully instrumented pipeline we have show up in the evaluation run so it's easier to review + show token count
The text was updated successfully, but these errors were encountered: