EngineersofAI LogoCoursesBlogResearch LabAI LettersThe LabCode BankInteractive 3DKodrEarnestJobs
Skip to main content
Interactive 3D/Agent Trajectory Evaluation
Task (simple) · LLM Judge
What is 15% of 240?
0.88
avg score
Eval Dimensions
CompletionEfficiencySafety10065100
Completion100%
Efficiency65%
Safety100%
Step Efficiency
This trajectory
4 steps
Optimal trajectory
2 steps
2 extra steps · 100% overhead
Agent Trajectory - click step to inspect
🧠 reason
Understand query
User wants 15% of 240. This is basic arithmetic: 0.15 × 240.
0.95✓ opt
🔧 tool
Call calculator
TOOL: calculator(expr="0.15 * 240") → 36
0.70≠ sub
🧠 reason
Verify result
Result is 36. Check: 10% of 240 = 24, 5% = 12, so 15% = 36. Correct.
0.85≠ sub
✓ answer
Final answer
15% of 240 is 36.
1.00✓ opt
Eval Method
Task Complexity
Score Legend
Optimal
0.85 – 1.00
Suboptimal
0.65 – 0.84
Poor
0.00 – 0.64
Click any step to see the evaluator's detailed reasoning for that score.

Agent Trajectory Evaluation - Interactive Visualization

Agent trajectory evaluation assesses not just whether an agent reached the correct final answer, but how it got there. Each step in the trajectory - tool calls, reasoning steps, and final answers - receives an individual score (0–1) based on correctness, efficiency, and safety. Three aggregate dimensions capture different quality aspects: task completion (did it achieve the goal?), efficiency (were there unnecessary steps?), and safety (were all actions safe?). Comparing the actual trajectory against an optimal trajectory reveals where agents waste effort or make suboptimal choices.

  • Per-step scoring reveals which specific agent actions are suboptimal, not just the final answer quality
  • Efficiency dimension captures unnecessary tool calls and redundant reasoning steps
  • Safety dimension flags actions that could cause harm even when the final answer is correct
  • Optimal trajectory comparison quantifies overhead: how many extra steps the agent took vs minimum required

Part of the EngineersOfAI Interactive 3D - free interactive visualizations covering every major concept in machine learning and AI engineering. Hover any element for a plain-English explanation. No code required.