arxivcs.AIcs.CLcs.LG2026-07-19
Otap:Structure-Aware Optimal Transport for Evaluating Planning and Execution in Agent Trajectories
Babak Barazandeh, Subhabrata Majumdar, George Michailidis
Large language model agents solve tasks by generating trajectories that interleave planning, tool calls, and intermediate results. Current evaluation metrics reduce such a trajectory to a binary success flag or compare it against a reference by exact matching. A success flag cann…