[ESC]:
Q2: correct answer is N/A - business step-in before bot can answer
[ESC]:
Q3 - Q29: Right answers should all be N/A due to unclear user intent.
[ESC]:
Q3 - Q29: Answers should all be N/A due to OOS conversation.
Q37: Correct answer is yes - bot handoff due to OOS conversation.
[ESC]:
Aligned.
[ESC]:
Q20: Correct answer is no - “Products missing from catalog are not considered missing data on this question”
Qxx: Right answer is XXX. Auto eval made a mistake by …
Qyy: Right answer is YYY. Auto eval made a mistake by …
MISSING AE EVAL ///////
[ESC]:
Q2: correct answer is yes.
Q3: Correct answer is yes.
Q5: Correct answer was no - handoff was needed.
Q16 - Q29: Correct answer is no.