Assessment Criteria

The Assessment Criteria tab is where you define the criteria by which the transcript of the conversation will be analyzed to provide feedback to the trainee immediately after the conversation is ended. The primary benefit of the assessment is that it pops up right after the simulation is finished, reminding them of how the conversation went and giving suggestions for how to proceed on a follow-up attempt of the simulation.

It is still a good idea for an expert or instructor to review the conversation recording later to provide more in depth analysis and advice that the AI doesn't have the personal experience to recognize.

For users creating simulations through the Guided Setup we have included a template rubric. You can delete our criteria using the red " - " button at the right side of each criteria slot.

To add a new criteria slot, scroll to the bottom of the criteria list, and below the last criteria you will find a "New Criteria" with an empty description box.

You can reorder the assessment criteria using the arrows to the left of each criteria.

At the top of the page there is an "AI Evaluation Complexity Meter". This is the limitation on how many criteria you can add to your assessment. Two things add to this complexity meter: the number of criteria you have listed, and the amount of options the AI can choose from within each criteria.

Right below the "AI Evaluation Complexity Meter" there is a dropdown labeled "Default Scale for New Criteria". You can use this dropdown to change the default options provided when adding a new Assessment Criteria to the list.