Why did I fail the certification when I said the right thing?
The AI reviewer grades each question alone. It compares the transcript of the answer that you recorded for that question with what the question asks. The certification passes only when the number of passed questions is equal to or more than the Pass Criteria.
Read the reason for each question in your result.
You did not pass enough questions
Section titled “You did not pass enough questions”When AI generates a certification, Arcade sets the Pass Criteria to the number of questions. Then you must pass every question. When Refine with AI replaces the questions, Arcade sets the Pass Criteria to the new number of questions again.
A manager can decrease the Pass Criteria in the settings of the certification. The minimum is 1. A manager can also decrease the Cooldown Period, so that learners can try again earlier. Refer to Set the pass criteria and the cooldown period.
The answer did not cover enough of the question
Section titled “The answer did not cover enough of the question”The question and its More text tell the AI what the answer must cover. By default, an answer passes when all these conditions are true:
- It answers the main point of the question.
- It covers about 60% of the key ideas that the question asks for.
- It states no essential fact incorrectly.
An answer without a small detail, for example a date or an exact term, can pass, unless the question asks for that detail. If the question asks for “at least” a number of examples, give that number. The AI grades each answer from its own recording. Say each point in the answer to the question that asks for it.
Read the reason of each failed question before you try again. If a question has a More button, read its text when you record. The AI grades the answer against this text too.
If an answer is short or not complete, select Redo before you select Save. After you select Save, you cannot record that answer again in this attempt. The Short answer — re-record tag on the Your recordings screen is only a warning.
Each question can also have AI Card Pass Criteria, which learners do not see. The AI uses this text to check the facts. It is not a list of facts that the answer must state. If the AI fails correct answers, make sure that this text agrees with the content. Refer to Edit an interaction.
The transcript does not have what you said
Section titled “The transcript does not have what you said”The AI reads only the written transcript of your recording. It does not watch the video. If the transcript does not have a word that you said, the AI cannot count it.
If Arcade got no speech from the whole attempt, the result shows No Spoken Words Detected in place of the questions. Your pathway shows TRY AGAIN. You can start again immediately, because the cooldown period does not apply to this attempt.
Test your microphone before you start. A manager can compare the video and the Transcript of each answer in the recording.
The AI reviewer made a mistake
Section titled “The AI reviewer made a mistake”A manager can correct the result of a question: select Override, then set Result to Pass. A change to one question or to Overall result does not approve the session. To give the learner the certification, approve the session.