Review and approve AI output (HITL)

AI-generated courses require admin review and approval before learners see them. This is called HITL (Human-in-the-Loop).

What you can do on /review

1. Edit per module

• Rewrite the body
• Edit slide titles and content
• Modify quiz questions, options, and correct answers
• Delete modules
• Reorder modules

2. Regenerate individual modules

Not happy with a module? Regenerate just that one with different instructions.

3. Review the AI Confidence Report

Available on the "AI Confidence Report" tab on /review.

Reading the AI Confidence Report

Fidelity score

Measures alignment with the source material (0–100%).

• 90%+ — Safe to publish
• 70–89% — Spot-check flagged sections before publish
• <70% — Consider regenerating

Check categories

1. Factual consistency — Contradictions with source?
2. Topic coverage — Missing important points?
3. Hallucination detection — Information not in source?

Each category shows "OK", "Needs review", or "Warning".

Publishing

1. Review all modules
2. Check the AI Confidence Report
3. Click Publish
4. Enter learner emails
5. Click Send Invitations — emails are sent automatically

Editing after publish

You can still edit published courses. But:

• Active learners see the new version on their next access
• Changing quiz answers does NOT recalculate existing grades
• For major changes, consider notifying learners separately

Unpublishing

Click Unpublish to take the course offline. Existing learner history is preserved. Learners are optionally emailed to inform them the course is paused.

Best practices

• Always do a learner-perspective walkthrough before publishing (Course Preview)
• Regenerate modules where AI Confidence falls below 85%
• Pay special attention to jargon and proper nouns
• Ensure quiz difficulty matches your audience

Next steps

• Invite learners
• View analytics