AI Content Pipeline

Curate generation, review, similarity control, and critic feedback.

Operate the human-in-the-loop exam pipeline from generation draft through publication.

primary-eu eu-west-2
Total Questions 12,450

+12% in 30 days

Pending Review 842

Alert threshold crossed

Ready to Publish 5,210

Stable approval queue

Review queue

Question Subject Similarity Review Diff summary
Civil service reasoning item 12A Verbal logic 0.71 cosine Needs human pass Rubric tightened; distractor B replaced
Pharmacy licensing scenario 8F Clinical judgement 0.42 cosine Approved Minor phrasing only
Teacher certification essay prompt 4C Essay scoring 0.88 cosine Rejected Too close to prior bank item

Critic loop

  • Teacher edits captured as structured JSON diff.
  • Prompt scaffold feedback batch runs nightly.
  • Critic model confidence preview is enabled in QA only.

Queue health

  • Draft generation queue: 18 messages
  • Embedding and similarity queue: 3 messages
  • Manual review queue: 842 items