Saiful Khan

Building the future through software

Initializing portfolio0%
Skip to content
All writing

AI · 9 min read

Retrieval systems that earn trust

Teams abandon internal assistants for one reason: the answers cannot be verified. Trust is recovered by making every claim traceable to a source the reader can open.

Apply permission filters before ranking, not after. Filtering afterwards leaks the existence of restricted documents through ranking behaviour.

Gate every prompt and retrieval change on a labelled evaluation set. Without it, each improvement is a guess with a changelog entry.

const evals = await run(suite, { threshold: 0.9 })
if (!evals.passed) throw new Error("release blocked")
  • AI
  • Retrieval
  • Evaluation