DocPilot
In progressAnswers questions from a company's own documents, always quoting its source.
Drop in your documentation and get a question-answering service that quotes its sources, plus a measurement of how faithful it stays to them.
The problem
A document search that "works in the demo" is one whose misses nobody measured. A credible answer with no source is the worst possible deliverable: wrong and convincing. Every claim has to point back to the passage it came from.
How it is built
- 01
One document library per customer, sealed off from the others.
- 02
Document splitting and indexing, versioned like code.
- 03
Two searches run side by side, by keyword and by meaning, then merged.
- 04
A second pass that re-ranks the best passages before the answer is written.
- 05
Answers with citations, automatically scored on how faithful they stay to the sources.
- 06
A numbers-backed comparison of several approaches on the same set of questions.
- 07
LangChain measured against a hand-written path on the same questions: 20 answers identical byte for byte, so the hand-written path stays the default.
What it proves
Document search measured at every stage, not just in the demo.
Build log
The full write-up will land here: what was tried, what failed, the numbers obtained, and what I would do differently. It goes up once the measurements exist, not before.
AgentDesk