On November 2 we shipped a small change with a long history: every answer from Ask Folio now links to the exact blocks it read. Hover a number and the source line lights up. This post explains why we spent a year on something that looks like a footnote.
An answer is a claim
When a colleague tells you the vacation policy, you weigh it: do they know, did it change, are they guessing? A machine that answers in the same confident tone every time removes that signal. So we decided early that Ask Folio would not ask for trust. It would show its work, and make checking it faster than reading the page.
If you cannot check an answer in under five seconds, you will either ignore it or believe it. Both are bad.
Citations down to the block
The first version cited pages. That was not enough: the Benefits page is 2,000 words long, and knowing the answer is “somewhere in Benefits” does not save time. Citing blocks meant keeping track of which blocks went into each answer, through retrieval, ranking and generation, and throwing an answer away if it made a claim we could not attach to a block.
- Retrieve candidate blocks, filtered by the asker’s permissions first, never after.
- Rank them, preferring verified pages and newer edits.
- Write the answer with each sentence tied to the blocks that support it.
- Drop any sentence that is not tied to a block. If nothing is left, say so.
Permissions come first. A block you cannot open never reaches the model. The answer cannot leak what it never saw.
What the numbers say
| Measure | Pages cited | Blocks cited |
|---|---|---|
| Median time to an answer | 1.4 s | 1.2 s |
| Answers people opened a source for | 11% | 38% |
| Answers marked wrong | 4.1% | 1.6% |
| Answers citing a verified page | 81% | 94% |
The surprise was the second row. When the source is one line away, people check. When they check, they catch the rare wrong answer, mark it, and the owner of the page fixes the page. Citations turned out to be a maintenance tool as much as a trust tool.
The answer we are proudest of
It is this one: I couldn’t find a page you can open that answers this. It is the least impressive answer Folio gives and the most important. It tells you the gap is real, and it tells the workspace owner what to write next. Business workspaces get a weekly list of questions Folio could not answer.
Ask Folio is part of Folio AI, $8 per member per month on any paid plan, and Free workspaces get 20 answers to try. See how it works.