Check recall quality
Run realistic queries and inspect why memories appear or stay hidden.
Check recall with real prompts, not keyword tests only.
Quality check
Use prompts like:
Plaintext
Then inspect:
| Question | Good sign |
|---|---|
| Did the right memory appear? | relevant project or preference node is listed |
| Did the agent open it? | usage tracking shows the node was read |
| Did the memory help the answer? | the response uses actual node content, not just the title |
| Was there noise? | weak candidates are few and easy to ignore |
If recall misses the memory, improve the memory before changing thresholds. Add glossary terms, rewrite disclosure, split broad notes, or move the memory to a clearer path.