Posts tagged "latency"

Reranking more candidates helps only while relevant evidence enters the pool and changes final order. Measure quality, latency, cost, duplicates, and permission-safe failure by query slice.

A handler can finish its visible work and still spend time destroying values. Trace scope exit and give expensive cleanup an explicit owner.