- Published on
Article · Measurement
Rules, Search, a Small Model, a Big Model, an Agent: One Task, Measured
I sent the same 200 bank support messages through keyword rules, search, three Claude models and an agent, and measured accuracy, cost per correct answer and time. The cheapest good result came from a small model that was shown similar labeled examples.