Mehdi Akiki

Posts tagged "prompt-caching"

  • Published on
    I turned measured token counts from a real classification test into a monthly cost range at 10,000 and 100,000 messages. The model bill went from cents to a few hundred dollars. Under my stated assumptions, the human time for wrong answers was far bigger.
  • Published on
    A router sends each task to a cheap model first and escalates when a check fails. I computed one from real runs on 40 Rust fixes and compared it with one strong model at low effort. It would never have escalated, and the reason was the check, not the models.
  • Published on
    Price per token said Haiku is 40 times cheaper than Opus. My 40 Rust fixes gave other numbers. This is how I compute cost per completed task, with failed attempts, retries, escalation and the fixed overhead of every call.