Naresh Jain compares coding agents building the same API service with and without a behavioral harness. A frontier model, GPT-6 Sol, passed every external evaluation either way. But a cost-optimized model, GPT-6 Luna, succeeded in only 3 of 10 unharnessed runs and all 10 with the harness. While adding the harness increased token usage and runtime for Luna, the harnessed Luna runs achieved the same 10-for-10 reliability as GPT-6 Sol while costing 33% less per run ($0.273 vs $0.406). This experiment suggests a behavioral harness might be a practical way to get dependable results from smaller, cost-optimized models.
Are Harnesses Worth the Cost?
找兴趣 找喜欢
- Don't Be A Commodity
- Is There An Indexing Bubble?
- U.S. Stocks Might Not Be as Expensive as You Think
- The Most Important Economic Question Of Our Time
- Investing Is Wayfinding
- Are U.S. States Just Like Greece?
- Why Ethical Consumption Is Myth
- Money Is Trust
- Are You A Complacent Investor?
- Is The Economy Really Doing That Poorly?






