Reducing LLM cost in Apex
A product lesson from cutting Apex model cost by roughly 95%.
The first version gave an expensive model too much responsibility. It received broad market context, performed much of the reasoning, and generated the explanation. The result could look intelligent while remaining expensive and difficult to reproduce.