The SAI, tracer and optimizer all contain a number of heuristics about when to optimize, how to link the optimized code and when to backoff, etc.

Almost all of these heuristics are just numbers.
We should group them together into a single "policy" object, improving consistency and enabling experimentation.