Is the "cost of inference" going up or down?