When the model is wrong, can you show your work?
Every output eventually gets challenged — by a regulator, a customer, a lawyer, or the board. “The model said so” is not an answer.
cannot fully trace an AI decision back to its inputs
McKinsey State of AI, 2024