Description: Machine learning models are not black-boxes; these models can easily be interpreted using tools like SHAP, LIME and Anchor. These tools can facilitate the understanding of the model and the business problem. We can used these tools to build better models and communicate how predictions are generated. This article demonstrates their use in a mortality model.