Glamorous Toolkit (http://gtoolkit.com/) has been mentioned here many times. Here's a very good introduction to how it helps in making systems explainable: . BTW, the code and notebook pages from this talk are part of Glamorous Toolkit, so you can dive in more deeply easily.