Source: Deep Learning on Medium
Applied SHAP on the polynomial equation case with LSTM algorithm
keyword: Python, LSTM, SHAP, weights
This article demonstrates the Python SHAP package capability in explaining the LSTM model in a known model. You will learn how to participate in the SHAP package and its accuracy.
Suppose a given model with five input state, each state has own weight factor and sum up with a result y. It represents as below.
The full working code is below.