Why Are Neural Networks a “Black-Box”

  1. Try to understand a simplified version of your problem and use conclusions from the simplified problem to extrapolate something from the original problem.


As disappointing as all this may sound, I would have you keep in mind that we’re not dealing with an easy problem. There are mathematicians whose entire academic careers have been spent dealing with specific types of PDEs and geometric surfaces. It would be incredibly naive to think that solving the black box of neural networks is an easy task. However, this isn’t the same as giving up! We have many good tools — shap, less powerful models, math techniques, new and future technologies — that should be expanded upon to create the best understanding possible. Given the power of neural networks, I find it very likely that they will only become more pervasive in everyday life. given this, it’s extremely important that we develop reasonably good explanation tools.


  1. Hurley, Samantha. Black And White Gift Box Photo. Unknown,
    burst.shopify.com, Online, https://burst.shopify.com/photos/black-and-white-gift-box

I love life, family, math and the internet. I’ve done everything from academic research to digging holes. I can be stubborn but always try to keep and open mind

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store