[Tyler]

Sure, A.I. Is Powerful—But Can We Make It Accountable?
27 October 2016, 11:40 pm

       

... imagine you apply to a firm that uses a machine-learning system, instead of a human with an actuarial table, to predict insurance risk. After crunching your info—age, job, house location and value—the machine decides, nope, no policy for you. You ask the same question: “Why?”

...  Nobody can answer, because nobody understands how these systems—neural networks modeled on the human brain—produce their results. Computer scientists “train” each one by feeding it data, and it gradually learns. But once a neural net is working well, it’s a black box. Ask its creator how it achieves a certain result and you’ll likely get a shrug.

WiredLink

Source: AI in the News

To visit any links mentioned please view the original article, the link is at the top of this post.

[infurl]

That's a problem that is discussed at length in this video. Rather long but interesting.