How do Neural Nets work?

Neural Nets are like Crayons for Crazy People: we colour outside the lines, and then blame it on the AI.

How do they get away with it?
What kind of crazy people use Neural Nets?

Only the kind that enjoy being told "it's a neural net" as an excuse for every mistake.

What kind of crazy people use them?