Every criminal knows they doing wrong, that’s why they try to hide it.

That’s also not really true. They can very well believe, that what they do is okay but they know that the law says otherwise. They hide because they want to avoid punishment, not because they feel that what they do is wrong (From their point of view)