Keeping them locked away serves no purpose. It's not as if there's any sort of reform for them.

[ Finding them and putting an end to it himself has definitely crossed his mind. He doesn't even need to touch them, so how would anyone even know? Death would have ended the problem. ]

All they've done by choosing to imprison them is drag this out further for no reason.