They aren't hard to kill. Any conventional method would work. The sticking point is that when you kill them you send every single person they have under their thrall into a complete mental breakdown. Total insanity, irreversible and usually fatal, pretty quickly. That's the only reason we haven't dealt with him yet.

I honestly don't know what would happen if we killed him while he's in any way attached to Claire.