Nope. Kuai is stuck with him forever as he can clearly never go away.

"When you die by my hand it won't be to end your suffering. Besides you are hardly worth killing in your current state. You would be as easy to defeat as any child."

Even if he wasn't here to kill him, he could still poke fun at his skills.