It didn't occur immediately to use Withdraw button to withdraw delegation. It seems like I'm withdrawing from my total deposit. Edit makes me think that I can withdraw delegation. Would love to see user testing around this.