This is extremely valid question and sadly to newsletters very few times. It’s mainly tied to how close I feel the “relationship” is. Which also applies. A simple “no feedback available, just spring cleaning” also works.
More thinking that social media operates at bigger scale and pace than newsletters. Can't see anybody wanting to be prompted for feedback after every unfollow.