True, $X always feels like the counterfactual of what you can buy with $X. Which of course includes things you've already bought and wouldn't want to buy more of (the function can saturate).
You'd still agree that if I spent $X and X was my net worth that would be larger signal than if it was merely some small fraction of my net worth. otherwise "All in" means nothing