Who says you can only owe something if you take something away first?
Think about how rent works. The building or appartement will still be there, loose value over time and need repairs whether you live there or not, yet you still owe the owner rent if you do.