Do you not see the implicit assumption you are making here? Why should anyone have an automatic right to control something just because it is in their possession at that particular time?
The entire concept of property is an artificial convention, which most societies have decided is beneficial and therefore worthy of respect/legal protection. But physical property is no more "natural" an idea than intellectual property. Both are just social agreements that we choose to value.
As a relevant aside, many societies/cultures throughout history have chosen not to recognise the concept of personal property and instead to hold that everything belongs to the group. In most cases, this has not worked very well on a large scale, which is perhaps why most modern societies have collectively taken the other view.
The entire concept of property is an artificial convention, which most societies have decided is beneficial and therefore worthy of respect/legal protection. But physical property is no more "natural" an idea than intellectual property. Both are just social agreements that we choose to value.
As a relevant aside, many societies/cultures throughout history have chosen not to recognise the concept of personal property and instead to hold that everything belongs to the group. In most cases, this has not worked very well on a large scale, which is perhaps why most modern societies have collectively taken the other view.