When towns fall, they have chests, lots of chests. If we were allowed to open doors and chests on fallen towns, it would make looting so much easier. Having to pay 5k (town outpost price) is such a pain and once you've payed that, you really just lose money because anything you can find is probably worth less than 5k.
Also, this would allow residents of fallen towns to retrieve stuff which they've lost.