Where do these stupid rules come from? They probably come from the one person in history who managed to get run over in these circumstances, and the chances are that person was also an idiot! It happens in business.
We are all defined by a range of relationships, boss and subordinate, parent and child, friend, sibling, etc. Correct action in each of these relationships may be slightly different - but they all have their own distinct morality and pattern of action and reaction.
Not all jobs are suitable for this kind of working. If your work requires close and frequent synchronous (same place, same time) cooperation with colleagues, then remote working may introduce significant delay unless it can all be achieved through technology.