Unix was originally a networked system that many terminals would connect to. Being able to actually reach the machine meant that you had authority.

It’s the same today. If someone has physical access, the system is so screwed that you can just give total privileges anyways.