You are quite right, the legislation applies to work places and work activities, not what a private individual (i.e. one who takes no money for the activity) does within the confines of their own premises.
As for the "Elves and Safely lot" that's my job in the nuclear industry; I'm one of the Design Elves that makes sure that everybody, including the public, stays safe.
I've seen somebody fall from two stories; it was a pregnant woman who fell through no fault of her own. I saw the aftermath and hope never to see such a thing again. If only the "Elves and Safely" Regulations had been followed ... I've also seen the aftermath of carelessness with a stack of unsecured gas cylinders; it left one dead and four seriously injured. Another case of if only the "Elves and Safely" Regulations had been followed ...
It's great to see you making an effort.
Stay Safe.