Freedom is one form of power - the power to stop people initiating force against you. For some people it is the only form of power they want to use. If this were true of everyone, the world would be a very good place. It is not.
The fact that there are people who wish to initiate force against others means that the best that we can do is to find the lesser of the evils.
At the risk of sounding Orwellian -
Freedom is your one and only right. And absolute freedom is not attainable.