> giving permissions to other servers ... is only a detail of how the web interface works.

That is incorrect. To deliver events that interest you, they need to write to your inbox.

> Using a client like Pumpa or Dianara you can follow anyone without ever giving those permissions.

Without ever noticing that you are giving them those permissions.