How to disallow contacts access in Clubhouse?

How to disallow contacts access in Clubhouse?