You need to create or use existing Role Centers based on your requirement.
You can assign Sales Manager Role Center a user who wants to see Departments.
You can create a copy of Sales Manager Role Center (Ex: Sales Depot) and remove Departments.
Assign New Role Center Sales Depot to users who dont want to see Departments..
Hope you got what I mean.