Restrict Envelope Custom Fields to Specific User Groups

I think an enhancement to the eSignature and Agreement Manager - (formerly Navigator) workflow would be the admin ability to restrict custom envelope fields to specific user groups. I’ve run into instances where one custom field is required org-wide, but another additional custom field should only be restricted to a team within our business that uses Docusign.