Allow for the User role settings in "attribute set" :
"allow edit"
"allow deletion"
Make it so that admins need permission to delete the attribute set.
Similar to settings in the permissions under user roles:
"Sales -> Orders"
"create"
"view"
"edit"
"cancel" (delete in the case of attribute set)