How can I delegate access so another user can manage my contacts?

If you are the manager of a contact label you can create additional managers. These managers have exactly the same permissions as you over the contact label, the contacts and who is able to manage these contacts.