As a landlord of an apartment, I would certainly expect that I'd have to pay the deposit for the key, not the tenant.
I used to rent a place that had a pool with a secured key. I was never made to give a deposit, but was told that if I lost it, it would cost me $50 for a replacement one.