Don't lose keys when two users are logged in at the same time

If the first user logs out, the Close() call will cause us to lose the key, disrupting the other session.