Because you need regular, low-intensity interaction. Desensitize yourself purposefully to being around people and this will cease to be a problem.