Distract yourself or move way away from the door and you'll feel a bit better. Put something with noise on like a cd or a tv and you will feel much better. I was suffereing from something similar to that a few days ago.
I stayed home because I needed to finish my homework a few days ago and I could hear a voice-ish sound and footsteps from upstairs so I go into my dad's room (downstairs) where I could hear the neighbours having a party and I turned on a cd and I felt much safer.
