It's natural that when there's a sense missing, our other senses are heightened. You're going to be more aware of sound outside at night whether you're consciously aware of it or not.
I get freaked out when I'm going to the bathroom at night, because looking down the hall and not being able to make sense of certain shadows that are cast in the darkness as being something harmless isn't something that I'm good at. I run back into my room from wherever I have to go. And if I go outside, I do it quickly.
I'm anxious enough, though. I'm also a very paranoid person. I live in a pretty nice and friendly area, and the police station is just three blocks away, but even then if I see someone approaching me in the darkness ahead, I'll do my best to avoid them for safety reasons. Hop in my car, go in the house, cross the street and make it seem like that was my intention regardless.