Panic grips border villages, people moving to 'safer places'